[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:17:28.712683  3021 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.243.126:33769
I20260709 13:17:28.714731  3021 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:17:28.716584  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:28.738785  3028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:28.738998  3030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:28.740061  3027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:30.025291  3029 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:17:30.025416  3021 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:17:30.030833  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:30.031163  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:30.031504  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603050031451 us; error 0 us; skew 500 ppm
I20260709 13:17:30.032563  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:30.039839  3021 webserver.cc:533] Webserver started at http://127.2.243.126:43211/ using document root <none> and password file <none>
I20260709 13:17:30.041043  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:30.041333  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:30.041915  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:30.049250  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/master-0-root/instance:
uuid: "ba6f72bdcb394bb0aec4a3cab5793c15"
format_stamp: "Formatted at 2026-07-09 13:17:30 on dist-test-slave-ftjc"
I20260709 13:17:30.059826  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:17:30.066594  3036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:30.068074  3021 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:17:30.068588  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/master-0-root
uuid: "ba6f72bdcb394bb0aec4a3cab5793c15"
format_stamp: "Formatted at 2026-07-09 13:17:30 on dist-test-slave-ftjc"
I20260709 13:17:30.069013  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:30.131515  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:30.133981  3021 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:17:30.135066  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:30.232010  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.126:33769
I20260709 13:17:30.232036  3087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.126:33769 every 8 connection(s)
I20260709 13:17:30.242358  3088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.270470  3088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15: Bootstrap starting.
I20260709 13:17:30.278342  3088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.281104  3088 log.cc:826] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15: Log is configured to *not* fsync() on all Append() calls
I20260709 13:17:30.287074  3088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15: No bootstrap required, opened a new log
I20260709 13:17:30.312247  3088 raft_consensus.cc:359] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba6f72bdcb394bb0aec4a3cab5793c15" member_type: VOTER }
I20260709 13:17:30.313047  3088 raft_consensus.cc:385] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.313321  3088 raft_consensus.cc:740] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6f72bdcb394bb0aec4a3cab5793c15, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.314328  3088 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba6f72bdcb394bb0aec4a3cab5793c15" member_type: VOTER }
I20260709 13:17:30.314877  3088 raft_consensus.cc:399] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:30.315142  3088 raft_consensus.cc:493] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:30.315487  3088 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.320560  3088 raft_consensus.cc:515] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba6f72bdcb394bb0aec4a3cab5793c15" member_type: VOTER }
I20260709 13:17:30.321519  3088 leader_election.cc:304] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba6f72bdcb394bb0aec4a3cab5793c15; no voters: 
I20260709 13:17:30.323675  3088 leader_election.cc:290] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:30.324142  3091 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.328007  3091 raft_consensus.cc:697] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 1 LEADER]: Becoming Leader. State: Replica: ba6f72bdcb394bb0aec4a3cab5793c15, State: Running, Role: LEADER
I20260709 13:17:30.329242  3091 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba6f72bdcb394bb0aec4a3cab5793c15" member_type: VOTER }
I20260709 13:17:30.330541  3088 sys_catalog.cc:565] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:30.344950  3092 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba6f72bdcb394bb0aec4a3cab5793c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba6f72bdcb394bb0aec4a3cab5793c15" member_type: VOTER } }
I20260709 13:17:30.345988  3092 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:30.347627  3093 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba6f72bdcb394bb0aec4a3cab5793c15. Latest consensus state: current_term: 1 leader_uuid: "ba6f72bdcb394bb0aec4a3cab5793c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba6f72bdcb394bb0aec4a3cab5793c15" member_type: VOTER } }
I20260709 13:17:30.348497  3093 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:30.350850  3101 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:30.366232  3101 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:30.369757  3021 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:30.390147  3101 catalog_manager.cc:1383] Generated new cluster ID: 436e78783ead4d23bd2cf74b88fc90af
I20260709 13:17:30.390511  3101 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:30.418610  3101 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:30.420710  3101 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:30.440233  3101 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15: Generated new TSK 0
I20260709 13:17:30.441622  3101 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:30.501955  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:30.514194  3111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:30.513221  3110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:30.519429  3113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:30.519758  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:30.520992  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:30.521252  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:30.521450  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603050521423 us; error 0 us; skew 500 ppm
I20260709 13:17:30.522302  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:30.527899  3021 webserver.cc:533] Webserver started at http://127.2.243.65:35051/ using document root <none> and password file <none>
I20260709 13:17:30.528671  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:30.528929  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:30.529292  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:30.530722  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-0-root/instance:
uuid: "48a58305358643ac95d14bc82edca8e9"
format_stamp: "Formatted at 2026-07-09 13:17:30 on dist-test-slave-ftjc"
I20260709 13:17:30.538405  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.003s
I20260709 13:17:30.544150  3118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:30.545284  3021 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:17:30.545643  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "48a58305358643ac95d14bc82edca8e9"
format_stamp: "Formatted at 2026-07-09 13:17:30 on dist-test-slave-ftjc"
I20260709 13:17:30.546012  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:30.583251  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:30.585078  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:30.588143  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:30.593720  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:30.594040  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:30.594339  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:30.594535  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:30.727957  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:38047
I20260709 13:17:30.728113  3180 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:38047 every 8 connection(s)
I20260709 13:17:30.737826  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:30.750183  3185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:30.757897  3186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:30.764110  3188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:30.765451  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:30.766626  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:30.767831  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:30.768069  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603050768046 us; error 0 us; skew 500 ppm
I20260709 13:17:30.768991  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:30.774534  3021 webserver.cc:533] Webserver started at http://127.2.243.66:43433/ using document root <none> and password file <none>
I20260709 13:17:30.775354  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:30.775646  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:30.776005  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:30.776237  3181 heartbeater.cc:344] Connected to a master server at 127.2.243.126:33769
I20260709 13:17:30.777053  3181 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:30.777894  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-1-root/instance:
uuid: "2025206d4c5b44feb0552bf4a30c960e"
format_stamp: "Formatted at 2026-07-09 13:17:30 on dist-test-slave-ftjc"
I20260709 13:17:30.778519  3181 heartbeater.cc:507] Master 127.2.243.126:33769 requested a full tablet report, sending...
I20260709 13:17:30.783073  3053 ts_manager.cc:194] Registered new tserver with Master: 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047)
I20260709 13:17:30.787174  3053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39798
I20260709 13:17:30.787432  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:17:30.792814  3193 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:30.794060  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:30.794480  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-1-root
uuid: "2025206d4c5b44feb0552bf4a30c960e"
format_stamp: "Formatted at 2026-07-09 13:17:30 on dist-test-slave-ftjc"
I20260709 13:17:30.794992  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:30.829169  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:30.831267  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:30.834435  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:30.838855  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:30.839171  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:30.839466  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:30.839670  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:30.963749  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.66:40867
I20260709 13:17:30.963994  3255 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.66:40867 every 8 connection(s)
I20260709 13:17:30.971827  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:30.985893  3260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:30.986883  3259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:30.992059  3256 heartbeater.cc:344] Connected to a master server at 127.2.243.126:33769
I20260709 13:17:30.992779  3256 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:30.994204  3256 heartbeater.cc:507] Master 127.2.243.126:33769 requested a full tablet report, sending...
I20260709 13:17:30.998217  3053 ts_manager.cc:194] Registered new tserver with Master: 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
W20260709 13:17:30.998277  3262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:31.000828  3053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39812
I20260709 13:17:31.001679  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:31.002843  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:31.003144  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:31.003360  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603051003337 us; error 0 us; skew 500 ppm
I20260709 13:17:31.004122  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:31.007270  3021 webserver.cc:533] Webserver started at http://127.2.243.67:39169/ using document root <none> and password file <none>
I20260709 13:17:31.007822  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:31.008069  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:31.008409  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:31.009562  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-2-root/instance:
uuid: "f226f678f8684102999da97ef283d0d1"
format_stamp: "Formatted at 2026-07-09 13:17:31 on dist-test-slave-ftjc"
I20260709 13:17:31.014870  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:31.019176  3267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:31.020133  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:17:31.020503  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-2-root
uuid: "f226f678f8684102999da97ef283d0d1"
format_stamp: "Formatted at 2026-07-09 13:17:31 on dist-test-slave-ftjc"
I20260709 13:17:31.020848  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603048513324-3021-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:31.034478  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:31.036078  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:31.039703  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:31.043685  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:31.043998  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:31.044472  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:31.044687  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:31.168531  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.67:36189
I20260709 13:17:31.168648  3329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.67:36189 every 8 connection(s)
I20260709 13:17:31.190305  3330 heartbeater.cc:344] Connected to a master server at 127.2.243.126:33769
I20260709 13:17:31.190763  3330 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:31.191754  3330 heartbeater.cc:507] Master 127.2.243.126:33769 requested a full tablet report, sending...
I20260709 13:17:31.194352  3053 ts_manager.cc:194] Registered new tserver with Master: f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:31.195561  3021 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.02142742s
I20260709 13:17:31.195996  3053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39814
I20260709 13:17:31.268142  3053 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39828:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:31.272984  3053 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:17:31.351188  3100 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:31.403666  3293 tablet_service.cc:1511] Processing CreateTablet for tablet 776e4f1d90184191a28a96d25e182ce0 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:31.404528  3294 tablet_service.cc:1511] Processing CreateTablet for tablet 66785f4649de47c5ac74f5bd7e1f796e (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:31.399907  3295 tablet_service.cc:1511] Processing CreateTablet for tablet 7e19dba6f6444ac5b231068c5dca050e (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:31.408774  3293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776e4f1d90184191a28a96d25e182ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.416039  3295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e19dba6f6444ac5b231068c5dca050e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.417869  3294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66785f4649de47c5ac74f5bd7e1f796e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.421284  3292 tablet_service.cc:1511] Processing CreateTablet for tablet 469eed4053ec44ea83a9278099a99ae5 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:31.426244  3292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469eed4053ec44ea83a9278099a99ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.437836  3221 tablet_service.cc:1511] Processing CreateTablet for tablet 7e19dba6f6444ac5b231068c5dca050e (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:31.443297  3291 tablet_service.cc:1511] Processing CreateTablet for tablet bb5dea03f7c64eacb9425c399db2218a (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:31.436386  3220 tablet_service.cc:1511] Processing CreateTablet for tablet 66785f4649de47c5ac74f5bd7e1f796e (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:31.449021  3219 tablet_service.cc:1511] Processing CreateTablet for tablet 776e4f1d90184191a28a96d25e182ce0 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:31.458987  3218 tablet_service.cc:1511] Processing CreateTablet for tablet 469eed4053ec44ea83a9278099a99ae5 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:31.463093  3217 tablet_service.cc:1511] Processing CreateTablet for tablet bb5dea03f7c64eacb9425c399db2218a (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:31.466418  3221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e19dba6f6444ac5b231068c5dca050e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.468302  3220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66785f4649de47c5ac74f5bd7e1f796e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.471400  3291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5dea03f7c64eacb9425c399db2218a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.473047  3219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776e4f1d90184191a28a96d25e182ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.480482  3217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5dea03f7c64eacb9425c399db2218a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.482517  3218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469eed4053ec44ea83a9278099a99ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.517365  3216 tablet_service.cc:1511] Processing CreateTablet for tablet 2741dbe67a5c4b17ac77260eec4f444f (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:31.519179  3216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2741dbe67a5c4b17ac77260eec4f444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.526405  3290 tablet_service.cc:1511] Processing CreateTablet for tablet 2741dbe67a5c4b17ac77260eec4f444f (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:31.529917  3290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2741dbe67a5c4b17ac77260eec4f444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.552234  3289 tablet_service.cc:1511] Processing CreateTablet for tablet 2f99c9e34f344418bc086f9636aced8f (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:31.554764  3289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f99c9e34f344418bc086f9636aced8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.542335  3215 tablet_service.cc:1511] Processing CreateTablet for tablet 2f99c9e34f344418bc086f9636aced8f (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:31.559798  3215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f99c9e34f344418bc086f9636aced8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.584785  3145 tablet_service.cc:1511] Processing CreateTablet for tablet 66785f4649de47c5ac74f5bd7e1f796e (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:31.601248  3141 tablet_service.cc:1511] Processing CreateTablet for tablet 2741dbe67a5c4b17ac77260eec4f444f (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:31.603310  3144 tablet_service.cc:1511] Processing CreateTablet for tablet 776e4f1d90184191a28a96d25e182ce0 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:31.603469  3140 tablet_service.cc:1511] Processing CreateTablet for tablet 2f99c9e34f344418bc086f9636aced8f (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:31.612316  3143 tablet_service.cc:1511] Processing CreateTablet for tablet 469eed4053ec44ea83a9278099a99ae5 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:31.607825  3145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66785f4649de47c5ac74f5bd7e1f796e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.613572  3142 tablet_service.cc:1511] Processing CreateTablet for tablet bb5dea03f7c64eacb9425c399db2218a (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:31.606549  3146 tablet_service.cc:1511] Processing CreateTablet for tablet 7e19dba6f6444ac5b231068c5dca050e (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:31.633245  3143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469eed4053ec44ea83a9278099a99ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.639657  3139 tablet_service.cc:1511] Processing CreateTablet for tablet 7f003c3c4acc4f3ebeab9326d25d5930 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:31.646200  3141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2741dbe67a5c4b17ac77260eec4f444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.651124  3146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e19dba6f6444ac5b231068c5dca050e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.654714  3142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5dea03f7c64eacb9425c399db2218a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.661866  3214 tablet_service.cc:1511] Processing CreateTablet for tablet 7f003c3c4acc4f3ebeab9326d25d5930 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:31.665753  3214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f003c3c4acc4f3ebeab9326d25d5930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.668006  3349 tablet_bootstrap.cc:492] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:31.671444  3144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776e4f1d90184191a28a96d25e182ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.671499  3348 tablet_bootstrap.cc:492] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:31.674788  3139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f003c3c4acc4f3ebeab9326d25d5930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.690353  3140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f99c9e34f344418bc086f9636aced8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.695631  3138 tablet_service.cc:1511] Processing CreateTablet for tablet d738c0749bd045d7be62fef8b4a1b54a (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:31.697909  3138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d738c0749bd045d7be62fef8b4a1b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.735095  3293 tablet_service.cc:1511] Processing CreateTablet for tablet 7f003c3c4acc4f3ebeab9326d25d5930 (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:31.737594  3293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f003c3c4acc4f3ebeab9326d25d5930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.747783  3216 tablet_service.cc:1511] Processing CreateTablet for tablet d738c0749bd045d7be62fef8b4a1b54a (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:31.750172  3216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d738c0749bd045d7be62fef8b4a1b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.773572  3349 tablet_bootstrap.cc:654] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.793534  3289 tablet_service.cc:1511] Processing CreateTablet for tablet d738c0749bd045d7be62fef8b4a1b54a (DEFAULT_TABLE table=test-workload [id=344c5db5d192472db77775105d040e3c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:31.791393  3181 heartbeater.cc:499] Master 127.2.243.126:33769 was elected leader, sending a full tablet report...
I20260709 13:17:31.805171  3289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d738c0749bd045d7be62fef8b4a1b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.873121  3348 tablet_bootstrap.cc:654] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.884984  3349 tablet_bootstrap.cc:492] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:31.897303  3349 ts_tablet_manager.cc:1403] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.230s	user 0.019s	sys 0.029s
I20260709 13:17:31.902215  3351 tablet_bootstrap.cc:492] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:31.917817  3349 raft_consensus.cc:359] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:31.918727  3349 raft_consensus.cc:385] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.919040  3349 raft_consensus.cc:740] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.920115  3349 consensus_queue.cc:260] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:31.923409  3348 tablet_bootstrap.cc:492] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:31.923887  3348 ts_tablet_manager.cc:1403] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.273s	user 0.022s	sys 0.005s
I20260709 13:17:31.925846  3351 tablet_bootstrap.cc:654] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.928337  3348 raft_consensus.cc:359] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:31.929569  3348 raft_consensus.cc:385] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.930039  3348 raft_consensus.cc:740] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.931247  3348 consensus_queue.cc:260] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:31.934891  3330 heartbeater.cc:499] Master 127.2.243.126:33769 was elected leader, sending a full tablet report...
I20260709 13:17:31.940925  3351 tablet_bootstrap.cc:492] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:31.942636  3256 heartbeater.cc:499] Master 127.2.243.126:33769 was elected leader, sending a full tablet report...
I20260709 13:17:31.942304  3349 ts_tablet_manager.cc:1434] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.008s
I20260709 13:17:31.944110  3349 tablet_bootstrap.cc:492] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:31.944516  3351 ts_tablet_manager.cc:1403] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.008s
I20260709 13:17:31.942308  3348 ts_tablet_manager.cc:1434] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:17:31.949043  3348 tablet_bootstrap.cc:492] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:31.951531  3351 raft_consensus.cc:359] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:31.954214  3351 raft_consensus.cc:385] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.954883  3351 raft_consensus.cc:740] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.956139  3351 consensus_queue.cc:260] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:31.958954  3349 tablet_bootstrap.cc:654] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.965834  3348 tablet_bootstrap.cc:654] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:31.979998  3257 tablet.cc:2406] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:32.000550  3351 ts_tablet_manager.cc:1434] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.052s	user 0.018s	sys 0.030s
I20260709 13:17:32.002314  3351 tablet_bootstrap.cc:492] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:32.003337  3348 tablet_bootstrap.cc:492] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:32.003880  3348 ts_tablet_manager.cc:1403] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.019s
I20260709 13:17:32.005501  3349 tablet_bootstrap.cc:492] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:32.006058  3349 ts_tablet_manager.cc:1403] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.017s
I20260709 13:17:32.007332  3348 raft_consensus.cc:359] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.009232  3349 raft_consensus.cc:359] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.009771  3348 raft_consensus.cc:385] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.010023  3349 raft_consensus.cc:385] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.010177  3348 raft_consensus.cc:740] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.010419  3349 raft_consensus.cc:740] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.011140  3348 consensus_queue.cc:260] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.011409  3349 consensus_queue.cc:260] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.014268  3348 ts_tablet_manager.cc:1434] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:17:32.016002  3348 tablet_bootstrap.cc:492] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:32.021389  3351 tablet_bootstrap.cc:654] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.024387  3348 tablet_bootstrap.cc:654] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.033032  3349 ts_tablet_manager.cc:1434] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:17:32.034735  3349 tablet_bootstrap.cc:492] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:32.043568  3351 tablet_bootstrap.cc:492] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:32.044384  3351 ts_tablet_manager.cc:1403] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.010s
I20260709 13:17:32.047865  3348 tablet_bootstrap.cc:492] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:32.048573  3348 ts_tablet_manager.cc:1403] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.011s
I20260709 13:17:32.048184  3351 raft_consensus.cc:359] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.049160  3351 raft_consensus.cc:385] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.049644  3351 raft_consensus.cc:740] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.050746  3351 consensus_queue.cc:260] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.051292  3349 tablet_bootstrap.cc:654] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.052688  3348 raft_consensus.cc:359] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.053167  3351 ts_tablet_manager.cc:1434] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:32.053500  3348 raft_consensus.cc:385] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.053848  3348 raft_consensus.cc:740] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.054257  3351 tablet_bootstrap.cc:492] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:32.054616  3348 consensus_queue.cc:260] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.057281  3348 ts_tablet_manager.cc:1434] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:17:32.058465  3348 tablet_bootstrap.cc:492] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:32.062781  3351 tablet_bootstrap.cc:654] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.067272  3348 tablet_bootstrap.cc:654] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.080529  3349 tablet_bootstrap.cc:492] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:32.081079  3348 tablet_bootstrap.cc:492] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:32.081187  3349 ts_tablet_manager.cc:1403] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.000s
I20260709 13:17:32.081669  3348 ts_tablet_manager.cc:1403] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 13:17:32.082242  3351 tablet_bootstrap.cc:492] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:32.082726  3351 ts_tablet_manager.cc:1403] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.016s
I20260709 13:17:32.084818  3348 raft_consensus.cc:359] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.085158  3349 raft_consensus.cc:359] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.085695  3348 raft_consensus.cc:385] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.086175  3349 raft_consensus.cc:385] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.086217  3348 raft_consensus.cc:740] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.086750  3349 raft_consensus.cc:740] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.087352  3348 consensus_queue.cc:260] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.085876  3351 raft_consensus.cc:359] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.088671  3351 raft_consensus.cc:385] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.089016  3351 raft_consensus.cc:740] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.090186  3348 ts_tablet_manager.cc:1434] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:17:32.089946  3351 consensus_queue.cc:260] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.091595  3348 tablet_bootstrap.cc:492] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:32.092672  3351 ts_tablet_manager.cc:1434] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:17:32.087767  3349 consensus_queue.cc:260] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.100229  3348 tablet_bootstrap.cc:654] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.103965  3351 tablet_bootstrap.cc:492] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:32.109781  3349 ts_tablet_manager.cc:1434] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:17:32.113420  3349 tablet_bootstrap.cc:492] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:32.120245  3351 tablet_bootstrap.cc:654] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.121270  3349 tablet_bootstrap.cc:654] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.126096  3348 tablet_bootstrap.cc:492] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:32.126700  3348 ts_tablet_manager.cc:1403] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.021s
I20260709 13:17:32.131019  3348 raft_consensus.cc:359] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.132632  3348 raft_consensus.cc:385] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.133137  3348 raft_consensus.cc:740] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.136812  3348 consensus_queue.cc:260] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.139539  3348 ts_tablet_manager.cc:1434] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.007s
I20260709 13:17:32.140141  3349 tablet_bootstrap.cc:492] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:32.140316  3356 raft_consensus.cc:493] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.141541  3356 raft_consensus.cc:515] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.142722  3348 tablet_bootstrap.cc:492] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:32.145550  3356 leader_election.cc:290] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.146806  3349 ts_tablet_manager.cc:1403] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.008s
I20260709 13:17:32.155423  3351 tablet_bootstrap.cc:492] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:32.156221  3351 ts_tablet_manager.cc:1403] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.053s	user 0.025s	sys 0.008s
I20260709 13:17:32.181368  3355 raft_consensus.cc:493] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.182217  3355 raft_consensus.cc:515] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.183949  3349 raft_consensus.cc:359] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.184752  3349 raft_consensus.cc:385] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.185047  3349 raft_consensus.cc:740] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.194681  3355 leader_election.cc:290] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.207844  3351 raft_consensus.cc:359] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.211494  3351 raft_consensus.cc:385] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.212040  3351 raft_consensus.cc:740] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.219792  3348 tablet_bootstrap.cc:654] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.220300  3349 consensus_queue.cc:260] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.236654  3351 consensus_queue.cc:260] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.249143  3351 ts_tablet_manager.cc:1434] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.088s	user 0.011s	sys 0.002s
I20260709 13:17:32.252671  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:32.255535  3351 tablet_bootstrap.cc:492] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:32.254762  3231 raft_consensus.cc:2468] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 0.
I20260709 13:17:32.263250  3120 leader_election.cc:304] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:32.262630  3349 ts_tablet_manager.cc:1434] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.113s	user 0.002s	sys 0.016s
I20260709 13:17:32.265875  3349 tablet_bootstrap.cc:492] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:32.270154  3351 tablet_bootstrap.cc:654] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.270056  3356 raft_consensus.cc:493] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.271252  3356 raft_consensus.cc:515] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:32.274226  3355 raft_consensus.cc:493] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.274820  3355 raft_consensus.cc:515] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.276028  3356 leader_election.cc:290] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:32.288620  3356 raft_consensus.cc:2804] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.289269  3356 raft_consensus.cc:493] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.289916  3356 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.289302  3355 leader_election.cc:290] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.314415  3353 raft_consensus.cc:493] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.315333  3353 raft_consensus.cc:515] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.317870  3356 raft_consensus.cc:515] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.321664  3348 tablet_bootstrap.cc:492] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:32.326668  3348 ts_tablet_manager.cc:1403] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.184s	user 0.037s	sys 0.042s
I20260709 13:17:32.329154  3349 tablet_bootstrap.cc:654] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:32.325603  3120 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:40867, user_credentials={real_user=slave}} blocked reactor thread for 62004.2us
I20260709 13:17:32.352511  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.362370  3305 raft_consensus.cc:2468] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 0.
I20260709 13:17:32.368417  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
W20260709 13:17:32.368985  3100 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:32.370090  3351 tablet_bootstrap.cc:492] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:32.371078  3351 ts_tablet_manager.cc:1403] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.119s	user 0.014s	sys 0.012s
I20260709 13:17:32.372457  3356 leader_election.cc:290] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 election: Requested vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.370184  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.374300  3353 leader_election.cc:290] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:32.378495  3353 raft_consensus.cc:493] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.379108  3353 raft_consensus.cc:515] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.379511  3348 raft_consensus.cc:359] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.380268  3348 raft_consensus.cc:385] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.386575  3355 raft_consensus.cc:493] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.387732  3355 raft_consensus.cc:515] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.381870  3353 leader_election.cc:290] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:32.381419  3348 raft_consensus.cc:740] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.393501  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:32.390910  3378 raft_consensus.cc:493] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.390656  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f99c9e34f344418bc086f9636aced8f" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:32.394949  3304 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.394140  3155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
W20260709 13:17:32.394675  3120 leader_election.cc:343] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.397374  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:32.397423  3351 raft_consensus.cc:359] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
W20260709 13:17:32.401618  3121 leader_election.cc:343] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.401904  3231 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.402057  3351 raft_consensus.cc:385] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.402546  3351 raft_consensus.cc:740] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.400115  3355 leader_election.cc:290] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.404713  3351 consensus_queue.cc:260] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.406024  3121 leader_election.cc:304] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9; no voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1
I20260709 13:17:32.407263  3356 raft_consensus.cc:2749] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.406585  3348 consensus_queue.cc:260] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.412626  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:32.414665  3377 raft_consensus.cc:493] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.413462  3156 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:32.426165  3351 ts_tablet_manager.cc:1434] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 13:17:32.429958  3351 tablet_bootstrap.cc:492] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:32.430897  3304 raft_consensus.cc:2468] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 1.
I20260709 13:17:32.428241  3348 ts_tablet_manager.cc:1434] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.101s	user 0.015s	sys 0.031s
I20260709 13:17:32.437170  3356 raft_consensus.cc:493] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.439126  3196 leader_election.cc:343] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.439079  3356 raft_consensus.cc:515] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
W20260709 13:17:32.440412  3196 leader_election.cc:343] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.440635  3349 tablet_bootstrap.cc:492] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:32.441383  3349 ts_tablet_manager.cc:1403] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.009s
I20260709 13:17:32.441309  3196 leader_election.cc:304] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:32.441754  3356 leader_election.cc:290] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.397140  3378 raft_consensus.cc:515] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.442276  3355 raft_consensus.cc:2804] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.416200  3377 raft_consensus.cc:515] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.445219  3355 raft_consensus.cc:493] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:32.445900  3121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:36189, user_credentials={real_user=slave}} blocked reactor thread for 51405.4us
I20260709 13:17:32.448047  3348 tablet_bootstrap.cc:492] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:32.447122  3355 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.446928  3230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:32.451604  3230 raft_consensus.cc:2468] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 0.
I20260709 13:17:32.453867  3231 raft_consensus.cc:2468] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 1.
I20260709 13:17:32.456096  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.460433  3120 leader_election.cc:304] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:32.471130  3378 leader_election.cc:290] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:32.469743  3377 leader_election.cc:290] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.477556  3377 raft_consensus.cc:2804] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.477993  3377 raft_consensus.cc:493] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.478341  3377 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.482021  3351 tablet_bootstrap.cc:654] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.468732  3121 leader_election.cc:304] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:32.486641  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:32.489073  3380 raft_consensus.cc:2804] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:32.489866  3380 raft_consensus.cc:697] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:32.487995  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.492584  3349 raft_consensus.cc:359] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.493458  3349 raft_consensus.cc:385] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:32.493387  3120 leader_election.cc:343] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.470450  3304 raft_consensus.cc:2468] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 0.
I20260709 13:17:32.493963  3380 consensus_queue.cc:237] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
W20260709 13:17:32.494845  3121 leader_election.cc:343] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.494318  3349 raft_consensus.cc:740] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.502038  3355 raft_consensus.cc:515] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.499058  3121 leader_election.cc:304] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9; no voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1
I20260709 13:17:32.506016  3356 raft_consensus.cc:2749] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.507826  3348 tablet_bootstrap.cc:654] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.509361  3349 consensus_queue.cc:260] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.514204  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:32.514886  3156 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.516451  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f99c9e34f344418bc086f9636aced8f" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.516789  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.517576  3304 raft_consensus.cc:2468] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:32.527328  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.528131  3304 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
W20260709 13:17:32.529053  3196 leader_election.cc:343] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.529605  3196 leader_election.cc:304] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e; no voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1
I20260709 13:17:32.536054  3196 leader_election.cc:304] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:32.537941  3351 tablet_bootstrap.cc:492] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:32.530642  3355 leader_election.cc:290] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.540177  3349 ts_tablet_manager.cc:1434] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.098s	user 0.003s	sys 0.022s
I20260709 13:17:32.538668  3351 ts_tablet_manager.cc:1403] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.109s	user 0.023s	sys 0.006s
I20260709 13:17:32.530750  3377 raft_consensus.cc:515] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.547482  3349 tablet_bootstrap.cc:492] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:32.556715  3156 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:32.546078  3355 raft_consensus.cc:2804] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.545835  3351 raft_consensus.cc:359] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.560541  3351 raft_consensus.cc:385] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.564936  3351 raft_consensus.cc:740] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.560784  3355 raft_consensus.cc:493] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.569001  3377 leader_election.cc:290] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 election: Requested vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.568789  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:32.570941  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:32.566095  3355 raft_consensus.cc:3060] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.569654  3230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:32.572244  3229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:32.574396  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:32.574743  3304 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.575526  3305 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.572710  3351 consensus_queue.cc:260] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.578052  3230 raft_consensus.cc:2393] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f226f678f8684102999da97ef283d0d1 in current term 1: Already voted for candidate 48a58305358643ac95d14bc82edca8e9 in this term.
I20260709 13:17:32.578482  3387 raft_consensus.cc:493] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.574889  3231 raft_consensus.cc:2468] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 0.
I20260709 13:17:32.579049  3386 raft_consensus.cc:2749] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.577842  3196 leader_election.cc:304] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:32.597532  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:32.610143  3228 raft_consensus.cc:2393] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f226f678f8684102999da97ef283d0d1 in current term 1: Already voted for candidate 2025206d4c5b44feb0552bf4a30c960e in this term.
I20260709 13:17:32.613878  3053 catalog_manager.cc:5697] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 1 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.616150  3348 tablet_bootstrap.cc:492] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:32.617061  3348 ts_tablet_manager.cc:1403] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.172s	user 0.011s	sys 0.010s
I20260709 13:17:32.611937  3386 raft_consensus.cc:2804] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:32.612290  3269 leader_election.cc:304] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:32.598608  3387 raft_consensus.cc:515] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
W20260709 13:17:32.629596  3196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:38047, user_credentials={real_user=slave}} blocked reactor thread for 54478.2us
I20260709 13:17:32.627970  3304 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:32.625298  3386 raft_consensus.cc:697] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:32.630111  3305 raft_consensus.cc:2468] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 1.
I20260709 13:17:32.634547  3382 raft_consensus.cc:2764] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:32.635219  3351 ts_tablet_manager.cc:1434] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.093s	user 0.014s	sys 0.000s
I20260709 13:17:32.636514  3121 leader_election.cc:304] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 2025206d4c5b44feb0552bf4a30c960e
I20260709 13:17:32.636969  3355 raft_consensus.cc:515] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.637864  3377 raft_consensus.cc:2804] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:32.638451  3377 raft_consensus.cc:697] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:32.639318  3355 leader_election.cc:290] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.639394  3377 consensus_queue.cc:237] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.639554  3348 raft_consensus.cc:359] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.632803  3386 consensus_queue.cc:237] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.642143  3348 raft_consensus.cc:385] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.639844  3351 tablet_bootstrap.cc:492] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:32.642508  3348 raft_consensus.cc:740] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.642526  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f99c9e34f344418bc086f9636aced8f" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:32.645398  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f99c9e34f344418bc086f9636aced8f" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:32.646003  3305 raft_consensus.cc:3060] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.645851  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:32.646761  3155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:32.647372  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:32.654513  3154 raft_consensus.cc:2393] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f226f678f8684102999da97ef283d0d1 in current term 1: Already voted for candidate 2025206d4c5b44feb0552bf4a30c960e in this term.
W20260709 13:17:32.648620  3196 leader_election.cc:343] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.655769  3270 leader_election.cc:304] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f226f678f8684102999da97ef283d0d1; no voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:32.655165  3348 consensus_queue.cc:260] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.658308  3382 raft_consensus.cc:2749] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.660859  3348 ts_tablet_manager.cc:1434] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:17:32.663280  3348 tablet_bootstrap.cc:492] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:32.663344  3270 leader_election.cc:304] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f226f678f8684102999da97ef283d0d1; no voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:32.664753  3382 raft_consensus.cc:2749] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.669390  3349 tablet_bootstrap.cc:654] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.673233  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:32.674593  3154 raft_consensus.cc:2468] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:32.675139  3382 raft_consensus.cc:493] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.675990  3382 raft_consensus.cc:515] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.677189  3196 leader_election.cc:304] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:32.680464  3355 raft_consensus.cc:2804] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.681108  3355 raft_consensus.cc:493] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.681627  3355 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.679963  3387 leader_election.cc:290] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.684525  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.685343  3382 leader_election.cc:290] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:32.685266  3304 raft_consensus.cc:2468] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:32.688109  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:32.683714  3305 raft_consensus.cc:2468] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:32.699136  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:32.699716  3196 leader_election.cc:304] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:32.699906  3154 raft_consensus.cc:2468] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 0.
I20260709 13:17:32.700708  3386 raft_consensus.cc:2804] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:32.701260  3386 raft_consensus.cc:697] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:32.702534  3386 consensus_queue.cc:237] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.701489  3270 leader_election.cc:304] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:32.705056  3382 raft_consensus.cc:2804] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.704737  3355 raft_consensus.cc:515] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.705231  3351 tablet_bootstrap.cc:654] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.705492  3382 raft_consensus.cc:493] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.705899  3382 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.706077  3228 raft_consensus.cc:2393] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f226f678f8684102999da97ef283d0d1 in current term 1: Already voted for candidate 2025206d4c5b44feb0552bf4a30c960e in this term.
I20260709 13:17:32.709713  3355 leader_election.cc:290] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.710997  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:32.714521  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:32.716492  3154 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.714592  3349 tablet_bootstrap.cc:492] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:32.719120  3349 ts_tablet_manager.cc:1403] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.013s
I20260709 13:17:32.741379  3351 tablet_bootstrap.cc:492] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:32.741930  3351 ts_tablet_manager.cc:1403] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.014s
I20260709 13:17:32.741693  3349 raft_consensus.cc:359] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.742503  3349 raft_consensus.cc:385] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.742818  3349 raft_consensus.cc:740] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.744107  3154 raft_consensus.cc:2468] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:32.743816  3349 consensus_queue.cc:260] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.746840  3196 leader_election.cc:304] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:32.740135  3348 tablet_bootstrap.cc:654] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.748191  3386 raft_consensus.cc:2804] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:32.745208  3351 raft_consensus.cc:359] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.748935  3386 raft_consensus.cc:697] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:32.749215  3351 raft_consensus.cc:385] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.747419  3382 raft_consensus.cc:515] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.749688  3351 raft_consensus.cc:740] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.750043  3386 consensus_queue.cc:237] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.751160  3305 raft_consensus.cc:2393] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2025206d4c5b44feb0552bf4a30c960e in current term 1: Already voted for candidate f226f678f8684102999da97ef283d0d1 in this term.
I20260709 13:17:32.756116  3349 ts_tablet_manager.cc:1434] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.034s	user 0.000s	sys 0.009s
I20260709 13:17:32.750787  3351 consensus_queue.cc:260] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.758831  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:32.758952  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:32.760159  3154 raft_consensus.cc:2393] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f226f678f8684102999da97ef283d0d1 in current term 1: Already voted for candidate 2025206d4c5b44feb0552bf4a30c960e in this term.
I20260709 13:17:32.761677  3382 leader_election.cc:290] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:32.761698  3270 leader_election.cc:304] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f226f678f8684102999da97ef283d0d1; no voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:32.764982  3052 catalog_manager.cc:5697] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.765794  3382 raft_consensus.cc:2749] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.794183  3349 tablet_bootstrap.cc:492] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:32.794715  3053 catalog_manager.cc:5697] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 1 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.805630  3351 ts_tablet_manager.cc:1434] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.005s
I20260709 13:17:32.810544  3351 tablet_bootstrap.cc:492] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:32.814360  3348 tablet_bootstrap.cc:492] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:32.815585  3051 catalog_manager.cc:5697] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.820762  3351 tablet_bootstrap.cc:654] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.820808  3348 ts_tablet_manager.cc:1403] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.039s
I20260709 13:17:32.821792  3051 catalog_manager.cc:5697] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.818657  3349 tablet_bootstrap.cc:654] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.831951  3348 raft_consensus.cc:359] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.833854  3348 raft_consensus.cc:385] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.834241  3348 raft_consensus.cc:740] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.835069  3348 consensus_queue.cc:260] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.837643  3348 ts_tablet_manager.cc:1434] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:17:32.837646  3351 tablet_bootstrap.cc:492] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:32.839903  3348 tablet_bootstrap.cc:492] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e: Bootstrap starting.
I20260709 13:17:32.840036  3351 ts_tablet_manager.cc:1403] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.014s
I20260709 13:17:32.843225  3351 raft_consensus.cc:359] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.843995  3351 raft_consensus.cc:385] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.844302  3351 raft_consensus.cc:740] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.846942  3349 tablet_bootstrap.cc:492] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:32.847820  3349 ts_tablet_manager.cc:1403] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.007s
I20260709 13:17:32.848762  3348 tablet_bootstrap.cc:654] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.851368  3349 raft_consensus.cc:359] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:32.852176  3349 raft_consensus.cc:385] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.852532  3349 raft_consensus.cc:740] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.852780  3351 consensus_queue.cc:260] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.853499  3349 consensus_queue.cc:260] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:32.855898  3351 ts_tablet_manager.cc:1434] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:17:32.856693  3349 ts_tablet_manager.cc:1434] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:17:32.857082  3351 tablet_bootstrap.cc:492] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9: Bootstrap starting.
I20260709 13:17:32.857740  3349 tablet_bootstrap.cc:492] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:32.865540  3351 tablet_bootstrap.cc:654] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.865895  3349 tablet_bootstrap.cc:654] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.868790  3386 raft_consensus.cc:493] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.869451  3386 raft_consensus.cc:515] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.873807  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:32.874612  3154 raft_consensus.cc:2468] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:32.875681  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:32.876495  3196 leader_election.cc:304] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:32.877588  3386 leader_election.cc:290] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
W20260709 13:17:32.877885  3196 leader_election.cc:343] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.878361  3386 raft_consensus.cc:2804] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.878844  3386 raft_consensus.cc:493] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.879298  3386 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.896749  3386 raft_consensus.cc:515] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.902247  3348 tablet_bootstrap.cc:492] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e: No bootstrap required, opened a new log
I20260709 13:17:32.902624  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:32.903829  3348 ts_tablet_manager.cc:1403] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.031s
I20260709 13:17:32.904027  3154 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.907348  3348 raft_consensus.cc:359] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:32.908303  3348 raft_consensus.cc:385] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.908756  3348 raft_consensus.cc:740] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.909637  3348 consensus_queue.cc:260] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:32.912097  3348 ts_tablet_manager.cc:1434] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:17:32.919911  3154 raft_consensus.cc:2468] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:32.920133  3351 tablet_bootstrap.cc:492] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9: No bootstrap required, opened a new log
I20260709 13:17:32.921303  3351 ts_tablet_manager.cc:1403] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9: Time spent bootstrapping tablet: real 0.064s	user 0.033s	sys 0.027s
I20260709 13:17:32.922184  3386 leader_election.cc:290] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:32.922643  3196 leader_election.cc:304] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:32.924363  3349 tablet_bootstrap.cc:492] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:32.924657  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:32.924973  3351 raft_consensus.cc:359] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.925843  3351 raft_consensus.cc:385] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.926182  3351 raft_consensus.cc:740] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Initialized, Role: FOLLOWER
W20260709 13:17:32.926457  3196 leader_election.cc:343] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.924860  3349 ts_tablet_manager.cc:1403] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.004s
I20260709 13:17:32.927130  3351 consensus_queue.cc:260] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.929946  3351 ts_tablet_manager.cc:1434] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:17:32.930881  3386 raft_consensus.cc:2804] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:32.932289  3386 raft_consensus.cc:697] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:32.933457  3386 consensus_queue.cc:237] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.930334  3349 raft_consensus.cc:359] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.934836  3349 raft_consensus.cc:385] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.935187  3349 raft_consensus.cc:740] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.936072  3349 consensus_queue.cc:260] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.939189  3349 ts_tablet_manager.cc:1434] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:32.940202  3349 tablet_bootstrap.cc:492] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1: Bootstrap starting.
I20260709 13:17:32.947070  3349 tablet_bootstrap.cc:654] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.954309  3349 tablet_bootstrap.cc:492] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1: No bootstrap required, opened a new log
I20260709 13:17:32.954941  3349 ts_tablet_manager.cc:1403] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:17:32.957878  3349 raft_consensus.cc:359] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.958523  3349 raft_consensus.cc:385] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.958777  3349 raft_consensus.cc:740] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.959523  3349 consensus_queue.cc:260] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:32.962630  3349 ts_tablet_manager.cc:1434] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:17:32.965134  3051 catalog_manager.cc:5697] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.979732  3377 consensus_queue.cc:1048] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.006779  3386 raft_consensus.cc:493] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.007125  3356 consensus_queue.cc:1048] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.007426  3386 raft_consensus.cc:515] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.010941  3386 leader_election.cc:290] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:33.011991  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:33.012749  3154 raft_consensus.cc:2468] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:33.014222  3196 leader_election.cc:304] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:33.015369  3355 raft_consensus.cc:2804] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:33.015872  3355 raft_consensus.cc:493] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.016271  3355 raft_consensus.cc:3060] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.016693  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:33.017584  3305 raft_consensus.cc:2468] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:33.030011  3355 raft_consensus.cc:515] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.034184  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:33.034968  3154 raft_consensus.cc:3060] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.038583  3355 leader_election.cc:290] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:33.038846  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:33.039569  3305 raft_consensus.cc:3060] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.043045  3154 raft_consensus.cc:2468] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:33.044546  3196 leader_election.cc:304] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:33.046020  3355 raft_consensus.cc:2804] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:33.046787  3355 raft_consensus.cc:697] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:33.047508  3305 raft_consensus.cc:2468] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:33.048122  3355 consensus_queue.cc:237] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.057688  3052 catalog_manager.cc:5697] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.059100  3228 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.069276  3356 consensus_queue.cc:1048] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.087069  3356 consensus_queue.cc:1048] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.110301  3355 raft_consensus.cc:493] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.110924  3355 raft_consensus.cc:515] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:33.113413  3355 leader_election.cc:290] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189), 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047)
I20260709 13:17:33.116288  3155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:33.117148  3155 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:33.117343  3355 consensus_queue.cc:1048] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:33.118458  3196 leader_election.cc:304] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:33.119315  3386 raft_consensus.cc:2804] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:33.119711  3386 raft_consensus.cc:493] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.120069  3386 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.117163  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:33.122064  3305 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 0.
I20260709 13:17:33.129566  3382 raft_consensus.cc:493] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.129312  3386 raft_consensus.cc:515] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:33.130100  3382 raft_consensus.cc:515] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.134482  3386 leader_election.cc:290] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Requested vote from peers f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189), 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047)
I20260709 13:17:33.135370  3382 leader_election.cc:290] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:33.135610  3377 raft_consensus.cc:493] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.137187  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:33.137269  3377 raft_consensus.cc:515] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.138038  3228 raft_consensus.cc:2468] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 0.
I20260709 13:17:33.139122  3389 consensus_queue.cc:1048] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:33.139699  3377 leader_election.cc:290] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:33.140451  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:33.141093  3305 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.141376  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:33.141618  3269 leader_election.cc:304] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:33.141976  3156 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.142689  3382 raft_consensus.cc:2804] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:33.143158  3382 raft_consensus.cc:493] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.143579  3382 raft_consensus.cc:3060] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.147670  3154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9" is_pre_election: true
I20260709 13:17:33.148532  3154 raft_consensus.cc:2468] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 0.
I20260709 13:17:33.148761  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e" is_pre_election: true
I20260709 13:17:33.149585  3228 raft_consensus.cc:2468] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 0.
I20260709 13:17:33.151019  3120 leader_election.cc:304] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:33.151213  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1" is_pre_election: true
I20260709 13:17:33.152104  3377 raft_consensus.cc:2804] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:33.152630  3377 raft_consensus.cc:493] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.153087  3377 raft_consensus.cc:3060] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.155074  3305 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:33.157687  3196 leader_election.cc:304] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:33.162637  3156 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 1.
I20260709 13:17:33.165167  3386 raft_consensus.cc:2804] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:33.165999  3386 raft_consensus.cc:697] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:33.166908  3386 consensus_queue.cc:237] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:33.168867  3382 raft_consensus.cc:515] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.171281  3304 raft_consensus.cc:2393] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48a58305358643ac95d14bc82edca8e9 in current term 1: Already voted for candidate f226f678f8684102999da97ef283d0d1 in this term.
I20260709 13:17:33.171103  3377 raft_consensus.cc:515] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.174860  3377 leader_election.cc:290] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 election: Requested vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:33.175938  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:33.176783  3228 raft_consensus.cc:3060] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.185526  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:33.186522  3305 raft_consensus.cc:2393] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48a58305358643ac95d14bc82edca8e9 in current term 1: Already voted for candidate f226f678f8684102999da97ef283d0d1 in this term.
I20260709 13:17:33.186393  3052 catalog_manager.cc:5697] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.190126  3228 raft_consensus.cc:2468] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 1.
I20260709 13:17:33.190237  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:33.191190  3156 raft_consensus.cc:2393] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f226f678f8684102999da97ef283d0d1 in current term 1: Already voted for candidate 48a58305358643ac95d14bc82edca8e9 in this term.
I20260709 13:17:33.191639  3120 leader_election.cc:304] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: f226f678f8684102999da97ef283d0d1
I20260709 13:17:33.192977  3377 raft_consensus.cc:2804] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:33.194212  3382 leader_election.cc:290] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:33.194981  3377 raft_consensus.cc:697] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:33.195428  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:33.196723  3231 raft_consensus.cc:2393] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f226f678f8684102999da97ef283d0d1 in current term 1: Already voted for candidate 48a58305358643ac95d14bc82edca8e9 in this term.
I20260709 13:17:33.196301  3377 consensus_queue.cc:237] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.198402  3269 leader_election.cc:304] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f226f678f8684102999da97ef283d0d1; no voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:33.200966  3382 raft_consensus.cc:2749] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:33.216660  3052 catalog_manager.cc:5697] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 1 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.219735  3156 raft_consensus.cc:3060] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.228163  3386 consensus_queue.cc:1048] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.242348  3389 consensus_queue.cc:1048] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:33.278920  3386 consensus_queue.cc:1048] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.294943  3355 consensus_queue.cc:1048] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.329126  3355 consensus_queue.cc:1048] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:33.341498  3305 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.351795  3387 consensus_queue.cc:1048] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.491288  3387 consensus_queue.cc:1048] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:33.507663  3387 consensus_queue.cc:1048] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.655503  3231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:50956
I20260709 13:17:33.656445  3231 raft_consensus.cc:606] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Received request to transfer leadership to TS 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:33.659708  3387 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:33.672698  3231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:50956
I20260709 13:17:33.673480  3231 raft_consensus.cc:606] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Received request to transfer leadership to TS 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:33.676836  3355 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:33.685356  3231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:50956
I20260709 13:17:33.686064  3231 raft_consensus.cc:606] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Received request to transfer leadership to TS 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:33.691052  3355 raft_consensus.cc:993] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:33.691576  3355 raft_consensus.cc:1081] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Signalling peer 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:33.696834  3155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:17:33.697553  3155 raft_consensus.cc:493] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.697983  3155 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.713315  3155 raft_consensus.cc:515] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:33.717438  3155 leader_election.cc:290] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 2 election: Requested vote from peers f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:33.718706  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:33.719569  3305 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.722895  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:33.723615  3231 raft_consensus.cc:3055] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.723960  3231 raft_consensus.cc:740] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:33.725066  3231 consensus_queue.cc:260] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:33.728152  3231 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.728693  3305 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 2.
I20260709 13:17:33.728735  3155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
mode: GRACEFUL
new_leader_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:35550
I20260709 13:17:33.729606  3155 raft_consensus.cc:606] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Received request to transfer leadership to TS 2025206d4c5b44feb0552bf4a30c960e
I20260709 13:17:33.730286  3121 leader_election.cc:304] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:33.731526  3377 raft_consensus.cc:2804] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.732015  3377 raft_consensus.cc:697] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:33.733152  3377 consensus_queue.cc:237] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:33.736888  3231 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 2.
I20260709 13:17:33.738698  3155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
mode: GRACEFUL
new_leader_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:35550
I20260709 13:17:33.739197  3155 raft_consensus.cc:606] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Received request to transfer leadership to TS 2025206d4c5b44feb0552bf4a30c960e
I20260709 13:17:33.742751  3052 catalog_manager.cc:5697] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 1 to 2, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.762676  3231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:50956
I20260709 13:17:33.763389  3231 raft_consensus.cc:606] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Received request to transfer leadership to TS f226f678f8684102999da97ef283d0d1
I20260709 13:17:33.799283  3377 consensus_queue.cc:1048] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:33.804840  3356 consensus_queue.cc:1048] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.810110  3380 raft_consensus.cc:993] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9: : Instructing follower 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:33.810617  3380 raft_consensus.cc:1081] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Signalling peer 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:33.816210  3228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:48358
I20260709 13:17:33.818341  3228 raft_consensus.cc:493] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.818961  3228 raft_consensus.cc:3060] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.828265  3228 raft_consensus.cc:515] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.829761  3231 raft_consensus.cc:1240] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Rejecting Update request from peer 48a58305358643ac95d14bc82edca8e9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.831743  3377 consensus_queue.cc:1059] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:33.832029  3155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:33.833163  3155 raft_consensus.cc:3055] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.833549  3155 raft_consensus.cc:740] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:33.834452  3155 consensus_queue.cc:260] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.835755  3155 raft_consensus.cc:3060] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.837765  3355 raft_consensus.cc:993] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:33.838270  3355 raft_consensus.cc:1081] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Signalling peer 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:33.843102  3156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:17:33.843783  3156 raft_consensus.cc:493] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.844197  3156 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.844973  3228 leader_election.cc:290] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 2 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:33.846979  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2741dbe67a5c4b17ac77260eec4f444f" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:33.847311  3155 raft_consensus.cc:2468] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 2.
I20260709 13:17:33.847667  3304 raft_consensus.cc:3060] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.849061  3196 leader_election.cc:304] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:33.850193  3386 raft_consensus.cc:2804] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.850682  3386 raft_consensus.cc:697] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:33.851598  3386 consensus_queue.cc:237] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
W20260709 13:17:33.853319  3377 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:17:33.855655  3156 raft_consensus.cc:515] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.859603  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:33.860324  3228 raft_consensus.cc:3055] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.860752  3228 raft_consensus.cc:740] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:33.863982  3228 consensus_queue.cc:260] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.865201  3228 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.866104  3156 leader_election.cc:290] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 2 election: Requested vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:33.866374  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:33.867002  3305 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.861323  3304 raft_consensus.cc:2468] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 2.
I20260709 13:17:33.874125  3228 raft_consensus.cc:2468] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 2.
I20260709 13:17:33.875906  3120 leader_election.cc:304] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:33.876937  3377 raft_consensus.cc:2804] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.877502  3377 raft_consensus.cc:697] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:33.878384  3377 consensus_queue.cc:237] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:33.881982  3305 raft_consensus.cc:2468] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 2.
I20260709 13:17:33.884142  3052 catalog_manager.cc:5697] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 1 to 2, leader changed from 48a58305358643ac95d14bc82edca8e9 (127.2.243.65) to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.893647  3051 catalog_manager.cc:5697] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 1 to 2, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.001864  3387 raft_consensus.cc:993] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:34.002434  3387 raft_consensus.cc:1081] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Signalling peer f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:34.004604  3305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a"
dest_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:17:34.005283  3305 raft_consensus.cc:493] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.005667  3305 raft_consensus.cc:3060] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.007588  3380 raft_consensus.cc:993] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9: : Instructing follower 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:34.008082  3377 raft_consensus.cc:1081] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Signalling peer 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:34.009939  3228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:48358
I20260709 13:17:34.010679  3228 raft_consensus.cc:493] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.011161  3228 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.014067  3305 raft_consensus.cc:515] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.017359  3228 raft_consensus.cc:515] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.017751  3155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:34.017840  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738c0749bd045d7be62fef8b4a1b54a" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:34.018431  3155 raft_consensus.cc:3060] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.018524  3231 raft_consensus.cc:3055] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.018428  3305 leader_election.cc:290] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 2 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:34.019071  3231 raft_consensus.cc:740] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:34.020108  3231 consensus_queue.cc:260] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.021385  3231 raft_consensus.cc:3060] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.021775  3228 leader_election.cc:290] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 2 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:34.024017  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:34.024780  3305 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.024876  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:34.025588  3156 raft_consensus.cc:3055] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.025951  3156 raft_consensus.cc:740] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:34.027309  3155 raft_consensus.cc:2468] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 2.
I20260709 13:17:34.028643  3270 leader_election.cc:304] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:34.029592  3382 raft_consensus.cc:2804] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.029532  3156 consensus_queue.cc:260] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.031035  3382 raft_consensus.cc:697] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 2 LEADER]: Becoming Leader. State: Replica: f226f678f8684102999da97ef283d0d1, State: Running, Role: LEADER
I20260709 13:17:34.031140  3156 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.032032  3382 consensus_queue.cc:237] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.040066  3387 raft_consensus.cc:993] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:34.040623  3387 raft_consensus.cc:1081] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Signalling peer 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:34.042725  3155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:17:34.043501  3155 raft_consensus.cc:493] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.042652  3051 catalog_manager.cc:5697] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 reported cstate change: term changed from 1 to 2, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to f226f678f8684102999da97ef283d0d1 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "f226f678f8684102999da97ef283d0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.045562  3305 raft_consensus.cc:2468] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 2.
I20260709 13:17:34.043915  3155 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.046928  3196 leader_election.cc:304] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:34.048036  3355 raft_consensus.cc:2804] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.048584  3355 raft_consensus.cc:697] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:34.049551  3355 consensus_queue.cc:237] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.061646  3155 raft_consensus.cc:515] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.064807  3231 raft_consensus.cc:2468] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 2.
I20260709 13:17:34.065900  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:34.066582  3228 raft_consensus.cc:3055] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.057005  3156 raft_consensus.cc:2468] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 2.
I20260709 13:17:34.066962  3228 raft_consensus.cc:740] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:34.067977  3228 consensus_queue.cc:260] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.068435  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:34.064435  3155 leader_election.cc:290] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 2 election: Requested vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:34.069334  3228 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.069196  3305 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.073154  3051 catalog_manager.cc:5697] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 1 to 2, leader changed from 48a58305358643ac95d14bc82edca8e9 (127.2.243.65) to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.081161  3228 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 2.
I20260709 13:17:34.081202  3305 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 2.
I20260709 13:17:34.083597  3121 leader_election.cc:304] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:34.084625  3377 raft_consensus.cc:2804] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.085160  3377 raft_consensus.cc:697] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:34.085897  3377 consensus_queue.cc:237] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:34.095440  3051 catalog_manager.cc:5697] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 1 to 2, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.240243  3305 raft_consensus.cc:1275] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.242097  3386 consensus_queue.cc:1048] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.254189  3155 raft_consensus.cc:1275] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.256446  3386 consensus_queue.cc:1048] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.281409  3305 raft_consensus.cc:1275] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.283002  3377 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.291386  3228 raft_consensus.cc:1275] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.293154  3380 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.340696  3228 raft_consensus.cc:1275] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.342262  3380 consensus_queue.cc:1048] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.352576  3305 raft_consensus.cc:1275] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.354815  3377 consensus_queue.cc:1048] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.508163  3155 raft_consensus.cc:1275] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.509958  3382 consensus_queue.cc:1048] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.520061  3228 raft_consensus.cc:1275] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.521993  3382 consensus_queue.cc:1048] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.536695  3305 raft_consensus.cc:1275] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.538504  3155 raft_consensus.cc:1275] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.538232  3386 consensus_queue.cc:1048] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.540074  3386 consensus_queue.cc:1048] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.544579  3304 raft_consensus.cc:1275] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.546254  3377 consensus_queue.cc:1048] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.561921  3228 raft_consensus.cc:1275] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.564592  3356 consensus_queue.cc:1048] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:36.809628  3021 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:17:36.811442  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:36.837198  3156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
mode: GRACEFUL
new_leader_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:35562
I20260709 13:17:36.837893  3156 raft_consensus.cc:606] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Received request to transfer leadership to TS f226f678f8684102999da97ef283d0d1
I20260709 13:17:36.855319  3228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:50972
I20260709 13:17:36.856122  3228 raft_consensus.cc:606] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Received request to transfer leadership to TS f226f678f8684102999da97ef283d0d1
I20260709 13:17:36.858063  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:36.858716  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:36.873698  3452 raft_consensus.cc:993] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9: : Instructing follower f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:36.874218  3452 raft_consensus.cc:1081] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Signalling peer f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:36.876201  3304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e"
dest_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:54820
I20260709 13:17:36.876832  3304 raft_consensus.cc:493] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:36.877125  3304 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.883108  3304 raft_consensus.cc:515] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:36.886322  3304 leader_election.cc:290] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 3 election: Requested vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047)
I20260709 13:17:36.887419  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:36.887663  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:36.888033  3156 raft_consensus.cc:3055] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:36.888546  3156 raft_consensus.cc:740] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:36.888607  3228 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.889478  3156 consensus_queue.cc:260] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:36.890677  3156 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.896080  3228 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 3.
I20260709 13:17:36.896252  3156 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 3.
I20260709 13:17:36.897758  3269 leader_election.cc:304] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:36.898849  3450 raft_consensus.cc:2804] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:36.900686  3450 raft_consensus.cc:697] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 3 LEADER]: Becoming Leader. State: Replica: f226f678f8684102999da97ef283d0d1, State: Running, Role: LEADER
I20260709 13:17:36.901508  3450 consensus_queue.cc:237] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:36.916697  3052 catalog_manager.cc:5697] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 reported cstate change: term changed from 2 to 3, leader changed from 48a58305358643ac95d14bc82edca8e9 (127.2.243.65) to f226f678f8684102999da97ef283d0d1 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "f226f678f8684102999da97ef283d0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.940762  3463 raft_consensus.cc:993] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:36.941427  3463 raft_consensus.cc:1081] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Signalling peer f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:36.943809  3304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930"
dest_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:17:36.944615  3304 raft_consensus.cc:493] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:36.945456  3304 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.953048  3304 raft_consensus.cc:515] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:36.956077  3304 leader_election.cc:290] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 2 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:36.956496  3155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:36.957211  3155 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.957316  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:36.958071  3228 raft_consensus.cc:3055] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:36.958323  3228 raft_consensus.cc:740] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:36.959065  3228 consensus_queue.cc:260] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:36.960017  3228 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.964041  3155 raft_consensus.cc:2468] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 2.
I20260709 13:17:36.966332  3270 leader_election.cc:304] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:36.967347  3228 raft_consensus.cc:2468] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 2.
I20260709 13:17:36.967620  3450 raft_consensus.cc:2804] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:36.968410  3450 raft_consensus.cc:697] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 2 LEADER]: Becoming Leader. State: Replica: f226f678f8684102999da97ef283d0d1, State: Running, Role: LEADER
I20260709 13:17:36.969347  3450 consensus_queue.cc:237] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:36.978143  3052 catalog_manager.cc:5697] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 reported cstate change: term changed from 1 to 2, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to f226f678f8684102999da97ef283d0d1 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "f226f678f8684102999da97ef283d0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.378661  3228 raft_consensus.cc:1275] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:37.380554  3450 consensus_queue.cc:1048] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:37.394062  3155 raft_consensus.cc:1275] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:37.396332  3450 consensus_queue.cc:1048] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:37.408679  3155 raft_consensus.cc:1275] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:37.411149  3467 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:37.423857  3228 raft_consensus.cc:1275] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:37.426220  3467 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:37.859899  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:37.885951  3305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e"
dest_uuid: "f226f678f8684102999da97ef283d0d1"
mode: GRACEFUL
new_leader_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:56394
I20260709 13:17:37.886423  3305 raft_consensus.cc:606] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 3 LEADER]: Received request to transfer leadership to TS 2025206d4c5b44feb0552bf4a30c960e
I20260709 13:17:37.893230  3155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
mode: GRACEFUL
new_leader_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:35550
I20260709 13:17:37.893915  3155 raft_consensus.cc:606] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Received request to transfer leadership to TS 2025206d4c5b44feb0552bf4a30c960e
I20260709 13:17:37.897447  3450 raft_consensus.cc:993] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1: : Instructing follower 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:37.898162  3467 raft_consensus.cc:1081] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 3 LEADER]: Signalling peer 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:37.900080  3228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:48374
I20260709 13:17:37.900712  3228 raft_consensus.cc:493] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:37.900646  3155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
mode: GRACEFUL
new_leader_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:35550
I20260709 13:17:37.901472  3228 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.901834  3155 raft_consensus.cc:606] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Received request to transfer leadership to TS 2025206d4c5b44feb0552bf4a30c960e
I20260709 13:17:37.907855  3228 raft_consensus.cc:515] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:37.909617  3155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
mode: GRACEFUL
new_leader_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:35550
I20260709 13:17:37.909883  3228 leader_election.cc:290] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 4 election: Requested vote from peers f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189), 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047)
I20260709 13:17:37.910784  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:37.911456  3305 raft_consensus.cc:3055] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:37.911755  3305 raft_consensus.cc:740] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Running, Role: LEADER
I20260709 13:17:37.912662  3305 consensus_queue.cc:260] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:37.913802  3305 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.916663  3155 raft_consensus.cc:606] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Received request to transfer leadership to TS 2025206d4c5b44feb0552bf4a30c960e
I20260709 13:17:37.918177  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:37.919171  3156 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.920199  3305 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 4.
I20260709 13:17:37.921872  3196 leader_election.cc:304] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:37.922771  3473 raft_consensus.cc:2804] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:37.923435  3473 raft_consensus.cc:697] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 4 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:37.924587  3473 consensus_queue.cc:237] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:37.928323  3156 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 4.
I20260709 13:17:37.935281  3051 catalog_manager.cc:5697] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 3 to 4, leader changed from f226f678f8684102999da97ef283d0d1 (127.2.243.67) to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 4 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.936113  3305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930"
dest_uuid: "f226f678f8684102999da97ef283d0d1"
mode: GRACEFUL
new_leader_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:56394
I20260709 13:17:37.937041  3305 raft_consensus.cc:606] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 2 LEADER]: Received request to transfer leadership to TS 2025206d4c5b44feb0552bf4a30c960e
I20260709 13:17:38.015808  3467 raft_consensus.cc:993] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1: : Instructing follower 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:38.016394  3467 raft_consensus.cc:1081] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 2 LEADER]: Signalling peer 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:38.018107  3228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:48374
I20260709 13:17:38.018622  3228 raft_consensus.cc:493] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.018901  3228 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.024497  3228 raft_consensus.cc:515] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.026317  3228 leader_election.cc:290] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 3 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:38.027861  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:38.027877  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:38.028877  3305 raft_consensus.cc:3055] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:38.029063  3156 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.029217  3305 raft_consensus.cc:740] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f226f678f8684102999da97ef283d0d1, State: Running, Role: LEADER
I20260709 13:17:38.030246  3305 consensus_queue.cc:260] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.031172  3305 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.035326  3156 raft_consensus.cc:2468] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 3.
I20260709 13:17:38.035522  3305 raft_consensus.cc:2468] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 3.
I20260709 13:17:38.036865  3196 leader_election.cc:304] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:38.037684  3473 raft_consensus.cc:2804] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:38.038167  3473 raft_consensus.cc:697] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:38.038996  3473 consensus_queue.cc:237] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.046124  3051 catalog_manager.cc:5697] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 2 to 3, leader changed from f226f678f8684102999da97ef283d0d1 (127.2.243.67) to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 3 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.055823  3456 raft_consensus.cc:993] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9: : Instructing follower 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:38.056502  3479 raft_consensus.cc:1081] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Signalling peer 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:38.058393  3228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:48358
I20260709 13:17:38.058919  3228 raft_consensus.cc:493] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.059170  3228 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.066282  3228 raft_consensus.cc:515] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.068262  3228 leader_election.cc:290] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 2 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:38.069446  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:38.070197  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:38.070834  3156 raft_consensus.cc:3055] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.071192  3305 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.071389  3156 raft_consensus.cc:740] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:38.072487  3156 consensus_queue.cc:260] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.074024  3156 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.075826  3479 raft_consensus.cc:993] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9: : Instructing follower 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:38.076370  3479 raft_consensus.cc:1081] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Signalling peer 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:38.078428  3228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:48358
I20260709 13:17:38.079174  3228 raft_consensus.cc:493] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.079650  3228 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.080327  3305 raft_consensus.cc:2468] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 2.
I20260709 13:17:38.081569  3196 leader_election.cc:304] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:38.082036  3156 raft_consensus.cc:2468] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 2.
I20260709 13:17:38.082397  3473 raft_consensus.cc:2804] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.083269  3473 raft_consensus.cc:697] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:38.084460  3473 consensus_queue.cc:237] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.086611  3228 raft_consensus.cc:515] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.088574  3228 leader_election.cc:290] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 3 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:38.089773  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:38.090333  3156 raft_consensus.cc:3055] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:38.090590  3156 raft_consensus.cc:740] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:38.091428  3156 consensus_queue.cc:260] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.092860  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469eed4053ec44ea83a9278099a99ae5" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:38.093402  3156 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.093637  3305 raft_consensus.cc:3060] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.094349  3051 catalog_manager.cc:5697] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 1 to 2, leader changed from 48a58305358643ac95d14bc82edca8e9 (127.2.243.65) to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.100153  3156 raft_consensus.cc:2468] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 3.
I20260709 13:17:38.100172  3305 raft_consensus.cc:2468] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 3.
I20260709 13:17:38.101785  3196 leader_election.cc:304] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:38.102548  3473 raft_consensus.cc:2804] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:38.103449  3473 raft_consensus.cc:697] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:38.104457  3473 consensus_queue.cc:237] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.114780  3051 catalog_manager.cc:5697] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 2 to 3, leader changed from 48a58305358643ac95d14bc82edca8e9 (127.2.243.65) to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 3 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.251358  3479 raft_consensus.cc:993] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9: : Instructing follower 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:38.251899  3479 raft_consensus.cc:1081] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Signalling peer 2025206d4c5b44feb0552bf4a30c960e to start an election
I20260709 13:17:38.253659  3228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
 from {username='slave'} at 127.0.0.1:48358
I20260709 13:17:38.254184  3228 raft_consensus.cc:493] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.254496  3228 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.259846  3228 raft_consensus.cc:515] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.261669  3228 leader_election.cc:290] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 3 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:38.262887  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:38.262979  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "2025206d4c5b44feb0552bf4a30c960e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:38.263432  3305 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.263558  3156 raft_consensus.cc:3055] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:38.263947  3156 raft_consensus.cc:740] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:38.264916  3156 consensus_queue.cc:260] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.266095  3156 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.269441  3305 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 3.
I20260709 13:17:38.270632  3196 leader_election.cc:304] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:38.271351  3473 raft_consensus.cc:2804] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:38.271405  3156 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2025206d4c5b44feb0552bf4a30c960e in term 3.
I20260709 13:17:38.271867  3473 raft_consensus.cc:697] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Becoming Leader. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:38.272789  3473 consensus_queue.cc:237] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:38.281286  3051 catalog_manager.cc:5697] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e reported cstate change: term changed from 2 to 3, leader changed from 48a58305358643ac95d14bc82edca8e9 (127.2.243.65) to 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66). New cstate: current_term: 3 leader_uuid: "2025206d4c5b44feb0552bf4a30c960e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.488602  3305 raft_consensus.cc:1275] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:38.490727  3473 consensus_queue.cc:1048] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:38.501628  3156 raft_consensus.cc:1275] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:38.504585  3473 consensus_queue.cc:1048] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:38.513816  3305 raft_consensus.cc:1275] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:38.515213  3463 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:38.526917  3156 raft_consensus.cc:1275] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:38.528525  3463 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:38.550570  3156 raft_consensus.cc:1275] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:38.552042  3463 consensus_queue.cc:1048] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.563360  3305 raft_consensus.cc:1275] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:38.567570  3463 consensus_queue.cc:1048] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.644950  3305 raft_consensus.cc:1275] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:38.646586  3463 consensus_queue.cc:1048] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:38.659157  3156 raft_consensus.cc:1275] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:38.660629  3463 consensus_queue.cc:1048] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:38.672879  3305 raft_consensus.cc:1275] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:38.674221  3463 consensus_queue.cc:1048] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:38.687088  3156 raft_consensus.cc:1275] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Refusing update from remote peer 2025206d4c5b44feb0552bf4a30c960e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:38.689394  3491 consensus_queue.cc:1048] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:40.944736  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:40.954066  3228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:50972
I20260709 13:17:40.954794  3228 raft_consensus.cc:606] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Received request to transfer leadership to TS 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:40.958145  3228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:50972
I20260709 13:17:40.958913  3228 raft_consensus.cc:606] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Received request to transfer leadership to TS f226f678f8684102999da97ef283d0d1
I20260709 13:17:40.961874  3228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:50972
I20260709 13:17:40.962424  3228 raft_consensus.cc:606] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 4 LEADER]: Received request to transfer leadership to TS 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:40.965325  3228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:50972
I20260709 13:17:40.965780  3228 raft_consensus.cc:606] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Received request to transfer leadership to TS 48a58305358643ac95d14bc82edca8e9
I20260709 13:17:40.968585  3228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a"
dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
mode: GRACEFUL
new_leader_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:50972
I20260709 13:17:40.969062  3228 raft_consensus.cc:606] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Received request to transfer leadership to TS f226f678f8684102999da97ef283d0d1
I20260709 13:17:40.970329  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:40.970849  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:41.236207  3500 raft_consensus.cc:993] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:41.237010  3498 raft_consensus.cc:1081] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Signalling peer f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:41.239161  3305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0"
dest_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:17:41.239811  3305 raft_consensus.cc:493] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.240178  3305 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.246143  3305 raft_consensus.cc:515] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.249346  3305 leader_election.cc:290] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 4 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:41.250816  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:41.250939  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e4f1d90184191a28a96d25e182ce0" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:41.251883  3228 raft_consensus.cc:3055] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:41.251945  3156 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.252383  3228 raft_consensus.cc:740] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:41.253600  3228 consensus_queue.cc:260] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.255288  3228 raft_consensus.cc:3060] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.257660  3498 raft_consensus.cc:993] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:41.258255  3500 raft_consensus.cc:1081] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Signalling peer 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:41.260366  3154 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:17:41.261037  3154 raft_consensus.cc:493] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.261260  3156 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 4.
I20260709 13:17:41.261579  3154 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.262761  3270 leader_election.cc:304] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:41.263695  3467 raft_consensus.cc:2804] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:41.264133  3228 raft_consensus.cc:2468] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 4.
I20260709 13:17:41.264957  3467 raft_consensus.cc:697] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 4 LEADER]: Becoming Leader. State: Replica: f226f678f8684102999da97ef283d0d1, State: Running, Role: LEADER
I20260709 13:17:41.266192  3467 consensus_queue.cc:237] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.270717  3154 raft_consensus.cc:515] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.273680  3154 leader_election.cc:290] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 3 election: Requested vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:41.274958  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:41.275628  3228 raft_consensus.cc:3055] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.275565  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66785f4649de47c5ac74f5bd7e1f796e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:41.276021  3228 raft_consensus.cc:740] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:41.276209  3305 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.276858  3228 consensus_queue.cc:260] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.276291  3052 catalog_manager.cc:5697] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 reported cstate change: term changed from 3 to 4, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to f226f678f8684102999da97ef283d0d1 (127.2.243.67). New cstate: current_term: 4 leader_uuid: "f226f678f8684102999da97ef283d0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.278563  3228 raft_consensus.cc:3060] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.290984  3228 raft_consensus.cc:2468] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 3.
I20260709 13:17:41.292745  3305 raft_consensus.cc:2468] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 3.
I20260709 13:17:41.293243  3120 leader_election.cc:304] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2025206d4c5b44feb0552bf4a30c960e, 48a58305358643ac95d14bc82edca8e9; no voters: 
I20260709 13:17:41.297638  3505 raft_consensus.cc:2804] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.302285  3500 raft_consensus.cc:993] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:41.302826  3505 raft_consensus.cc:697] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 3 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:41.303440  3504 raft_consensus.cc:1081] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Signalling peer f226f678f8684102999da97ef283d0d1 to start an election
I20260709 13:17:41.304322  3505 consensus_queue.cc:237] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.306088  3305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a"
dest_uuid: "f226f678f8684102999da97ef283d0d1"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:17:41.306741  3305 raft_consensus.cc:493] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.307098  3305 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.317857  3305 raft_consensus.cc:515] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.318550  3052 catalog_manager.cc:5697] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 2 to 3, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 3 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.321127  3305 leader_election.cc:290] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 3 election: Requested vote from peers 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:41.321352  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:41.321342  3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5dea03f7c64eacb9425c399db2218a" candidate_uuid: "f226f678f8684102999da97ef283d0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a58305358643ac95d14bc82edca8e9"
I20260709 13:17:41.322139  3228 raft_consensus.cc:3055] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.322237  3156 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.322552  3228 raft_consensus.cc:740] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:41.323380  3228 consensus_queue.cc:260] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.324759  3228 raft_consensus.cc:3060] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.329939  3156 raft_consensus.cc:2468] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 3.
I20260709 13:17:41.331045  3228 raft_consensus.cc:2468] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f226f678f8684102999da97ef283d0d1 in term 3.
I20260709 13:17:41.331568  3270 leader_election.cc:304] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:41.332538  3467 raft_consensus.cc:2804] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.333340  3467 raft_consensus.cc:697] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 3 LEADER]: Becoming Leader. State: Replica: f226f678f8684102999da97ef283d0d1, State: Running, Role: LEADER
I20260709 13:17:41.334266  3467 consensus_queue.cc:237] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.343797  3052 catalog_manager.cc:5697] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 reported cstate change: term changed from 2 to 3, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to f226f678f8684102999da97ef283d0d1 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "f226f678f8684102999da97ef283d0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.370930  3504 raft_consensus.cc:993] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:41.371490  3504 raft_consensus.cc:1081] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Signalling peer 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:41.373268  3156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:17:41.373811  3156 raft_consensus.cc:493] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.374135  3156 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.378973  3156 raft_consensus.cc:515] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.380862  3156 leader_election.cc:290] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 4 election: Requested vote from peers 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867), f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189)
I20260709 13:17:41.381896  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:41.382122  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f003c3c4acc4f3ebeab9326d25d5930" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:41.382453  3228 raft_consensus.cc:3055] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:41.382766  3228 raft_consensus.cc:740] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:41.382637  3305 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.383705  3228 consensus_queue.cc:260] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.384773  3228 raft_consensus.cc:3060] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.387620  3305 raft_consensus.cc:2468] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 4.
I20260709 13:17:41.389098  3121 leader_election.cc:304] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:41.389752  3228 raft_consensus.cc:2468] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 4.
I20260709 13:17:41.390226  3505 raft_consensus.cc:2804] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:41.390666  3505 raft_consensus.cc:697] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 4 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:41.391855  3505 consensus_queue.cc:237] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } }
I20260709 13:17:41.400622  3052 catalog_manager.cc:5697] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 3 to 4, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 4 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.511996  3500 raft_consensus.cc:993] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e: : Instructing follower 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:41.512686  3504 raft_consensus.cc:1081] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 4 LEADER]: Signalling peer 48a58305358643ac95d14bc82edca8e9 to start an election
I20260709 13:17:41.514410  3156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e"
dest_uuid: "48a58305358643ac95d14bc82edca8e9"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:17:41.515040  3156 raft_consensus.cc:493] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.515317  3156 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.520222  3156 raft_consensus.cc:515] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:41.522143  3156 leader_election.cc:290] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 5 election: Requested vote from peers f226f678f8684102999da97ef283d0d1 (127.2.243.67:36189), 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66:40867)
I20260709 13:17:41.523250  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f226f678f8684102999da97ef283d0d1"
I20260709 13:17:41.523528  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e19dba6f6444ac5b231068c5dca050e" candidate_uuid: "48a58305358643ac95d14bc82edca8e9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2025206d4c5b44feb0552bf4a30c960e"
I20260709 13:17:41.523836  3305 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.524085  3228 raft_consensus.cc:3055] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:41.524446  3228 raft_consensus.cc:740] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2025206d4c5b44feb0552bf4a30c960e, State: Running, Role: LEADER
I20260709 13:17:41.525424  3228 consensus_queue.cc:260] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:41.526804  3228 raft_consensus.cc:3060] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.529341  3305 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 5.
I20260709 13:17:41.530347  3121 leader_election.cc:304] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a58305358643ac95d14bc82edca8e9, f226f678f8684102999da97ef283d0d1; no voters: 
I20260709 13:17:41.531517  3505 raft_consensus.cc:2804] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:41.531956  3505 raft_consensus.cc:697] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 5 LEADER]: Becoming Leader. State: Replica: 48a58305358643ac95d14bc82edca8e9, State: Running, Role: LEADER
I20260709 13:17:41.532256  3228 raft_consensus.cc:2468] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a58305358643ac95d14bc82edca8e9 in term 5.
I20260709 13:17:41.532817  3505 consensus_queue.cc:237] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } }
I20260709 13:17:41.540899  3052 catalog_manager.cc:5697] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 reported cstate change: term changed from 4 to 5, leader changed from 2025206d4c5b44feb0552bf4a30c960e (127.2.243.66) to 48a58305358643ac95d14bc82edca8e9 (127.2.243.65). New cstate: current_term: 5 leader_uuid: "48a58305358643ac95d14bc82edca8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.700060  3156 raft_consensus.cc:1275] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:41.701520  3467 consensus_queue.cc:1048] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:41.713791  3228 raft_consensus.cc:1275] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:41.716040  3516 consensus_queue.cc:1048] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:41.752612  3228 raft_consensus.cc:1275] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.754357  3505 consensus_queue.cc:1048] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:41.764750  3305 raft_consensus.cc:1275] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.767709  3521 consensus_queue.cc:1048] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:41.870498  3305 raft_consensus.cc:1275] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:41.872279  3521 consensus_queue.cc:1048] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:41.883343  3228 raft_consensus.cc:1275] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.884603  3231 raft_consensus.cc:1275] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:41.886325  3505 consensus_queue.cc:1048] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:41.886665  3501 consensus_queue.cc:1048] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:41.900008  3156 raft_consensus.cc:1275] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Refusing update from remote peer f226f678f8684102999da97ef283d0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.901628  3501 consensus_queue.cc:1048] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a58305358643ac95d14bc82edca8e9" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:41.918630  3228 raft_consensus.cc:1275] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 5 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:41.920073  3505 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2025206d4c5b44feb0552bf4a30c960e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:41.933364  3305 raft_consensus.cc:1275] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 5 FOLLOWER]: Refusing update from remote peer 48a58305358643ac95d14bc82edca8e9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:41.934876  3505 consensus_queue.cc:1048] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f226f678f8684102999da97ef283d0d1" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:41.971982  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:41.978849  3021 tablet_server.cc:179] TabletServer@127.2.243.65:0 shutting down...
I20260709 13:17:42.013118  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:42.014181  3021 tablet_replica.cc:333] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.015234  3021 raft_consensus.cc:2243] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.016070  3021 raft_consensus.cc:2272] T 2741dbe67a5c4b17ac77260eec4f444f P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.019006  3021 tablet_replica.cc:333] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.019711  3021 raft_consensus.cc:2243] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.020741  3021 raft_consensus.cc:2272] T 7f003c3c4acc4f3ebeab9326d25d5930 P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.024106  3021 tablet_replica.cc:333] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.024857  3021 raft_consensus.cc:2243] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.025517  3021 raft_consensus.cc:2272] T 776e4f1d90184191a28a96d25e182ce0 P 48a58305358643ac95d14bc82edca8e9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.028667  3021 tablet_replica.cc:333] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.029290  3021 raft_consensus.cc:2243] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.029776  3021 raft_consensus.cc:2272] T 2f99c9e34f344418bc086f9636aced8f P 48a58305358643ac95d14bc82edca8e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.031518  3021 tablet_replica.cc:333] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.032092  3021 raft_consensus.cc:2243] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.033070  3021 raft_consensus.cc:2272] T 66785f4649de47c5ac74f5bd7e1f796e P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.035281  3021 tablet_replica.cc:333] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.035871  3021 raft_consensus.cc:2243] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.036446  3021 raft_consensus.cc:2272] T 469eed4053ec44ea83a9278099a99ae5 P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.038357  3021 tablet_replica.cc:333] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.038932  3021 raft_consensus.cc:2243] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.039429  3021 raft_consensus.cc:2272] T bb5dea03f7c64eacb9425c399db2218a P 48a58305358643ac95d14bc82edca8e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.042730  3021 tablet_replica.cc:333] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.043340  3021 raft_consensus.cc:2243] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.043865  3021 raft_consensus.cc:2272] T d738c0749bd045d7be62fef8b4a1b54a P 48a58305358643ac95d14bc82edca8e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.045956  3021 tablet_replica.cc:333] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9: stopping tablet replica
I20260709 13:17:42.046533  3021 raft_consensus.cc:2243] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.047487  3021 raft_consensus.cc:2272] T 7e19dba6f6444ac5b231068c5dca050e P 48a58305358643ac95d14bc82edca8e9 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:42.161727  3196 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.243.65:38047: connect: Connection refused (error 111)
I20260709 13:17:42.163466  3021 tablet_server.cc:196] TabletServer@127.2.243.65:0 shutdown complete.
W20260709 13:17:42.166751  3196 consensus_peers.cc:597] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e -> Peer 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047): Couldn't send request to peer 48a58305358643ac95d14bc82edca8e9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:38047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:42.186286  3021 tablet_server.cc:179] TabletServer@127.2.243.66:0 shutting down...
W20260709 13:17:42.217687  3270 consensus_peers.cc:597] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 -> Peer 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047): Couldn't send request to peer 48a58305358643ac95d14bc82edca8e9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:38047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:42.224866  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:42.225955  3021 tablet_replica.cc:333] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.226775  3021 raft_consensus.cc:2243] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.227334  3021 raft_consensus.cc:2272] T 7e19dba6f6444ac5b231068c5dca050e P 2025206d4c5b44feb0552bf4a30c960e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.229799  3021 tablet_replica.cc:333] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.230440  3021 raft_consensus.cc:2243] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.230963  3021 raft_consensus.cc:2272] T d738c0749bd045d7be62fef8b4a1b54a P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.233390  3021 tablet_replica.cc:333] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.233994  3021 raft_consensus.cc:2243] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.234463  3021 raft_consensus.cc:2272] T 66785f4649de47c5ac74f5bd7e1f796e P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.236953  3021 tablet_replica.cc:333] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.237560  3021 raft_consensus.cc:2243] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.238441  3021 raft_consensus.cc:2272] T 2f99c9e34f344418bc086f9636aced8f P 2025206d4c5b44feb0552bf4a30c960e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.240456  3021 tablet_replica.cc:333] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.241215  3021 raft_consensus.cc:2243] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.242326  3021 raft_consensus.cc:2272] T 469eed4053ec44ea83a9278099a99ae5 P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.244665  3021 tablet_replica.cc:333] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.245224  3021 raft_consensus.cc:2243] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.245627  3021 raft_consensus.cc:2272] T bb5dea03f7c64eacb9425c399db2218a P 2025206d4c5b44feb0552bf4a30c960e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.248288  3021 tablet_replica.cc:333] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.249028  3021 raft_consensus.cc:2243] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.250109  3021 raft_consensus.cc:2272] T 2741dbe67a5c4b17ac77260eec4f444f P 2025206d4c5b44feb0552bf4a30c960e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.252079  3021 tablet_replica.cc:333] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.252667  3021 raft_consensus.cc:2243] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.253140  3021 raft_consensus.cc:2272] T 7f003c3c4acc4f3ebeab9326d25d5930 P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.255610  3021 tablet_replica.cc:333] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e: stopping tablet replica
I20260709 13:17:42.256137  3021 raft_consensus.cc:2243] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.256644  3021 raft_consensus.cc:2272] T 776e4f1d90184191a28a96d25e182ce0 P 2025206d4c5b44feb0552bf4a30c960e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:42.285097  3270 consensus_peers.cc:597] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 -> Peer 48a58305358643ac95d14bc82edca8e9 (127.2.243.65:38047): Couldn't send request to peer 48a58305358643ac95d14bc82edca8e9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:38047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:42.287730  3021 tablet_server.cc:196] TabletServer@127.2.243.66:0 shutdown complete.
I20260709 13:17:42.309137  3021 tablet_server.cc:179] TabletServer@127.2.243.67:0 shutting down...
I20260709 13:17:42.344311  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:42.345165  3021 tablet_replica.cc:333] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.345799  3021 raft_consensus.cc:2243] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.346665  3021 raft_consensus.cc:2272] T d738c0749bd045d7be62fef8b4a1b54a P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.348639  3021 tablet_replica.cc:333] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.349203  3021 raft_consensus.cc:2243] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.349685  3021 raft_consensus.cc:2272] T 7e19dba6f6444ac5b231068c5dca050e P f226f678f8684102999da97ef283d0d1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.352586  3021 tablet_replica.cc:333] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.353174  3021 raft_consensus.cc:2243] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.353617  3021 raft_consensus.cc:2272] T 2741dbe67a5c4b17ac77260eec4f444f P f226f678f8684102999da97ef283d0d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.355615  3021 tablet_replica.cc:333] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.356210  3021 raft_consensus.cc:2243] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.356765  3021 raft_consensus.cc:2272] T 66785f4649de47c5ac74f5bd7e1f796e P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.359694  3021 tablet_replica.cc:333] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.360255  3021 raft_consensus.cc:2243] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.360836  3021 raft_consensus.cc:2272] T 2f99c9e34f344418bc086f9636aced8f P f226f678f8684102999da97ef283d0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.362676  3021 tablet_replica.cc:333] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.363189  3021 raft_consensus.cc:2243] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.363616  3021 raft_consensus.cc:2272] T 469eed4053ec44ea83a9278099a99ae5 P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.365422  3021 tablet_replica.cc:333] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.365939  3021 raft_consensus.cc:2243] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.366760  3021 raft_consensus.cc:2272] T bb5dea03f7c64eacb9425c399db2218a P f226f678f8684102999da97ef283d0d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.369104  3021 tablet_replica.cc:333] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.369640  3021 raft_consensus.cc:2243] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.370103  3021 raft_consensus.cc:2272] T 7f003c3c4acc4f3ebeab9326d25d5930 P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.372490  3021 tablet_replica.cc:333] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1: stopping tablet replica
I20260709 13:17:42.373092  3021 raft_consensus.cc:2243] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.373943  3021 raft_consensus.cc:2272] T 776e4f1d90184191a28a96d25e182ce0 P f226f678f8684102999da97ef283d0d1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.404141  3021 tablet_server.cc:196] TabletServer@127.2.243.67:0 shutdown complete.
I20260709 13:17:42.425408  3021 master.cc:562] Master@127.2.243.126:33769 shutting down...
I20260709 13:17:42.601311  3021 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.602191  3021 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.602703  3021 tablet_replica.cc:333] T 00000000000000000000000000000000 P ba6f72bdcb394bb0aec4a3cab5793c15: stopping tablet replica
I20260709 13:17:42.624740  3021 master.cc:584] Master@127.2.243.126:33769 shutdown complete.
2025206d4c5b44feb0552bf4a30c960e  4
48a58305358643ac95d14bc82edca8e9  4
f226f678f8684102999da97ef283d0d1  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13965 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:17:42.674707  3021 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.243.126:43519
I20260709 13:17:42.675992  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:42.682626  3534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:42.683279  3533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:42.684617  3536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:42.685329  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:42.686386  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:42.686580  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:42.686717  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603062686705 us; error 0 us; skew 500 ppm
I20260709 13:17:42.687238  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:42.690410  3021 webserver.cc:533] Webserver started at http://127.2.243.126:43515/ using document root <none> and password file <none>
I20260709 13:17:42.690902  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:42.691056  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:42.691367  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:42.693056  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/master-0-root/instance:
uuid: "5c160320e38545df870eff5c2be5e425"
format_stamp: "Formatted at 2026-07-09 13:17:42 on dist-test-slave-ftjc"
I20260709 13:17:42.698880  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:17:42.703675  3541 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:42.704670  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:42.705013  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/master-0-root
uuid: "5c160320e38545df870eff5c2be5e425"
format_stamp: "Formatted at 2026-07-09 13:17:42 on dist-test-slave-ftjc"
I20260709 13:17:42.705370  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:42.715915  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:42.717772  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:42.770407  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.126:43519
I20260709 13:17:42.770503  3592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.126:43519 every 8 connection(s)
I20260709 13:17:42.776438  3593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.788803  3593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425: Bootstrap starting.
I20260709 13:17:42.794447  3593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.799808  3593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425: No bootstrap required, opened a new log
I20260709 13:17:42.802542  3593 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c160320e38545df870eff5c2be5e425" member_type: VOTER }
I20260709 13:17:42.803020  3593 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.803272  3593 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c160320e38545df870eff5c2be5e425, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.803896  3593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c160320e38545df870eff5c2be5e425" member_type: VOTER }
I20260709 13:17:42.804453  3593 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:42.804669  3593 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:42.805001  3593 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.810062  3593 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c160320e38545df870eff5c2be5e425" member_type: VOTER }
I20260709 13:17:42.810738  3593 leader_election.cc:304] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c160320e38545df870eff5c2be5e425; no voters: 
I20260709 13:17:42.812033  3593 leader_election.cc:290] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:42.812559  3596 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.813947  3596 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 1 LEADER]: Becoming Leader. State: Replica: 5c160320e38545df870eff5c2be5e425, State: Running, Role: LEADER
I20260709 13:17:42.814740  3596 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c160320e38545df870eff5c2be5e425" member_type: VOTER }
I20260709 13:17:42.815384  3593 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:42.819880  3597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c160320e38545df870eff5c2be5e425" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c160320e38545df870eff5c2be5e425" member_type: VOTER } }
I20260709 13:17:42.820747  3597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:42.820613  3598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c160320e38545df870eff5c2be5e425. Latest consensus state: current_term: 1 leader_uuid: "5c160320e38545df870eff5c2be5e425" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c160320e38545df870eff5c2be5e425" member_type: VOTER } }
I20260709 13:17:42.821280  3598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:42.823661  3602 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:42.833086  3602 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:42.834385  3021 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:42.844149  3602 catalog_manager.cc:1383] Generated new cluster ID: db34448501b74098b69b34cab84f608c
I20260709 13:17:42.844543  3602 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:42.861089  3602 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:42.862607  3602 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:42.875895  3602 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425: Generated new TSK 0
I20260709 13:17:42.876729  3602 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:42.901984  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:42.909535  3614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:42.910688  3615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:42.912608  3617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:42.913609  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:42.914541  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:42.914731  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:42.914845  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603062914834 us; error 0 us; skew 500 ppm
I20260709 13:17:42.915382  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:42.918321  3021 webserver.cc:533] Webserver started at http://127.2.243.65:40431/ using document root <none> and password file <none>
I20260709 13:17:42.918860  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:42.919039  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:42.919278  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:42.920655  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-0-root/instance:
uuid: "c80a8051fe814f15a2647b2b387a3c0b"
format_stamp: "Formatted at 2026-07-09 13:17:42 on dist-test-slave-ftjc"
I20260709 13:17:42.926484  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:42.930922  3622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:42.932101  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:17:42.932574  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "c80a8051fe814f15a2647b2b387a3c0b"
format_stamp: "Formatted at 2026-07-09 13:17:42 on dist-test-slave-ftjc"
I20260709 13:17:42.933143  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:42.975615  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:42.977319  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:42.979115  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:42.981914  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:42.982187  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:42.982460  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:42.982684  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:43.034562  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:41371
I20260709 13:17:43.034888  3684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:41371 every 8 connection(s)
I20260709 13:17:43.040553  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:43.049026  3689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:43.050637  3690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:43.054382  3692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:43.055235  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:43.057075  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:43.057395  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:43.057614  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603063057591 us; error 0 us; skew 500 ppm
I20260709 13:17:43.058483  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:43.059863  3685 heartbeater.cc:344] Connected to a master server at 127.2.243.126:43519
I20260709 13:17:43.060323  3685 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:43.061303  3685 heartbeater.cc:507] Master 127.2.243.126:43519 requested a full tablet report, sending...
I20260709 13:17:43.062227  3021 webserver.cc:533] Webserver started at http://127.2.243.66:41439/ using document root <none> and password file <none>
I20260709 13:17:43.062883  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:43.063186  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:43.063558  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:43.064435  3558 ts_manager.cc:194] Registered new tserver with Master: c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371)
I20260709 13:17:43.065111  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-1-root/instance:
uuid: "c146e8c13b62470cad363220f92f0ad5"
format_stamp: "Formatted at 2026-07-09 13:17:43 on dist-test-slave-ftjc"
I20260709 13:17:43.066685  3558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33966
I20260709 13:17:43.070806  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:17:43.077415  3697 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:43.079056  3021 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:17:43.079555  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-1-root
uuid: "c146e8c13b62470cad363220f92f0ad5"
format_stamp: "Formatted at 2026-07-09 13:17:43 on dist-test-slave-ftjc"
I20260709 13:17:43.079991  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:43.099478  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:43.101082  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:43.103163  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:43.105799  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:43.106009  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:43.106287  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:43.106493  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:43.160729  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.66:45849
I20260709 13:17:43.160846  3759 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.66:45849 every 8 connection(s)
I20260709 13:17:43.165951  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:43.175915  3763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:43.176930  3764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:43.179679  3021 server_base.cc:1061] running on GCE node
W20260709 13:17:43.180498  3766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:43.181468  3760 heartbeater.cc:344] Connected to a master server at 127.2.243.126:43519
I20260709 13:17:43.181703  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:43.181871  3760 heartbeater.cc:461] Registering TS with master...
W20260709 13:17:43.181998  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:43.182329  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603063182288 us; error 0 us; skew 500 ppm
I20260709 13:17:43.183000  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:43.183039  3760 heartbeater.cc:507] Master 127.2.243.126:43519 requested a full tablet report, sending...
I20260709 13:17:43.186203  3558 ts_manager.cc:194] Registered new tserver with Master: c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:43.186293  3021 webserver.cc:533] Webserver started at http://127.2.243.67:33143/ using document root <none> and password file <none>
I20260709 13:17:43.186995  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:43.187311  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:43.187651  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:43.188221  3558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32920
I20260709 13:17:43.189344  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-2-root/instance:
uuid: "4ec5091d4f52461387b4ef4ddd99319f"
format_stamp: "Formatted at 2026-07-09 13:17:43 on dist-test-slave-ftjc"
I20260709 13:17:43.195253  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:17:43.199088  3771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:43.200150  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:17:43.200747  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-2-root
uuid: "4ec5091d4f52461387b4ef4ddd99319f"
format_stamp: "Formatted at 2026-07-09 13:17:43 on dist-test-slave-ftjc"
I20260709 13:17:43.201113  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603048513324-3021-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:43.238934  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:43.240751  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:43.242873  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:43.245654  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:43.245954  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:43.246239  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:43.246475  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:43.300094  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.67:45781
I20260709 13:17:43.300252  3833 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.67:45781 every 8 connection(s)
I20260709 13:17:43.317342  3834 heartbeater.cc:344] Connected to a master server at 127.2.243.126:43519
I20260709 13:17:43.318015  3834 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:43.318993  3834 heartbeater.cc:507] Master 127.2.243.126:43519 requested a full tablet report, sending...
I20260709 13:17:43.321792  3558 ts_manager.cc:194] Registered new tserver with Master: 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:43.322336  3021 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01813398s
I20260709 13:17:43.323629  3558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32922
I20260709 13:17:43.353206  3558 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32924:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:43.357286  3558 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:43.444689  3725 tablet_service.cc:1511] Processing CreateTablet for tablet f92b8f10f618407183482b7214519229 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:43.445511  3723 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3aca580de9422ebe80bc6ac5c9e6f3 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:43.446419  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92b8f10f618407183482b7214519229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.447171  3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3aca580de9422ebe80bc6ac5c9e6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.451383  3722 tablet_service.cc:1511] Processing CreateTablet for tablet 087ff59e81504d51810b408ab971e40e (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:43.453362  3724 tablet_service.cc:1511] Processing CreateTablet for tablet de9d1ec007924167bafeb12e6e4330f6 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:43.455426  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087ff59e81504d51810b408ab971e40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.458359  3721 tablet_service.cc:1511] Processing CreateTablet for tablet 577290c8bfab42d799970f7025e3e7a4 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:43.462987  3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577290c8bfab42d799970f7025e3e7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.464500  3720 tablet_service.cc:1511] Processing CreateTablet for tablet 0c859ca2a86b45569483a543c6a44c13 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:43.466331  3720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c859ca2a86b45569483a543c6a44c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.470947  3719 tablet_service.cc:1511] Processing CreateTablet for tablet 25264a646a2a463f80fc8766c1170545 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:43.472939  3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25264a646a2a463f80fc8766c1170545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.480962  3718 tablet_service.cc:1511] Processing CreateTablet for tablet a0cc8e22ec1848f3b2b64a04b3ec5673 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:43.483410  3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9d1ec007924167bafeb12e6e4330f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.488839  3718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cc8e22ec1848f3b2b64a04b3ec5673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.488595  3650 tablet_service.cc:1511] Processing CreateTablet for tablet f92b8f10f618407183482b7214519229 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:43.490293  3650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92b8f10f618407183482b7214519229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.486636  3722 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1cfcba93a1409dbf5d756d92a2468c (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:43.494530  3717 tablet_service.cc:1511] Processing CreateTablet for tablet c1ecb79bb19f4e4d92b9141a6af9c04e (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:43.495811  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1cfcba93a1409dbf5d756d92a2468c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.484400  3849 tablet_bootstrap.cc:492] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:43.500089  3717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ecb79bb19f4e4d92b9141a6af9c04e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.505227  3646 tablet_service.cc:1511] Processing CreateTablet for tablet 577290c8bfab42d799970f7025e3e7a4 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:43.507066  3646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577290c8bfab42d799970f7025e3e7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.509030  3645 tablet_service.cc:1511] Processing CreateTablet for tablet 0c859ca2a86b45569483a543c6a44c13 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:43.512413  3647 tablet_service.cc:1511] Processing CreateTablet for tablet 087ff59e81504d51810b408ab971e40e (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:43.513688  3649 tablet_service.cc:1511] Processing CreateTablet for tablet de9d1ec007924167bafeb12e6e4330f6 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:43.516774  3648 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3aca580de9422ebe80bc6ac5c9e6f3 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:43.518935  3647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087ff59e81504d51810b408ab971e40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.520831  3644 tablet_service.cc:1511] Processing CreateTablet for tablet 25264a646a2a463f80fc8766c1170545 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:43.522382  3644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25264a646a2a463f80fc8766c1170545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.524186  3648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3aca580de9422ebe80bc6ac5c9e6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.533100  3645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c859ca2a86b45569483a543c6a44c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.512127  3849 tablet_bootstrap.cc:654] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.540122  3643 tablet_service.cc:1511] Processing CreateTablet for tablet a0cc8e22ec1848f3b2b64a04b3ec5673 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:43.540817  3642 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1cfcba93a1409dbf5d756d92a2468c (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:43.543689  3649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9d1ec007924167bafeb12e6e4330f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.544759  3642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1cfcba93a1409dbf5d756d92a2468c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.548611  3641 tablet_service.cc:1511] Processing CreateTablet for tablet c1ecb79bb19f4e4d92b9141a6af9c04e (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:43.550258  3641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ecb79bb19f4e4d92b9141a6af9c04e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.552767  3643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cc8e22ec1848f3b2b64a04b3ec5673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.570040  3794 tablet_service.cc:1511] Processing CreateTablet for tablet 0c859ca2a86b45569483a543c6a44c13 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:43.570091  3793 tablet_service.cc:1511] Processing CreateTablet for tablet 25264a646a2a463f80fc8766c1170545 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:43.571975  3794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c859ca2a86b45569483a543c6a44c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.574025  3796 tablet_service.cc:1511] Processing CreateTablet for tablet 087ff59e81504d51810b408ab971e40e (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:43.581858  3797 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3aca580de9422ebe80bc6ac5c9e6f3 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:43.584829  3795 tablet_service.cc:1511] Processing CreateTablet for tablet 577290c8bfab42d799970f7025e3e7a4 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:43.585655  3798 tablet_service.cc:1511] Processing CreateTablet for tablet de9d1ec007924167bafeb12e6e4330f6 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:43.581858  3799 tablet_service.cc:1511] Processing CreateTablet for tablet f92b8f10f618407183482b7214519229 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:43.592270  3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25264a646a2a463f80fc8766c1170545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.599362  3850 tablet_bootstrap.cc:492] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:43.599053  3792 tablet_service.cc:1511] Processing CreateTablet for tablet a0cc8e22ec1848f3b2b64a04b3ec5673 (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:43.605324  3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9d1ec007924167bafeb12e6e4330f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.607612  3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577290c8bfab42d799970f7025e3e7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.613114  3792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cc8e22ec1848f3b2b64a04b3ec5673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.617022  3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3aca580de9422ebe80bc6ac5c9e6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.620815  3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92b8f10f618407183482b7214519229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.626907  3849 tablet_bootstrap.cc:492] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:43.627703  3849 ts_tablet_manager.cc:1403] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.019s
I20260709 13:17:43.631577  3849 raft_consensus.cc:359] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.632910  3796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087ff59e81504d51810b408ab971e40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.641459  3791 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1cfcba93a1409dbf5d756d92a2468c (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:43.642913  3790 tablet_service.cc:1511] Processing CreateTablet for tablet c1ecb79bb19f4e4d92b9141a6af9c04e (DEFAULT_TABLE table=test-workload [id=857ccadb4d1148fbb259c230bc92ec0f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:43.662914  3790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ecb79bb19f4e4d92b9141a6af9c04e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.663815  3850 tablet_bootstrap.cc:654] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.668905  3791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1cfcba93a1409dbf5d756d92a2468c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.698665  3849 raft_consensus.cc:385] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.703584  3849 raft_consensus.cc:740] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.714521  3850 tablet_bootstrap.cc:492] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:43.715175  3850 ts_tablet_manager.cc:1403] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.009s
I20260709 13:17:43.708244  3849 consensus_queue.cc:260] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.719359  3850 raft_consensus.cc:359] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.720747  3850 raft_consensus.cc:385] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.721668  3850 raft_consensus.cc:740] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.722741  3850 consensus_queue.cc:260] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.727648  3852 tablet_bootstrap.cc:492] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:43.755419  3852 tablet_bootstrap.cc:654] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.757831  3850 ts_tablet_manager.cc:1434] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.042s	user 0.020s	sys 0.017s
I20260709 13:17:43.758791  3685 heartbeater.cc:499] Master 127.2.243.126:43519 was elected leader, sending a full tablet report...
I20260709 13:17:43.766162  3856 raft_consensus.cc:493] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.766871  3856 raft_consensus.cc:515] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.768185  3760 heartbeater.cc:499] Master 127.2.243.126:43519 was elected leader, sending a full tablet report...
I20260709 13:17:43.768923  3849 ts_tablet_manager.cc:1434] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.141s	user 0.011s	sys 0.017s
I20260709 13:17:43.770076  3849 tablet_bootstrap.cc:492] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:43.778167  3856 leader_election.cc:290] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:43.778663  3849 tablet_bootstrap.cc:654] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.781845  3850 tablet_bootstrap.cc:492] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:43.784626  3852 tablet_bootstrap.cc:492] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:43.785219  3852 ts_tablet_manager.cc:1403] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.013s
I20260709 13:17:43.789757  3852 raft_consensus.cc:359] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.790864  3852 raft_consensus.cc:385] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.791260  3852 raft_consensus.cc:740] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.792166  3852 consensus_queue.cc:260] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.798913  3850 tablet_bootstrap.cc:654] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.824928  3834 heartbeater.cc:499] Master 127.2.243.126:43519 was elected leader, sending a full tablet report...
I20260709 13:17:43.826687  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:43.829301  3849 tablet_bootstrap.cc:492] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:43.830492  3849 ts_tablet_manager.cc:1403] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.026s
I20260709 13:17:43.830883  3854 raft_consensus.cc:493] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.831696  3606 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:43.831461  3854 raft_consensus.cc:515] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.834167  3849 raft_consensus.cc:359] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.834820  3854 leader_election.cc:290] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
W20260709 13:17:43.829435  3626 leader_election.cc:343] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.835274  3849 raft_consensus.cc:385] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.835688  3849 raft_consensus.cc:740] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.837543  3852 ts_tablet_manager.cc:1434] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.052s	user 0.025s	sys 0.007s
I20260709 13:17:43.837963  3849 consensus_queue.cc:260] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.845882  3852 tablet_bootstrap.cc:492] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:43.850458  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:43.850981  3849 ts_tablet_manager.cc:1434] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
W20260709 13:17:43.852793  3624 leader_election.cc:343] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.853192  3849 tablet_bootstrap.cc:492] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:43.853355  3624 leader_election.cc:304] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c80a8051fe814f15a2647b2b387a3c0b; no voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5
I20260709 13:17:43.856566  3856 raft_consensus.cc:2749] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:43.857636  3852 tablet_bootstrap.cc:654] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.864188  3849 tablet_bootstrap.cc:654] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.869041  3850 tablet_bootstrap.cc:492] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:43.869676  3850 ts_tablet_manager.cc:1403] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.005s
I20260709 13:17:43.873335  3850 raft_consensus.cc:359] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.874356  3850 raft_consensus.cc:385] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.874711  3850 raft_consensus.cc:740] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.880300  3850 consensus_queue.cc:260] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.885944  3849 tablet_bootstrap.cc:492] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:43.886583  3849 ts_tablet_manager.cc:1403] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.003s
I20260709 13:17:43.889180  3850 ts_tablet_manager.cc:1434] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 13:17:43.890443  3850 tablet_bootstrap.cc:492] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:43.890570  3849 raft_consensus.cc:359] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.891253  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:43.891510  3849 raft_consensus.cc:385] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.891855  3849 raft_consensus.cc:740] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.893050  3849 consensus_queue.cc:260] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
W20260709 13:17:43.894594  3699 leader_election.cc:343] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.895977  3849 ts_tablet_manager.cc:1434] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:17:43.897819  3849 tablet_bootstrap.cc:492] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:43.898571  3852 tablet_bootstrap.cc:492] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:43.898816  3850 tablet_bootstrap.cc:654] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.899096  3852 ts_tablet_manager.cc:1403] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.055s	user 0.031s	sys 0.002s
I20260709 13:17:43.903380  3852 raft_consensus.cc:359] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.904582  3852 raft_consensus.cc:385] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.904997  3852 raft_consensus.cc:740] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.905494  3849 tablet_bootstrap.cc:654] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.906037  3852 consensus_queue.cc:260] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.912681  3852 ts_tablet_manager.cc:1434] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:17:43.917755  3852 tablet_bootstrap.cc:492] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:43.919333  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
W20260709 13:17:43.922431  3699 leader_election.cc:343] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.923178  3699 leader_election.cc:304] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5; no voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:43.924844  3861 raft_consensus.cc:493] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.925637  3861 raft_consensus.cc:515] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.928930  3852 tablet_bootstrap.cc:654] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.929972  3854 raft_consensus.cc:2749] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:43.943267  3861 leader_election.cc:290] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:43.945050  3852 tablet_bootstrap.cc:492] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:43.945962  3852 ts_tablet_manager.cc:1403] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 13:17:43.952014  3852 raft_consensus.cc:359] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.953733  3852 raft_consensus.cc:385] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.954298  3852 raft_consensus.cc:740] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.955996  3852 consensus_queue.cc:260] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.959743  3852 ts_tablet_manager.cc:1434] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:17:43.962107  3852 tablet_bootstrap.cc:492] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:43.973193  3852 tablet_bootstrap.cc:654] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.988859  3852 tablet_bootstrap.cc:492] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:43.989883  3852 ts_tablet_manager.cc:1403] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.009s
I20260709 13:17:43.995618  3850 tablet_bootstrap.cc:492] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:43.995467  3852 raft_consensus.cc:359] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:43.996266  3850 ts_tablet_manager.cc:1403] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.106s	user 0.039s	sys 0.044s
I20260709 13:17:43.996707  3852 raft_consensus.cc:385] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.996809  3849 tablet_bootstrap.cc:492] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:43.997207  3852 raft_consensus.cc:740] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.997501  3849 ts_tablet_manager.cc:1403] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.100s	user 0.039s	sys 0.059s
I20260709 13:17:43.998405  3852 consensus_queue.cc:260] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.001235  3849 raft_consensus.cc:359] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.001956  3852 ts_tablet_manager.cc:1434] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:44.002283  3849 raft_consensus.cc:385] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.002650  3849 raft_consensus.cc:740] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.003552  3852 tablet_bootstrap.cc:492] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:44.003638  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.003530  3849 consensus_queue.cc:260] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.005357  3854 raft_consensus.cc:493] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.005880  3854 raft_consensus.cc:515] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.008066  3854 leader_election.cc:290] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
W20260709 13:17:44.009236  3773 leader_election.cc:343] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.010147  3849 ts_tablet_manager.cc:1434] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:17:44.011405  3849 tablet_bootstrap.cc:492] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:44.012950  3852 tablet_bootstrap.cc:654] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.016319  3850 raft_consensus.cc:359] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.017202  3850 raft_consensus.cc:385] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.017630  3850 raft_consensus.cc:740] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.020123  3849 tablet_bootstrap.cc:654] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.018605  3850 consensus_queue.cc:260] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.026772  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.027781  3735 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 0.
I20260709 13:17:44.030146  3775 leader_election.cc:304] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.030725  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.031626  3861 raft_consensus.cc:2804] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.032029  3861 raft_consensus.cc:493] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.032437  3861 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.032828  3849 tablet_bootstrap.cc:492] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:44.033488  3849 ts_tablet_manager.cc:1403] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
W20260709 13:17:44.033638  3699 leader_election.cc:343] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.035290  3852 tablet_bootstrap.cc:492] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:44.035920  3852 ts_tablet_manager.cc:1403] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.011s
I20260709 13:17:44.036752  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.037077  3849 raft_consensus.cc:359] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.037935  3849 raft_consensus.cc:385] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.038264  3849 raft_consensus.cc:740] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.039288  3849 consensus_queue.cc:260] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.040067  3850 ts_tablet_manager.cc:1434] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:17:44.039745  3852 raft_consensus.cc:359] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.040766  3852 raft_consensus.cc:385] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.041296  3850 tablet_bootstrap.cc:492] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:44.042025  3849 ts_tablet_manager.cc:1434] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:44.041199  3852 raft_consensus.cc:740] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.043133  3849 tablet_bootstrap.cc:492] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:44.044046  3852 consensus_queue.cc:260] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.048934  3850 tablet_bootstrap.cc:654] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.052680  3849 tablet_bootstrap.cc:654] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.054277  3852 ts_tablet_manager.cc:1434] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:17:44.064469  3852 tablet_bootstrap.cc:492] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:44.065786  3849 tablet_bootstrap.cc:492] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:44.066427  3849 ts_tablet_manager.cc:1403] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 13:17:44.070216  3849 raft_consensus.cc:359] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.071228  3849 raft_consensus.cc:385] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.071583  3849 raft_consensus.cc:740] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.073359  3852 tablet_bootstrap.cc:654] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.072588  3849 consensus_queue.cc:260] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.076066  3849 ts_tablet_manager.cc:1434] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:17:44.077350  3849 tablet_bootstrap.cc:492] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:44.079241  3861 raft_consensus.cc:515] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.080232  3850 tablet_bootstrap.cc:492] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:44.080677  3809 raft_consensus.cc:2393] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c146e8c13b62470cad363220f92f0ad5 in current term 1: Already voted for candidate 4ec5091d4f52461387b4ef4ddd99319f in this term.
I20260709 13:17:44.080861  3850 ts_tablet_manager.cc:1403] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.031s
I20260709 13:17:44.084914  3852 tablet_bootstrap.cc:492] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:44.084704  3699 leader_election.cc:304] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5; no voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.084784  3850 raft_consensus.cc:359] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.085716  3850 raft_consensus.cc:385] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.085961  3872 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.086057  3850 raft_consensus.cc:740] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.086680  3852 ts_tablet_manager.cc:1403] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:17:44.087131  3850 consensus_queue.cc:260] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.090085  3850 ts_tablet_manager.cc:1434] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:17:44.091293  3850 tablet_bootstrap.cc:492] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:44.090755  3852 raft_consensus.cc:359] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.091828  3852 raft_consensus.cc:385] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.092259  3852 raft_consensus.cc:740] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.093500  3852 consensus_queue.cc:260] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.095268  3872 raft_consensus.cc:2749] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.096439  3849 tablet_bootstrap.cc:654] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.096735  3852 ts_tablet_manager.cc:1434] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:17:44.097987  3852 tablet_bootstrap.cc:492] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:44.099190  3850 tablet_bootstrap.cc:654] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.106971  3852 tablet_bootstrap.cc:654] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.113200  3850 tablet_bootstrap.cc:492] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:44.113873  3850 ts_tablet_manager.cc:1403] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:17:44.117426  3850 raft_consensus.cc:359] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.118253  3850 raft_consensus.cc:385] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.118600  3850 raft_consensus.cc:740] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.120095  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:44.120827  3660 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.127524  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:44.130043  3660 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 1.
I20260709 13:17:44.131880  3773 leader_election.cc:304] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.133375  3875 raft_consensus.cc:2804] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.135470  3875 raft_consensus.cc:697] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Becoming Leader. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:44.136849  3861 leader_election.cc:290] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:44.137159  3856 raft_consensus.cc:493] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.137661  3856 raft_consensus.cc:515] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.138242  3735 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 1.
I20260709 13:17:44.140002  3856 leader_election.cc:290] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.142259  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.142972  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.142905  3875 consensus_queue.cc:237] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.143323  3734 raft_consensus.cc:2468] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 0.
W20260709 13:17:44.144836  3624 leader_election.cc:343] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.145452  3626 leader_election.cc:304] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 4ec5091d4f52461387b4ef4ddd99319f
I20260709 13:17:44.146719  3856 raft_consensus.cc:2804] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.147133  3856 raft_consensus.cc:493] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.147514  3856 raft_consensus.cc:3060] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.149710  3849 tablet_bootstrap.cc:492] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:44.150470  3849 ts_tablet_manager.cc:1403] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.021s
I20260709 13:17:44.119504  3850 consensus_queue.cc:260] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.151856  3855 raft_consensus.cc:493] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.152556  3855 raft_consensus.cc:515] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.156190  3849 raft_consensus.cc:359] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.157302  3852 tablet_bootstrap.cc:492] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:44.157857  3852 ts_tablet_manager.cc:1403] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.060s	user 0.033s	sys 0.019s
I20260709 13:17:44.158790  3855 leader_election.cc:290] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.157130  3849 raft_consensus.cc:385] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.159750  3849 raft_consensus.cc:740] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.159878  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.161042  3735 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 0.
I20260709 13:17:44.161476  3850 ts_tablet_manager.cc:1434] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.002s
I20260709 13:17:44.161257  3852 raft_consensus.cc:359] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.162035  3852 raft_consensus.cc:385] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.162495  3852 raft_consensus.cc:740] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.162689  3850 tablet_bootstrap.cc:492] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:44.161954  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.163069  3626 leader_election.cc:304] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.163225  3809 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 0.
I20260709 13:17:44.163328  3852 consensus_queue.cc:260] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.164637  3884 raft_consensus.cc:2804] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.165122  3884 raft_consensus.cc:493] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.165545  3884 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.165917  3852 ts_tablet_manager.cc:1434] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:44.167362  3849 consensus_queue.cc:260] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.169749  3849 ts_tablet_manager.cc:1434] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.008s
I20260709 13:17:44.171185  3849 tablet_bootstrap.cc:492] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:44.177285  3850 tablet_bootstrap.cc:654] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.177408  3852 tablet_bootstrap.cc:492] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:44.179018  3849 tablet_bootstrap.cc:654] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.179893  3556 catalog_manager.cc:5697] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67). New cstate: current_term: 1 leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.187718  3856 raft_consensus.cc:515] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.191172  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:44.192005  3735 raft_consensus.cc:3060] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.192878  3872 raft_consensus.cc:493] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.193557  3872 raft_consensus.cc:515] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.195490  3852 tablet_bootstrap.cc:654] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.191282  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
W20260709 13:17:44.198016  3624 leader_election.cc:343] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.198331  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c859ca2a86b45569483a543c6a44c13" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.198710  3856 leader_election.cc:290] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
W20260709 13:17:44.201380  3699 leader_election.cc:343] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.205664  3852 tablet_bootstrap.cc:492] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:44.205482  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c859ca2a86b45569483a543c6a44c13" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.206264  3852 ts_tablet_manager.cc:1403] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.007s
I20260709 13:17:44.206615  3809 raft_consensus.cc:2468] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 0.
I20260709 13:17:44.202800  3872 leader_election.cc:290] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.209048  3699 leader_election.cc:304] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.209453  3852 raft_consensus.cc:359] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.210306  3852 raft_consensus.cc:385] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.210695  3852 raft_consensus.cc:740] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.211242  3872 raft_consensus.cc:2804] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.211885  3872 raft_consensus.cc:493] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.211603  3852 consensus_queue.cc:260] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.212524  3872 raft_consensus.cc:3060] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.210083  3735 raft_consensus.cc:2468] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 1.
I20260709 13:17:44.214403  3852 ts_tablet_manager.cc:1434] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:44.214597  3626 leader_election.cc:304] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 4ec5091d4f52461387b4ef4ddd99319f
I20260709 13:17:44.215503  3852 tablet_bootstrap.cc:492] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:44.215845  3856 raft_consensus.cc:2804] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.216615  3856 raft_consensus.cc:697] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:44.217567  3856 consensus_queue.cc:237] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.223136  3852 tablet_bootstrap.cc:654] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.229220  3884 raft_consensus.cc:515] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.231453  3849 tablet_bootstrap.cc:492] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:44.232069  3849 ts_tablet_manager.cc:1403] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.031s
I20260709 13:17:44.233979  3872 raft_consensus.cc:515] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.235666  3849 raft_consensus.cc:359] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.236689  3849 raft_consensus.cc:385] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.237123  3849 raft_consensus.cc:740] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.238258  3849 consensus_queue.cc:260] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.239985  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:44.241184  3735 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.241214  3849 ts_tablet_manager.cc:1434] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:17:44.242983  3849 tablet_bootstrap.cc:492] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:44.244041  3884 leader_election.cc:290] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.245414  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:44.249356  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c859ca2a86b45569483a543c6a44c13" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:44.252611  3809 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:44.253695  3699 leader_election.cc:343] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.250511  3849 tablet_bootstrap.cc:654] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.252002  3852 tablet_bootstrap.cc:492] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:44.251848  3735 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 1.
I20260709 13:17:44.255409  3852 ts_tablet_manager.cc:1403] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.004s
I20260709 13:17:44.256008  3626 leader_election.cc:304] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.257040  3884 raft_consensus.cc:2804] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.257544  3884 raft_consensus.cc:697] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:44.257948  3872 leader_election.cc:290] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.258423  3884 consensus_queue.cc:237] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.261320  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c859ca2a86b45569483a543c6a44c13" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:44.262100  3808 raft_consensus.cc:3060] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.258687  3852 raft_consensus.cc:359] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.263262  3852 raft_consensus.cc:385] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.263576  3852 raft_consensus.cc:740] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.264374  3852 consensus_queue.cc:260] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.266834  3852 ts_tablet_manager.cc:1434] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:44.266889  3809 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 1.
I20260709 13:17:44.267951  3852 tablet_bootstrap.cc:492] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f: Bootstrap starting.
I20260709 13:17:44.280551  3852 tablet_bootstrap.cc:654] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.293875  3872 raft_consensus.cc:493] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.295555  3872 raft_consensus.cc:515] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.293960  3854 raft_consensus.cc:493] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.296720  3854 raft_consensus.cc:515] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.297772  3884 raft_consensus.cc:493] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.298424  3884 raft_consensus.cc:515] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.297744  3557 catalog_manager.cc:5697] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 0 to 1, leader changed from <none> to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.304467  3854 leader_election.cc:290] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.301934  3884 leader_election.cc:290] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.303692  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9d1ec007924167bafeb12e6e4330f6" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.305837  3809 raft_consensus.cc:2468] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 0.
I20260709 13:17:44.303810  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.306607  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.300076  3808 raft_consensus.cc:2468] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 1.
I20260709 13:17:44.306420  3557 catalog_manager.cc:5697] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 0 to 1, leader changed from <none> to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.308059  3875 raft_consensus.cc:493] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.308681  3875 raft_consensus.cc:515] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.310741  3875 leader_election.cc:290] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:44.311730  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.312712  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.307464  3659 raft_consensus.cc:2468] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 0.
I20260709 13:17:44.315788  3699 leader_election.cc:304] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: c80a8051fe814f15a2647b2b387a3c0b
W20260709 13:17:44.315969  3775 leader_election.cc:343] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:44.317319  3699 leader_election.cc:343] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.318785  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9d1ec007924167bafeb12e6e4330f6" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.319228  3872 leader_election.cc:290] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.319886  3872 raft_consensus.cc:2804] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.320173  3699 leader_election.cc:304] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.320402  3872 raft_consensus.cc:697] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Becoming Leader. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:44.322440  3872 consensus_queue.cc:237] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.328671  3854 raft_consensus.cc:2804] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:44.327971  3773 leader_election.cc:343] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.329850  3875 raft_consensus.cc:493] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.334539  3854 raft_consensus.cc:493] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.334017  3624 leader_election.cc:304] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.338881  3773 leader_election.cc:304] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f; no voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.339586  3875 raft_consensus.cc:515] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.350054  3884 raft_consensus.cc:2804] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.350639  3884 raft_consensus.cc:493] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.351115  3884 raft_consensus.cc:3060] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.341933  3854 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.347904  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.353652  3735 raft_consensus.cc:2468] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 0.
I20260709 13:17:44.355496  3882 raft_consensus.cc:2749] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.356992  3775 leader_election.cc:304] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: 
I20260709 13:17:44.358160  3882 raft_consensus.cc:2804] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.359047  3882 raft_consensus.cc:493] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.359519  3882 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:44.360231  3626 leader_election.cc:343] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.359527  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.362728  3850 tablet_bootstrap.cc:492] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:44.363516  3850 ts_tablet_manager.cc:1403] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.201s	user 0.022s	sys 0.022s
I20260709 13:17:44.349422  3875 leader_election.cc:290] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:44.366513  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.368767  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.370707  3809 raft_consensus.cc:2468] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 0.
I20260709 13:17:44.371766  3872 raft_consensus.cc:493] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.372128  3773 leader_election.cc:343] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.375931  3884 raft_consensus.cc:515] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.377388  3849 tablet_bootstrap.cc:492] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:44.379261  3854 raft_consensus.cc:515] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.369021  3850 raft_consensus.cc:359] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.372663  3872 raft_consensus.cc:515] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.381464  3556 catalog_manager.cc:5697] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c146e8c13b62470cad363220f92f0ad5 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "c146e8c13b62470cad363220f92f0ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.383450  3849 ts_tablet_manager.cc:1403] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.021s
I20260709 13:17:44.382311  3882 raft_consensus.cc:515] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.385607  3808 raft_consensus.cc:2393] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c146e8c13b62470cad363220f92f0ad5 in current term 1: Already voted for candidate 4ec5091d4f52461387b4ef4ddd99319f in this term.
I20260709 13:17:44.383895  3852 tablet_bootstrap.cc:492] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f: No bootstrap required, opened a new log
I20260709 13:17:44.387611  3852 ts_tablet_manager.cc:1403] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.031s
I20260709 13:17:44.383992  3850 raft_consensus.cc:385] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.387984  3850 raft_consensus.cc:740] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.388999  3849 raft_consensus.cc:359] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.391594  3849 raft_consensus.cc:385] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.388119  3699 leader_election.cc:304] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5; no voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.389178  3850 consensus_queue.cc:260] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.393415  3896 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.393473  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:44.394155  3849 raft_consensus.cc:740] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.394393  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9d1ec007924167bafeb12e6e4330f6" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:44.395056  3808 raft_consensus.cc:3060] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.395105  3849 consensus_queue.cc:260] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.396476  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:44.390508  3852 raft_consensus.cc:359] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.397107  3659 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.397468  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9d1ec007924167bafeb12e6e4330f6" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:44.398119  3735 raft_consensus.cc:3060] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.399392  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ecb79bb19f4e4d92b9141a6af9c04e" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.400596  3875 raft_consensus.cc:493] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.401120  3875 raft_consensus.cc:515] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.404207  3875 leader_election.cc:290] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:44.405750  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.406497  3734 raft_consensus.cc:2468] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 0.
W20260709 13:17:44.407931  3699 leader_election.cc:343] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.409183  3775 leader_election.cc:304] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: 
W20260709 13:17:44.410710  3773 leader_election.cc:343] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.412513  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.413862  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:44.414461  3809 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.414887  3884 leader_election.cc:290] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.391165  3854 leader_election.cc:290] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.417251  3735 raft_consensus.cc:2468] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 1.
I20260709 13:17:44.417657  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ecb79bb19f4e4d92b9141a6af9c04e" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.418388  3807 raft_consensus.cc:2468] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 0.
I20260709 13:17:44.418973  3626 leader_election.cc:304] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.419857  3884 raft_consensus.cc:2804] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.415282  3872 leader_election.cc:290] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.397210  3852 raft_consensus.cc:385] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.420540  3852 raft_consensus.cc:740] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.420604  3875 raft_consensus.cc:2804] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.420674  3884 raft_consensus.cc:697] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:44.421543  3852 consensus_queue.cc:260] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.421859  3884 consensus_queue.cc:237] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.424045  3852 ts_tablet_manager.cc:1434] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:17:44.421263  3875 raft_consensus.cc:493] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.424932  3875 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.416217  3659 raft_consensus.cc:2468] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 1.
I20260709 13:17:44.429629  3699 leader_election.cc:304] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.439823  3872 raft_consensus.cc:2804] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.440603  3872 raft_consensus.cc:697] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Becoming Leader. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:44.440902  3699 leader_election.cc:304] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.442032  3854 raft_consensus.cc:2804] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.441788  3872 consensus_queue.cc:237] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.442631  3854 raft_consensus.cc:493] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.443379  3854 raft_consensus.cc:3060] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.447160  3809 raft_consensus.cc:2468] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 1.
I20260709 13:17:44.416939  3850 ts_tablet_manager.cc:1434] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
W20260709 13:17:44.442659  3773 leader_election.cc:343] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.453408  3850 tablet_bootstrap.cc:492] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:44.456787  3882 leader_election.cc:290] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:44.457012  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:44.459455  3854 raft_consensus.cc:515] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.460659  3808 raft_consensus.cc:2468] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 1.
I20260709 13:17:44.462598  3558 catalog_manager.cc:5697] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c146e8c13b62470cad363220f92f0ad5 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "c146e8c13b62470cad363220f92f0ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.464071  3896 raft_consensus.cc:2749] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.465318  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ecb79bb19f4e4d92b9141a6af9c04e" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
W20260709 13:17:44.467238  3699 leader_election.cc:343] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.467446  3854 leader_election.cc:290] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.467214  3849 ts_tablet_manager.cc:1434] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.082s	user 0.021s	sys 0.017s
I20260709 13:17:44.471626  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ecb79bb19f4e4d92b9141a6af9c04e" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:44.472625  3808 raft_consensus.cc:3060] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.473512  3735 raft_consensus.cc:2468] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 1.
I20260709 13:17:44.475780  3775 leader_election.cc:304] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.470793  3849 tablet_bootstrap.cc:492] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5: Bootstrap starting.
I20260709 13:17:44.481212  3882 raft_consensus.cc:2804] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.482789  3882 raft_consensus.cc:697] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Becoming Leader. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:44.483773  3882 consensus_queue.cc:237] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.484745  3861 raft_consensus.cc:493] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.485479  3861 raft_consensus.cc:515] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.489235  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b" is_pre_election: true
I20260709 13:17:44.485849  3875 raft_consensus.cc:515] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.490018  3861 leader_election.cc:290] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:44.495445  3850 tablet_bootstrap.cc:654] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.496956  3875 leader_election.cc:290] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:44.490253  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.500285  3735 raft_consensus.cc:2393] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ec5091d4f52461387b4ef4ddd99319f in current term 1: Already voted for candidate c80a8051fe814f15a2647b2b387a3c0b in this term.
I20260709 13:17:44.500566  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:44.501024  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:44.501255  3734 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:44.516326  3773 leader_election.cc:343] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.516635  3849 tablet_bootstrap.cc:654] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.516539  3775 leader_election.cc:304] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f; no voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.519068  3875 raft_consensus.cc:3060] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.521505  3808 raft_consensus.cc:2468] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 1.
I20260709 13:17:44.522765  3699 leader_election.cc:304] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.524081  3896 raft_consensus.cc:2804] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.517876  3558 catalog_manager.cc:5697] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67). New cstate: current_term: 1 leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.525976  3896 raft_consensus.cc:697] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Becoming Leader. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:44.523583  3557 catalog_manager.cc:5697] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 0 to 1, leader changed from <none> to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.527922  3896 consensus_queue.cc:237] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.543943  3882 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.542660  3734 raft_consensus.cc:2468] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 1.
I20260709 13:17:44.549415  3775 leader_election.cc:304] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.552203  3882 raft_consensus.cc:2804] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.554348  3882 raft_consensus.cc:697] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Becoming Leader. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:44.555991  3875 raft_consensus.cc:2749] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.555439  3882 consensus_queue.cc:237] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.556792  3850 tablet_bootstrap.cc:492] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:44.557643  3850 ts_tablet_manager.cc:1403] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.001s
I20260709 13:17:44.561870  3850 raft_consensus.cc:359] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.568902  3849 tablet_bootstrap.cc:492] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5: No bootstrap required, opened a new log
I20260709 13:17:44.569518  3849 ts_tablet_manager.cc:1403] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.031s
I20260709 13:17:44.573300  3849 raft_consensus.cc:359] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.574275  3849 raft_consensus.cc:385] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.572953  3558 catalog_manager.cc:5697] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c146e8c13b62470cad363220f92f0ad5 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "c146e8c13b62470cad363220f92f0ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.574692  3849 raft_consensus.cc:740] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.575958  3849 consensus_queue.cc:260] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.579103  3849 ts_tablet_manager.cc:1434] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:44.562723  3850 raft_consensus.cc:385] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.578258  3557 catalog_manager.cc:5697] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67). New cstate: current_term: 1 leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.580037  3850 raft_consensus.cc:740] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.581925  3850 consensus_queue.cc:260] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.596513  3882 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:44.614969  3850 ts_tablet_manager.cc:1434] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:17:44.616434  3850 tablet_bootstrap.cc:492] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:44.622793  3850 tablet_bootstrap.cc:654] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.625808  3884 consensus_queue.cc:1048] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.634848  3850 tablet_bootstrap.cc:492] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:44.635466  3850 ts_tablet_manager.cc:1403] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.003s
I20260709 13:17:44.638794  3850 raft_consensus.cc:359] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.639609  3850 raft_consensus.cc:385] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.639904  3850 raft_consensus.cc:740] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.640695  3850 consensus_queue.cc:260] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.642552  3884 consensus_queue.cc:1048] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.643446  3850 ts_tablet_manager.cc:1434] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:17:44.644500  3850 tablet_bootstrap.cc:492] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:44.652416  3850 tablet_bootstrap.cc:654] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.652122  3884 consensus_queue.cc:1048] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.671334  3850 tablet_bootstrap.cc:492] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:44.671897  3850 ts_tablet_manager.cc:1403] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 13:17:44.675716  3850 raft_consensus.cc:359] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.676594  3850 raft_consensus.cc:385] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.676893  3850 raft_consensus.cc:740] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.677603  3850 consensus_queue.cc:260] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.677613  3884 consensus_queue.cc:1048] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.680271  3850 ts_tablet_manager.cc:1434] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:44.681384  3850 tablet_bootstrap.cc:492] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b: Bootstrap starting.
I20260709 13:17:44.684674  3884 raft_consensus.cc:493] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.685318  3884 raft_consensus.cc:515] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.688575  3850 tablet_bootstrap.cc:654] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.688796  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.689540  3735 raft_consensus.cc:2468] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 0.
I20260709 13:17:44.689774  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.690461  3809 raft_consensus.cc:2468] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 0.
I20260709 13:17:44.691043  3626 leader_election.cc:304] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.691993  3856 raft_consensus.cc:2804] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.692485  3856 raft_consensus.cc:493] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.692875  3856 raft_consensus.cc:3060] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.691987  3884 leader_election.cc:290] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.706149  3856 raft_consensus.cc:515] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.710986  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:44.712037  3734 raft_consensus.cc:3060] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.722105  3734 raft_consensus.cc:2468] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 1.
I20260709 13:17:44.723582  3626 leader_election.cc:304] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.725054  3855 raft_consensus.cc:2804] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.725615  3855 raft_consensus.cc:697] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:44.726537  3855 consensus_queue.cc:237] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.732311  3856 leader_election.cc:290] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.735227  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:44.735954  3850 tablet_bootstrap.cc:492] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b: No bootstrap required, opened a new log
I20260709 13:17:44.735994  3808 raft_consensus.cc:3060] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.736608  3850 ts_tablet_manager.cc:1403] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.027s
I20260709 13:17:44.739756  3850 raft_consensus.cc:359] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.740684  3850 raft_consensus.cc:385] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.740994  3850 raft_consensus.cc:740] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.739969  3557 catalog_manager.cc:5697] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 0 to 1, leader changed from <none> to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.741816  3850 consensus_queue.cc:260] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.744094  3850 ts_tablet_manager.cc:1434] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:44.744148  3808 raft_consensus.cc:2468] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 1.
I20260709 13:17:44.789539  3896 consensus_queue.cc:1048] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.800148  3659 raft_consensus.cc:3060] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.808892  3855 consensus_queue.cc:1048] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.812801  3898 consensus_queue.cc:1048] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.824754  3884 consensus_queue.cc:1048] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.864439  3898 consensus_queue.cc:1048] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.877812  3659 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.888568  3882 consensus_queue.cc:1048] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.889168  3854 consensus_queue.cc:1048] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.901846  3734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f92b8f10f618407183482b7214519229"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
mode: GRACEFUL
new_leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:54646
I20260709 13:17:44.902583  3734 raft_consensus.cc:606] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Received request to transfer leadership to TS c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.905782  3854 raft_consensus.cc:993] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5: : Instructing follower c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:44.906327  3854 raft_consensus.cc:1081] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Signalling peer c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:44.910728  3875 consensus_queue.cc:1048] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.911474  3660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f92b8f10f618407183482b7214519229"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:56338
I20260709 13:17:44.915623  3660 raft_consensus.cc:493] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.916167  3660 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.925313  3660 raft_consensus.cc:515] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.928785  3660 leader_election.cc:290] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 2 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.928601  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:44.929903  3735 raft_consensus.cc:3055] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:44.930280  3735 raft_consensus.cc:740] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:44.930403  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:44.931003  3809 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.931185  3735 consensus_queue.cc:260] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.932664  3735 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.939615  3658 raft_consensus.cc:3060] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.943476  3735 raft_consensus.cc:2468] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 2.
I20260709 13:17:44.946815  3626 leader_election.cc:304] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:44.947912  3884 raft_consensus.cc:2804] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:44.948454  3884 raft_consensus.cc:697] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:44.949354  3884 consensus_queue.cc:237] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.949676  3809 raft_consensus.cc:2468] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 2.
I20260709 13:17:44.951277  3872 consensus_queue.cc:1048] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.963063  3557 catalog_manager.cc:5697] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 1 to 2, leader changed from c146e8c13b62470cad363220f92f0ad5 (127.2.243.66) to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 2 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.966180  3872 consensus_queue.cc:1048] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.973189  3884 raft_consensus.cc:493] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.973954  3884 raft_consensus.cc:515] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:44.976337  3884 leader_election.cc:290] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:44.976588  3808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
mode: GRACEFUL
new_leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:45630
I20260709 13:17:44.977267  3808 raft_consensus.cc:606] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Received request to transfer leadership to TS c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:44.977247  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c146e8c13b62470cad363220f92f0ad5" is_pre_election: true
I20260709 13:17:44.978355  3735 raft_consensus.cc:2393] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c80a8051fe814f15a2647b2b387a3c0b in current term 1: Already voted for candidate 4ec5091d4f52461387b4ef4ddd99319f in this term.
I20260709 13:17:44.979844  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f" is_pre_election: true
I20260709 13:17:44.982250  3624 leader_election.cc:304] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c80a8051fe814f15a2647b2b387a3c0b; no voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5
I20260709 13:17:44.984002  3884 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.988662  3807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25264a646a2a463f80fc8766c1170545"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
mode: GRACEFUL
new_leader_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:45630
I20260709 13:17:44.989401  3807 raft_consensus.cc:606] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Received request to transfer leadership to TS c146e8c13b62470cad363220f92f0ad5
I20260709 13:17:44.993019  3884 raft_consensus.cc:2749] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.997682  3807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
mode: GRACEFUL
new_leader_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:45630
I20260709 13:17:44.998245  3807 raft_consensus.cc:606] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Received request to transfer leadership to TS c146e8c13b62470cad363220f92f0ad5
I20260709 13:17:45.017124  3658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
mode: GRACEFUL
new_leader_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:56352
I20260709 13:17:45.017860  3658 raft_consensus.cc:606] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Received request to transfer leadership to TS c146e8c13b62470cad363220f92f0ad5
I20260709 13:17:45.025318  3735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1ecb79bb19f4e4d92b9141a6af9c04e"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
mode: GRACEFUL
new_leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:54646
I20260709 13:17:45.025972  3735 raft_consensus.cc:606] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Received request to transfer leadership to TS 4ec5091d4f52461387b4ef4ddd99319f
I20260709 13:17:45.030712  3875 consensus_queue.cc:1048] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.041204  3882 raft_consensus.cc:993] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f: : Instructing follower c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:45.041757  3861 raft_consensus.cc:1081] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Signalling peer c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:45.043684  3734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25264a646a2a463f80fc8766c1170545"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:54642
I20260709 13:17:45.044445  3734 raft_consensus.cc:493] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.044870  3734 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.047952  3875 consensus_queue.cc:1048] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.054957  3734 raft_consensus.cc:515] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.057650  3734 leader_election.cc:290] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 2 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:45.060621  3735 raft_consensus.cc:1240] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Rejecting Update request from peer 4ec5091d4f52461387b4ef4ddd99319f for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:45.062717  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:45.063093  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:45.063482  3658 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.063717  3807 raft_consensus.cc:3055] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.064126  3807 raft_consensus.cc:740] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:45.065184  3807 consensus_queue.cc:260] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.066515  3807 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.072000  3658 raft_consensus.cc:2468] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 2.
I20260709 13:17:45.073527  3699 leader_election.cc:304] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:45.074955  3872 raft_consensus.cc:2804] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.075474  3807 raft_consensus.cc:2468] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 2.
I20260709 13:17:45.075980  3872 raft_consensus.cc:697] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Becoming Leader. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:45.077266  3872 consensus_queue.cc:237] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.088076  3555 catalog_manager.cc:5697] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 reported cstate change: term changed from 1 to 2, leader changed from 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67) to c146e8c13b62470cad363220f92f0ad5 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "c146e8c13b62470cad363220f92f0ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.157131  3861 raft_consensus.cc:993] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f: : Instructing follower c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:45.157625  3875 raft_consensus.cc:1081] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Signalling peer c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:45.159518  3658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:56350
I20260709 13:17:45.160317  3658 raft_consensus.cc:493] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.160821  3658 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.163012  3884 consensus_queue.cc:1048] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.169101  3658 raft_consensus.cc:515] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.172420  3856 raft_consensus.cc:993] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b: : Instructing follower c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:45.171938  3658 leader_election.cc:290] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 2 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:45.173010  3856 raft_consensus.cc:1081] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Signalling peer c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:45.175540  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:45.175988  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:45.176257  3807 raft_consensus.cc:3055] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.176645  3807 raft_consensus.cc:740] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:45.175566  3733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:54626
I20260709 13:17:45.177366  3733 raft_consensus.cc:493] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.178272  3733 raft_consensus.cc:3060] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.178087  3807 consensus_queue.cc:260] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.180091  3807 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.176651  3735 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.183315  3884 consensus_queue.cc:1048] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.188622  3733 raft_consensus.cc:515] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.190026  3734 raft_consensus.cc:1240] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Rejecting Update request from peer c80a8051fe814f15a2647b2b387a3c0b for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:45.191095  3735 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 2.
I20260709 13:17:45.193149  3626 leader_election.cc:304] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:45.193565  3884 consensus_queue.cc:1059] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.194152  3855 raft_consensus.cc:2804] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.198139  3733 leader_election.cc:290] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 2 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:45.200275  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:45.200896  3807 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 2.
I20260709 13:17:45.202066  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1cfcba93a1409dbf5d756d92a2468c" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:45.194782  3855 raft_consensus.cc:697] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:45.203495  3855 consensus_queue.cc:237] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.214186  3555 catalog_manager.cc:5697] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 1 to 2, leader changed from 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67) to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 2 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.221767  3658 raft_consensus.cc:3055] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.222323  3658 raft_consensus.cc:740] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:45.223340  3658 consensus_queue.cc:260] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.224608  3658 raft_consensus.cc:3060] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.233173  3658 raft_consensus.cc:2468] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 2.
W20260709 13:17:45.233815  3856 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:17:45.235666  3699 leader_election.cc:304] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 4ec5091d4f52461387b4ef4ddd99319f
I20260709 13:17:45.236553  3872 raft_consensus.cc:2804] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.237035  3872 raft_consensus.cc:697] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Becoming Leader. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:45.237922  3872 consensus_queue.cc:237] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.247484  3555 catalog_manager.cc:5697] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 reported cstate change: term changed from 1 to 2, leader changed from c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65) to c146e8c13b62470cad363220f92f0ad5 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "c146e8c13b62470cad363220f92f0ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.368673  3872 raft_consensus.cc:993] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5: : Instructing follower 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:45.369263  3896 raft_consensus.cc:1081] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Signalling peer 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:45.371203  3809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1ecb79bb19f4e4d92b9141a6af9c04e"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:45624
I20260709 13:17:45.371897  3809 raft_consensus.cc:493] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.372291  3809 raft_consensus.cc:3060] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.379098  3809 raft_consensus.cc:515] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.381390  3809 leader_election.cc:290] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 2 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:45.382573  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ecb79bb19f4e4d92b9141a6af9c04e" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:45.382750  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ecb79bb19f4e4d92b9141a6af9c04e" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:45.383347  3658 raft_consensus.cc:3060] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.383486  3733 raft_consensus.cc:3055] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.383925  3733 raft_consensus.cc:740] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:45.384789  3733 consensus_queue.cc:260] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.385819  3733 raft_consensus.cc:3060] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.389657  3658 raft_consensus.cc:2468] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 2.
I20260709 13:17:45.391144  3773 leader_election.cc:304] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:45.391566  3733 raft_consensus.cc:2468] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 2.
I20260709 13:17:45.392235  3875 raft_consensus.cc:2804] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.393057  3875 raft_consensus.cc:697] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 LEADER]: Becoming Leader. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:45.394095  3875 consensus_queue.cc:237] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.403342  3556 catalog_manager.cc:5697] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f reported cstate change: term changed from 1 to 2, leader changed from c146e8c13b62470cad363220f92f0ad5 (127.2.243.66) to 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67). New cstate: current_term: 2 leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.426569  3733 raft_consensus.cc:1275] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.428238  3856 consensus_queue.cc:1048] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.437454  3809 raft_consensus.cc:1275] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.439821  3856 consensus_queue.cc:1048] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.462868  3809 raft_consensus.cc:1275] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.464272  3896 consensus_queue.cc:1048] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.474191  3658 raft_consensus.cc:1275] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.476483  3896 consensus_queue.cc:1048] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.508313  3861 raft_consensus.cc:993] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f: : Instructing follower c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:45.508852  3875 raft_consensus.cc:1081] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Signalling peer c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:45.510656  3733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:54642
I20260709 13:17:45.511222  3733 raft_consensus.cc:493] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.511655  3733 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.517786  3733 raft_consensus.cc:515] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.519632  3733 leader_election.cc:290] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 2 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:45.520754  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:45.521037  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:45.521505  3658 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.521624  3809 raft_consensus.cc:3055] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.521997  3809 raft_consensus.cc:740] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:45.522933  3809 consensus_queue.cc:260] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.524271  3809 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.530143  3658 raft_consensus.cc:2468] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 2.
I20260709 13:17:45.531848  3699 leader_election.cc:304] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:45.532178  3809 raft_consensus.cc:2468] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 2.
I20260709 13:17:45.532750  3896 raft_consensus.cc:2804] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.533418  3896 raft_consensus.cc:697] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Becoming Leader. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:45.534257  3896 consensus_queue.cc:237] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:45.541947  3555 catalog_manager.cc:5697] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 reported cstate change: term changed from 1 to 2, leader changed from 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67) to c146e8c13b62470cad363220f92f0ad5 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "c146e8c13b62470cad363220f92f0ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.651048  3733 raft_consensus.cc:1275] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.652666  3856 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.662415  3809 raft_consensus.cc:1275] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.664089  3937 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.719146  3809 raft_consensus.cc:3060] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.726588  3809 raft_consensus.cc:1275] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.728132  3896 consensus_queue.cc:1048] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.739867  3658 raft_consensus.cc:1275] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.741828  3896 consensus_queue.cc:1048] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.909499  3658 raft_consensus.cc:1275] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.911007  3875 consensus_queue.cc:1048] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.920647  3733 raft_consensus.cc:1275] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.923291  3861 consensus_queue.cc:1048] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.983073  3808 raft_consensus.cc:1275] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.985502  3896 consensus_queue.cc:1048] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.996309  3658 raft_consensus.cc:1275] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.998454  3940 consensus_queue.cc:1048] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:48.065021  3021 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:17:48.065883  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.090826  3658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
mode: GRACEFUL
new_leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:56362
I20260709 13:17:48.091648  3658 raft_consensus.cc:606] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Received request to transfer leadership to TS 4ec5091d4f52461387b4ef4ddd99319f
I20260709 13:17:48.094601  3658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
mode: GRACEFUL
new_leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:56362
I20260709 13:17:48.095206  3658 raft_consensus.cc:606] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Received request to transfer leadership to TS 4ec5091d4f52461387b4ef4ddd99319f
I20260709 13:17:48.096596  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:48.097172  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:48.235957  3937 raft_consensus.cc:993] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b: : Instructing follower 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:48.236862  3949 raft_consensus.cc:1081] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Signalling peer 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:48.238675  3808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:17:48.239254  3808 raft_consensus.cc:493] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.239629  3808 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.246081  3808 raft_consensus.cc:515] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:48.248193  3808 leader_election.cc:290] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 2 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:48.249404  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:48.249545  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:48.250315  3658 raft_consensus.cc:3055] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.250476  3733 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.250675  3658 raft_consensus.cc:740] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:48.251736  3658 consensus_queue.cc:260] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:48.252837  3658 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.256645  3733 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 2.
I20260709 13:17:48.258160  3775 leader_election.cc:304] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: 
I20260709 13:17:48.258852  3658 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 2.
I20260709 13:17:48.258991  3946 raft_consensus.cc:2804] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.260587  3946 raft_consensus.cc:697] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 LEADER]: Becoming Leader. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:48.261464  3946 consensus_queue.cc:237] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:48.270190  3556 catalog_manager.cc:5697] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f reported cstate change: term changed from 1 to 2, leader changed from c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65) to 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67). New cstate: current_term: 2 leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.278326  3950 raft_consensus.cc:993] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b: : Instructing follower 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:48.278980  3949 raft_consensus.cc:1081] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Signalling peer 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:48.281399  3808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:17:48.281992  3808 raft_consensus.cc:493] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.282454  3808 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.290938  3808 raft_consensus.cc:515] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:48.293357  3808 leader_election.cc:290] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 3 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:48.294287  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:48.294499  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:48.294885  3658 raft_consensus.cc:3055] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:48.295114  3733 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.295259  3658 raft_consensus.cc:740] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:48.296175  3658 consensus_queue.cc:260] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:48.297322  3658 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.302042  3733 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 3.
I20260709 13:17:48.303050  3658 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 3.
I20260709 13:17:48.303392  3775 leader_election.cc:304] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: 
I20260709 13:17:48.304705  3946 raft_consensus.cc:2804] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:48.305301  3946 raft_consensus.cc:697] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 LEADER]: Becoming Leader. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:48.306161  3946 consensus_queue.cc:237] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:48.317792  3556 catalog_manager.cc:5697] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f reported cstate change: term changed from 2 to 3, leader changed from c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65) to 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67). New cstate: current_term: 3 leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.678792  3658 raft_consensus.cc:1275] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.680445  3946 consensus_queue.cc:1048] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:48.694072  3733 raft_consensus.cc:1275] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.696772  3960 consensus_queue.cc:1048] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:48.835839  3658 raft_consensus.cc:1275] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:48.838469  3960 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:48.857451  3733 raft_consensus.cc:1275] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:48.867470  3951 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.098399  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.117543  3808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
mode: GRACEFUL
new_leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:45630
I20260709 13:17:49.118256  3808 raft_consensus.cc:606] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 LEADER]: Received request to transfer leadership to TS c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:49.129884  3808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
mode: GRACEFUL
new_leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:45630
I20260709 13:17:49.130630  3808 raft_consensus.cc:606] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 LEADER]: Received request to transfer leadership to TS c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:49.137558  3733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c859ca2a86b45569483a543c6a44c13"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
mode: GRACEFUL
new_leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:54646
I20260709 13:17:49.138121  3733 raft_consensus.cc:606] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Received request to transfer leadership to TS c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:49.144639  3733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25264a646a2a463f80fc8766c1170545"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
mode: GRACEFUL
new_leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:54646
I20260709 13:17:49.145284  3733 raft_consensus.cc:606] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Received request to transfer leadership to TS c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:49.150600  3854 raft_consensus.cc:993] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5: : Instructing follower c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.151211  3854 raft_consensus.cc:1081] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Signalling peer c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.152364  3733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
mode: GRACEFUL
new_leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:54646
I20260709 13:17:49.152978  3733 raft_consensus.cc:606] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Received request to transfer leadership to TS c80a8051fe814f15a2647b2b387a3c0b
I20260709 13:17:49.153437  3658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25264a646a2a463f80fc8766c1170545"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:56338
I20260709 13:17:49.154193  3658 raft_consensus.cc:493] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.154693  3658 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.164006  3658 raft_consensus.cc:515] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.165982  3658 leader_election.cc:290] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 3 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:49.167092  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:49.167237  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25264a646a2a463f80fc8766c1170545" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:49.167878  3733 raft_consensus.cc:3055] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.167989  3808 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.168202  3733 raft_consensus.cc:740] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:49.169703  3733 consensus_queue.cc:260] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.171352  3733 raft_consensus.cc:3060] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.175781  3808 raft_consensus.cc:2468] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 3.
I20260709 13:17:49.177757  3624 leader_election.cc:304] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:49.178819  3949 raft_consensus.cc:2804] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.179589  3733 raft_consensus.cc:2468] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 3.
I20260709 13:17:49.179652  3949 raft_consensus.cc:697] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:49.181036  3949 consensus_queue.cc:237] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.190687  3556 catalog_manager.cc:5697] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 2 to 3, leader changed from c146e8c13b62470cad363220f92f0ad5 (127.2.243.66) to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 3 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.212059  3960 raft_consensus.cc:993] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f: : Instructing follower c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.212636  3960 raft_consensus.cc:1081] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 LEADER]: Signalling peer c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.214438  3658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:56350
I20260709 13:17:49.215063  3658 raft_consensus.cc:493] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.215353  3658 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.223241  3658 raft_consensus.cc:515] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.225206  3658 leader_election.cc:290] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 3 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:49.226593  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:49.226972  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:49.227298  3808 raft_consensus.cc:3055] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.227843  3733 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.227865  3808 raft_consensus.cc:740] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:49.229363  3808 consensus_queue.cc:260] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.230989  3808 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.234098  3968 raft_consensus.cc:993] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5: : Instructing follower c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.234736  3968 raft_consensus.cc:1081] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Signalling peer c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.237062  3658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:56338
I20260709 13:17:49.237695  3658 raft_consensus.cc:493] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.238090  3658 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.238600  3733 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 3.
I20260709 13:17:49.238737  3808 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 3.
I20260709 13:17:49.240099  3626 leader_election.cc:304] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:49.240978  3949 raft_consensus.cc:2804] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.241781  3949 raft_consensus.cc:697] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:49.243112  3949 consensus_queue.cc:237] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.245718  3658 raft_consensus.cc:515] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.248596  3658 leader_election.cc:290] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 3 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:49.249500  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:49.250415  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cc8e22ec1848f3b2b64a04b3ec5673" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:49.251024  3808 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.250988  3733 raft_consensus.cc:3055] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.251883  3733 raft_consensus.cc:740] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:49.252864  3733 consensus_queue.cc:260] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.253875  3556 catalog_manager.cc:5697] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 2 to 3, leader changed from 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67) to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 3 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.254590  3733 raft_consensus.cc:3060] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.262574  3808 raft_consensus.cc:2468] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 3.
I20260709 13:17:49.263974  3624 leader_election.cc:304] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:49.264916  3949 raft_consensus.cc:2804] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.264927  3733 raft_consensus.cc:2468] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 3.
I20260709 13:17:49.265471  3949 raft_consensus.cc:697] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:49.266764  3949 consensus_queue.cc:237] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.275283  3556 catalog_manager.cc:5697] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 2 to 3, leader changed from c146e8c13b62470cad363220f92f0ad5 (127.2.243.66) to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 3 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.329919  3854 raft_consensus.cc:993] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5: : Instructing follower c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.330454  3968 raft_consensus.cc:1081] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Signalling peer c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.332392  3658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c859ca2a86b45569483a543c6a44c13"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:56338
I20260709 13:17:49.332921  3658 raft_consensus.cc:493] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.333220  3658 raft_consensus.cc:3060] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.340516  3658 raft_consensus.cc:515] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.342833  3658 leader_election.cc:290] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 2 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:49.344069  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c859ca2a86b45569483a543c6a44c13" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:49.344067  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c859ca2a86b45569483a543c6a44c13" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:49.344946  3808 raft_consensus.cc:3060] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.344957  3733 raft_consensus.cc:3055] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:49.345489  3733 raft_consensus.cc:740] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:49.346412  3733 consensus_queue.cc:260] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.347844  3733 raft_consensus.cc:3060] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.349182  3951 raft_consensus.cc:993] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f: : Instructing follower c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.349814  3960 raft_consensus.cc:1081] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 LEADER]: Signalling peer c80a8051fe814f15a2647b2b387a3c0b to start an election
I20260709 13:17:49.351701  3658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
 from {username='slave'} at 127.0.0.1:56350
I20260709 13:17:49.352238  3658 raft_consensus.cc:493] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.352610  3658 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.354959  3808 raft_consensus.cc:2468] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 2.
I20260709 13:17:49.356033  3733 raft_consensus.cc:2468] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 2.
I20260709 13:17:49.356269  3624 leader_election.cc:304] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:49.357187  3949 raft_consensus.cc:2804] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:49.357638  3949 raft_consensus.cc:697] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:49.358495  3949 consensus_queue.cc:237] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.358654  3658 raft_consensus.cc:515] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.360388  3658 leader_election.cc:290] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 4 election: Requested vote from peers c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:49.361248  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:49.361773  3733 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.363914  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "c80a8051fe814f15a2647b2b387a3c0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:49.364478  3808 raft_consensus.cc:3055] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:49.364921  3808 raft_consensus.cc:740] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:49.366184  3808 consensus_queue.cc:260] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.367111  3808 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.367296  3556 catalog_manager.cc:5697] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 1 to 2, leader changed from c146e8c13b62470cad363220f92f0ad5 (127.2.243.66) to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 2 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.369071  3733 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 4.
I20260709 13:17:49.370663  3626 leader_election.cc:304] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:49.371403  3949 raft_consensus.cc:2804] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:49.371811  3949 raft_consensus.cc:697] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 4 LEADER]: Becoming Leader. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:49.372704  3949 consensus_queue.cc:237] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:49.373718  3808 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c80a8051fe814f15a2647b2b387a3c0b in term 4.
I20260709 13:17:49.387341  3556 catalog_manager.cc:5697] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b reported cstate change: term changed from 3 to 4, leader changed from 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67) to c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65). New cstate: current_term: 4 leader_uuid: "c80a8051fe814f15a2647b2b387a3c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.608078  3733 raft_consensus.cc:1275] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.609508  3949 consensus_queue.cc:1048] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.625074  3808 raft_consensus.cc:1275] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.627282  3966 consensus_queue.cc:1048] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.709981  3735 raft_consensus.cc:1275] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.711980  3978 consensus_queue.cc:1048] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.723730  3808 raft_consensus.cc:1275] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.726400  3966 consensus_queue.cc:1048] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.755084  3808 raft_consensus.cc:1275] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.757014  3966 consensus_queue.cc:1048] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.769158  3735 raft_consensus.cc:1275] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.770956  3978 consensus_queue.cc:1048] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.782502  3808 raft_consensus.cc:1275] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:49.783947  3978 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:49.791945  3735 raft_consensus.cc:1275] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 4 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:49.793926  3978 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:49.927100  3808 raft_consensus.cc:1275] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.928728  3978 consensus_queue.cc:1048] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.942227  3735 raft_consensus.cc:1275] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Refusing update from remote peer c80a8051fe814f15a2647b2b387a3c0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.943830  3966 consensus_queue.cc:1048] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.164598  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.174224  3658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "087ff59e81504d51810b408ab971e40e"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
mode: GRACEFUL
new_leader_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:56362
I20260709 13:17:52.174904  3658 raft_consensus.cc:606] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Received request to transfer leadership to TS c146e8c13b62470cad363220f92f0ad5
I20260709 13:17:52.178432  3658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
mode: GRACEFUL
new_leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:56362
I20260709 13:17:52.179052  3658 raft_consensus.cc:606] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Received request to transfer leadership to TS 4ec5091d4f52461387b4ef4ddd99319f
I20260709 13:17:52.182191  3658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
mode: GRACEFUL
new_leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:56362
I20260709 13:17:52.182786  3658 raft_consensus.cc:606] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 4 LEADER]: Received request to transfer leadership to TS 4ec5091d4f52461387b4ef4ddd99319f
I20260709 13:17:52.185853  3658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f92b8f10f618407183482b7214519229"
dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
mode: GRACEFUL
new_leader_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:56362
I20260709 13:17:52.186589  3658 raft_consensus.cc:606] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Received request to transfer leadership to TS c146e8c13b62470cad363220f92f0ad5
I20260709 13:17:52.188565  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:52.189186  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:52.262918  3966 raft_consensus.cc:993] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b: : Instructing follower c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:52.263511  3966 raft_consensus.cc:1081] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Signalling peer c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:52.265030  3966 raft_consensus.cc:993] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b: : Instructing follower 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:52.265765  3978 raft_consensus.cc:1081] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Signalling peer 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:52.265746  3733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "087ff59e81504d51810b408ab971e40e"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:54626
I20260709 13:17:52.266515  3733 raft_consensus.cc:493] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.266906  3733 raft_consensus.cc:3060] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.267876  3808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:17:52.268435  3808 raft_consensus.cc:493] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.268715  3808 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.272244  3733 raft_consensus.cc:515] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.273686  3808 raft_consensus.cc:515] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.275337  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:52.275933  3658 raft_consensus.cc:3055] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.276230  3658 raft_consensus.cc:740] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:52.276908  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:52.276376  3808 leader_election.cc:290] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 4 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:52.277527  3735 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.277849  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3aca580de9422ebe80bc6ac5c9e6f3" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:52.276654  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087ff59e81504d51810b408ab971e40e" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:52.277562  3658 consensus_queue.cc:260] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.278501  3660 raft_consensus.cc:3055] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:52.276135  3733 leader_election.cc:290] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 2 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:52.278921  3660 raft_consensus.cc:740] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:52.278891  3809 raft_consensus.cc:3060] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.279935  3660 consensus_queue.cc:260] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.281263  3658 raft_consensus.cc:3060] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.281504  3660 raft_consensus.cc:3060] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.286552  3735 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 4.
I20260709 13:17:52.288532  3775 leader_election.cc:304] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: 
I20260709 13:17:52.289659  3987 raft_consensus.cc:2804] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:52.290196  3658 raft_consensus.cc:2468] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 2.
I20260709 13:17:52.290606  3660 raft_consensus.cc:2468] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 4.
I20260709 13:17:52.292191  3699 leader_election.cc:304] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c146e8c13b62470cad363220f92f0ad5, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:52.293217  3968 raft_consensus.cc:2804] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.293416  3809 raft_consensus.cc:2468] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 2.
I20260709 13:17:52.293706  3987 raft_consensus.cc:697] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 LEADER]: Becoming Leader. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:52.294643  3968 raft_consensus.cc:697] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Becoming Leader. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:52.294940  3987 consensus_queue.cc:237] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.295754  3968 consensus_queue.cc:237] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.301055  3966 raft_consensus.cc:993] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b: : Instructing follower 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:52.301734  3978 raft_consensus.cc:1081] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 4 LEADER]: Signalling peer 4ec5091d4f52461387b4ef4ddd99319f to start an election
I20260709 13:17:52.304556  3809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4"
dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:17:52.305712  3809 raft_consensus.cc:493] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.306078  3809 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:52.307449  3556 catalog_manager.cc:5697] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 reported cstate change: term changed from 1 to 2, leader changed from c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65) to c146e8c13b62470cad363220f92f0ad5 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "c146e8c13b62470cad363220f92f0ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.307515  3555 catalog_manager.cc:5697] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f reported cstate change: term changed from 3 to 4, leader changed from c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65) to 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67). New cstate: current_term: 4 leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.313395  3809 raft_consensus.cc:515] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.316895  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:52.317589  3660 raft_consensus.cc:3055] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:52.317055  3809 leader_election.cc:290] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 5 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849)
I20260709 13:17:52.317932  3660 raft_consensus.cc:740] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:52.318392  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577290c8bfab42d799970f7025e3e7a4" candidate_uuid: "4ec5091d4f52461387b4ef4ddd99319f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
I20260709 13:17:52.319000  3735 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:52.319037  3660 consensus_queue.cc:260] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.321547  3660 raft_consensus.cc:3060] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:52.330004  3735 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 5.
I20260709 13:17:52.330926  3660 raft_consensus.cc:2468] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec5091d4f52461387b4ef4ddd99319f in term 5.
I20260709 13:17:52.333976  3773 leader_election.cc:304] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c80a8051fe814f15a2647b2b387a3c0b; no voters: 
I20260709 13:17:52.335089  3987 raft_consensus.cc:2804] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:52.335775  3987 raft_consensus.cc:697] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 5 LEADER]: Becoming Leader. State: Replica: 4ec5091d4f52461387b4ef4ddd99319f, State: Running, Role: LEADER
I20260709 13:17:52.336786  3987 consensus_queue.cc:237] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.346166  3556 catalog_manager.cc:5697] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f reported cstate change: term changed from 4 to 5, leader changed from c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65) to 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67). New cstate: current_term: 5 leader_uuid: "4ec5091d4f52461387b4ef4ddd99319f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.448915  3966 raft_consensus.cc:993] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b: : Instructing follower c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:52.449340  3978 raft_consensus.cc:1081] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Signalling peer c146e8c13b62470cad363220f92f0ad5 to start an election
I20260709 13:17:52.451017  3735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f92b8f10f618407183482b7214519229"
dest_uuid: "c146e8c13b62470cad363220f92f0ad5"
 from {username='slave'} at 127.0.0.1:54626
I20260709 13:17:52.451433  3735 raft_consensus.cc:493] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.451682  3735 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.455734  3735 raft_consensus.cc:515] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.457365  3735 leader_election.cc:290] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 3 election: Requested vote from peers c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371), 4ec5091d4f52461387b4ef4ddd99319f (127.2.243.67:45781)
I20260709 13:17:52.458498  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c80a8051fe814f15a2647b2b387a3c0b"
I20260709 13:17:52.458674  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92b8f10f618407183482b7214519229" candidate_uuid: "c146e8c13b62470cad363220f92f0ad5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ec5091d4f52461387b4ef4ddd99319f"
I20260709 13:17:52.459098  3660 raft_consensus.cc:3055] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.459262  3809 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.459461  3660 raft_consensus.cc:740] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c80a8051fe814f15a2647b2b387a3c0b, State: Running, Role: LEADER
I20260709 13:17:52.460321  3660 consensus_queue.cc:260] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.461406  3660 raft_consensus.cc:3060] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.465269  3809 raft_consensus.cc:2468] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 3.
I20260709 13:17:52.466938  3660 raft_consensus.cc:2468] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c146e8c13b62470cad363220f92f0ad5 in term 3.
I20260709 13:17:52.467087  3699 leader_election.cc:304] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec5091d4f52461387b4ef4ddd99319f, c146e8c13b62470cad363220f92f0ad5; no voters: 
I20260709 13:17:52.468101  3968 raft_consensus.cc:2804] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.468631  3968 raft_consensus.cc:697] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 3 LEADER]: Becoming Leader. State: Replica: c146e8c13b62470cad363220f92f0ad5, State: Running, Role: LEADER
I20260709 13:17:52.469512  3968 consensus_queue.cc:237] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } }
I20260709 13:17:52.477710  3556 catalog_manager.cc:5697] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 reported cstate change: term changed from 2 to 3, leader changed from c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65) to c146e8c13b62470cad363220f92f0ad5 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "c146e8c13b62470cad363220f92f0ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.743659  3809 raft_consensus.cc:1275] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.744997  3968 consensus_queue.cc:1048] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.757560  3660 raft_consensus.cc:1275] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.761224  3735 raft_consensus.cc:1275] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 4 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:52.761644  3968 consensus_queue.cc:1048] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.763343  3987 consensus_queue.cc:1048] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:52.764076  3660 raft_consensus.cc:1275] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 4 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:52.765566  3987 consensus_queue.cc:1048] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:52.795827  3660 raft_consensus.cc:1275] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 5 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:52.797302  3989 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:52.810561  3735 raft_consensus.cc:1275] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 5 FOLLOWER]: Refusing update from remote peer 4ec5091d4f52461387b4ef4ddd99319f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:52.812021  4007 consensus_queue.cc:1048] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c146e8c13b62470cad363220f92f0ad5" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:52.859251  3809 raft_consensus.cc:1275] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.860670  3968 consensus_queue.cc:1048] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec5091d4f52461387b4ef4ddd99319f" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.872782  3660 raft_consensus.cc:1275] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Refusing update from remote peer c146e8c13b62470cad363220f92f0ad5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.874699  4012 consensus_queue.cc:1048] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c80a8051fe814f15a2647b2b387a3c0b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:53.190296  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:53.196961  3021 tablet_server.cc:179] TabletServer@127.2.243.65:0 shutting down...
I20260709 13:17:53.225699  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:53.228716  3021 tablet_replica.cc:333] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.229854  3021 raft_consensus.cc:2243] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.230459  3021 raft_consensus.cc:2272] T c1ecb79bb19f4e4d92b9141a6af9c04e P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.233124  3021 tablet_replica.cc:333] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.233748  3021 raft_consensus.cc:2243] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.234630  3021 raft_consensus.cc:2272] T 25264a646a2a463f80fc8766c1170545 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.236958  3021 tablet_replica.cc:333] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.237507  3021 raft_consensus.cc:2243] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.238288  3021 raft_consensus.cc:2272] T 0c859ca2a86b45569483a543c6a44c13 P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.240299  3021 tablet_replica.cc:333] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.240931  3021 raft_consensus.cc:2243] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.241794  3021 raft_consensus.cc:2272] T de9d1ec007924167bafeb12e6e4330f6 P c80a8051fe814f15a2647b2b387a3c0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.243824  3021 tablet_replica.cc:333] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.244442  3021 raft_consensus.cc:2243] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.244865  3021 raft_consensus.cc:2272] T 087ff59e81504d51810b408ab971e40e P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.247789  3021 tablet_replica.cc:333] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.248433  3021 raft_consensus.cc:2243] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.249361  3021 raft_consensus.cc:2272] T 1f1cfcba93a1409dbf5d756d92a2468c P c80a8051fe814f15a2647b2b387a3c0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.251799  3021 tablet_replica.cc:333] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.252617  3021 raft_consensus.cc:2243] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.253103  3021 raft_consensus.cc:2272] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c80a8051fe814f15a2647b2b387a3c0b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.256119  3021 tablet_replica.cc:333] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.256891  3021 raft_consensus.cc:2243] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.257858  3021 raft_consensus.cc:2272] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.260010  3773 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 13:17:53.260401  3021 tablet_replica.cc:333] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
I20260709 13:17:53.261111  3021 raft_consensus.cc:2243] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.261600  3021 raft_consensus.cc:2272] T 577290c8bfab42d799970f7025e3e7a4 P c80a8051fe814f15a2647b2b387a3c0b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.264933  3021 tablet_replica.cc:333] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b: stopping tablet replica
W20260709 13:17:53.265623  3773 consensus_peers.cc:597] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f -> Peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Couldn't send request to peer c80a8051fe814f15a2647b2b387a3c0b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.265856  3021 raft_consensus.cc:2243] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.266608  3021 raft_consensus.cc:2272] T f92b8f10f618407183482b7214519229 P c80a8051fe814f15a2647b2b387a3c0b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.292054  3021 tablet_server.cc:196] TabletServer@127.2.243.65:0 shutdown complete.
W20260709 13:17:53.304409  3773 consensus_peers.cc:597] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f -> Peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Couldn't send request to peer c80a8051fe814f15a2647b2b387a3c0b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:41371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.320709  3021 tablet_server.cc:179] TabletServer@127.2.243.66:0 shutting down...
W20260709 13:17:53.338264  3775 consensus_peers.cc:597] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f -> Peer c146e8c13b62470cad363220f92f0ad5 (127.2.243.66:45849): Couldn't send request to peer c146e8c13b62470cad363220f92f0ad5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.369539  3699 consensus_peers.cc:597] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 -> Peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Couldn't send request to peer c80a8051fe814f15a2647b2b387a3c0b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:41371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.371047  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:53.371781  3021 tablet_replica.cc:333] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.372648  3021 raft_consensus.cc:2243] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.373438  3021 raft_consensus.cc:2272] T 25264a646a2a463f80fc8766c1170545 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.377244  3021 tablet_replica.cc:333] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.377962  3021 raft_consensus.cc:2243] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.378531  3021 raft_consensus.cc:2272] T c1ecb79bb19f4e4d92b9141a6af9c04e P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.379133  3699 consensus_peers.cc:597] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 -> Peer c80a8051fe814f15a2647b2b387a3c0b (127.2.243.65:41371): Couldn't send request to peer c80a8051fe814f15a2647b2b387a3c0b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:41371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.380841  3021 tablet_replica.cc:333] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.381505  3021 raft_consensus.cc:2243] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.382339  3021 raft_consensus.cc:2272] T 1f1cfcba93a1409dbf5d756d92a2468c P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.385165  3021 tablet_replica.cc:333] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.385857  3021 raft_consensus.cc:2243] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.386778  3021 raft_consensus.cc:2272] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P c146e8c13b62470cad363220f92f0ad5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.389534  3021 tablet_replica.cc:333] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.390144  3021 raft_consensus.cc:2243] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.390578  3021 raft_consensus.cc:2272] T a0cc8e22ec1848f3b2b64a04b3ec5673 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.393047  3021 tablet_replica.cc:333] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.393800  3021 raft_consensus.cc:2243] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.394532  3021 raft_consensus.cc:2272] T 577290c8bfab42d799970f7025e3e7a4 P c146e8c13b62470cad363220f92f0ad5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.397780  3021 tablet_replica.cc:333] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.398545  3021 raft_consensus.cc:2243] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.399536  3021 raft_consensus.cc:2272] T f92b8f10f618407183482b7214519229 P c146e8c13b62470cad363220f92f0ad5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.402182  3021 tablet_replica.cc:333] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.403102  3021 raft_consensus.cc:2243] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.403723  3021 raft_consensus.cc:2272] T 0c859ca2a86b45569483a543c6a44c13 P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.405781  3021 tablet_replica.cc:333] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.406287  3021 raft_consensus.cc:2243] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.406903  3021 raft_consensus.cc:2272] T de9d1ec007924167bafeb12e6e4330f6 P c146e8c13b62470cad363220f92f0ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.409381  3021 tablet_replica.cc:333] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5: stopping tablet replica
I20260709 13:17:53.409904  3021 raft_consensus.cc:2243] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.410778  3021 raft_consensus.cc:2272] T 087ff59e81504d51810b408ab971e40e P c146e8c13b62470cad363220f92f0ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.444060  3021 tablet_server.cc:196] TabletServer@127.2.243.66:0 shutdown complete.
I20260709 13:17:53.468210  3021 tablet_server.cc:179] TabletServer@127.2.243.67:0 shutting down...
I20260709 13:17:53.499791  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:53.500590  3021 tablet_replica.cc:333] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.501302  3021 raft_consensus.cc:2243] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.501834  3021 raft_consensus.cc:2272] T 087ff59e81504d51810b408ab971e40e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.504558  3021 tablet_replica.cc:333] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.505151  3021 raft_consensus.cc:2243] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.505635  3021 raft_consensus.cc:2272] T de9d1ec007924167bafeb12e6e4330f6 P 4ec5091d4f52461387b4ef4ddd99319f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.508008  3021 tablet_replica.cc:333] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.508745  3021 raft_consensus.cc:2243] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.509227  3021 raft_consensus.cc:2272] T 0c859ca2a86b45569483a543c6a44c13 P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.511137  3021 tablet_replica.cc:333] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.511706  3021 raft_consensus.cc:2243] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.513146  3021 raft_consensus.cc:2272] T c1ecb79bb19f4e4d92b9141a6af9c04e P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.515090  3021 tablet_replica.cc:333] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.515580  3021 raft_consensus.cc:2243] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.515969  3021 raft_consensus.cc:2272] T 25264a646a2a463f80fc8766c1170545 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.518743  3021 tablet_replica.cc:333] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.519544  3021 raft_consensus.cc:2243] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.520032  3021 raft_consensus.cc:2272] T f92b8f10f618407183482b7214519229 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.523085  3021 tablet_replica.cc:333] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.523752  3021 raft_consensus.cc:2243] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.524442  3021 raft_consensus.cc:2272] T 1f1cfcba93a1409dbf5d756d92a2468c P 4ec5091d4f52461387b4ef4ddd99319f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.526469  3021 tablet_replica.cc:333] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.527048  3021 raft_consensus.cc:2243] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.527885  3021 raft_consensus.cc:2272] T 2f3aca580de9422ebe80bc6ac5c9e6f3 P 4ec5091d4f52461387b4ef4ddd99319f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.530449  3021 tablet_replica.cc:333] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.531327  3021 raft_consensus.cc:2243] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.532016  3021 raft_consensus.cc:2272] T a0cc8e22ec1848f3b2b64a04b3ec5673 P 4ec5091d4f52461387b4ef4ddd99319f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.534116  3021 tablet_replica.cc:333] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f: stopping tablet replica
I20260709 13:17:53.534646  3021 raft_consensus.cc:2243] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.535532  3021 raft_consensus.cc:2272] T 577290c8bfab42d799970f7025e3e7a4 P 4ec5091d4f52461387b4ef4ddd99319f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.567247  3021 tablet_server.cc:196] TabletServer@127.2.243.67:0 shutdown complete.
I20260709 13:17:53.588807  3021 master.cc:562] Master@127.2.243.126:43519 shutting down...
I20260709 13:17:53.613852  3021 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.614537  3021 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.614907  3021 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5c160320e38545df870eff5c2be5e425: stopping tablet replica
I20260709 13:17:53.637200  3021 master.cc:584] Master@127.2.243.126:43519 shutdown complete.
4ec5091d4f52461387b4ef4ddd99319f  1
c146e8c13b62470cad363220f92f0ad5  4
c80a8051fe814f15a2647b2b387a3c0b  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11011 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:17:53.686268  3021 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.243.126:38007
I20260709 13:17:53.687609  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:53.694868  4020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:53.695116  4021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:53.696029  4023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:53.697827  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:53.698745  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:53.698942  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:53.699062  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603073699051 us; error 0 us; skew 500 ppm
I20260709 13:17:53.699546  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:53.703009  3021 webserver.cc:533] Webserver started at http://127.2.243.126:34241/ using document root <none> and password file <none>
I20260709 13:17:53.703552  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:53.703725  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:53.703969  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:53.705533  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/master-0-root/instance:
uuid: "bc702ba481ed4ff7b99697ca2b44c086"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-ftjc"
I20260709 13:17:53.711638  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:17:53.716181  4028 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.717219  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:53.717694  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/master-0-root
uuid: "bc702ba481ed4ff7b99697ca2b44c086"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-ftjc"
I20260709 13:17:53.718086  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:53.740306  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:53.741958  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:53.793035  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.126:38007
I20260709 13:17:53.793126  4079 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.126:38007 every 8 connection(s)
I20260709 13:17:53.797848  4080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.811105  4080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Bootstrap starting.
I20260709 13:17:53.817531  4080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:53.823257  4080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: No bootstrap required, opened a new log
I20260709 13:17:53.825918  4080 raft_consensus.cc:359] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc702ba481ed4ff7b99697ca2b44c086" member_type: VOTER }
I20260709 13:17:53.826370  4080 raft_consensus.cc:385] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:53.826659  4080 raft_consensus.cc:740] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc702ba481ed4ff7b99697ca2b44c086, State: Initialized, Role: FOLLOWER
I20260709 13:17:53.827322  4080 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc702ba481ed4ff7b99697ca2b44c086" member_type: VOTER }
I20260709 13:17:53.827832  4080 raft_consensus.cc:399] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:53.828078  4080 raft_consensus.cc:493] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:53.828413  4080 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:53.835175  4080 raft_consensus.cc:515] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc702ba481ed4ff7b99697ca2b44c086" member_type: VOTER }
I20260709 13:17:53.836144  4080 leader_election.cc:304] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc702ba481ed4ff7b99697ca2b44c086; no voters: 
I20260709 13:17:53.837754  4080 leader_election.cc:290] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:53.838457  4083 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:53.840103  4083 raft_consensus.cc:697] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 1 LEADER]: Becoming Leader. State: Replica: bc702ba481ed4ff7b99697ca2b44c086, State: Running, Role: LEADER
I20260709 13:17:53.840965  4083 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc702ba481ed4ff7b99697ca2b44c086" member_type: VOTER }
I20260709 13:17:53.841351  4080 sys_catalog.cc:565] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:53.847581  4085 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc702ba481ed4ff7b99697ca2b44c086. Latest consensus state: current_term: 1 leader_uuid: "bc702ba481ed4ff7b99697ca2b44c086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc702ba481ed4ff7b99697ca2b44c086" member_type: VOTER } }
I20260709 13:17:53.847944  4084 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc702ba481ed4ff7b99697ca2b44c086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc702ba481ed4ff7b99697ca2b44c086" member_type: VOTER } }
I20260709 13:17:53.848757  4085 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:53.848899  4084 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:53.853192  4090 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:53.863328  4090 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:53.864986  3021 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:53.874307  4090 catalog_manager.cc:1383] Generated new cluster ID: 28785215bfd74239ada879ad9093d43b
I20260709 13:17:53.874707  4090 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:53.926252  4090 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:53.928006  4090 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:53.943169  4090 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Generated new TSK 0
I20260709 13:17:53.944041  4090 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:53.997265  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:54.004675  4101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.007256  4102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.009596  4104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.014072  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:54.015018  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:54.015214  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:54.015338  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603074015327 us; error 0 us; skew 500 ppm
I20260709 13:17:54.015848  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:54.018716  3021 webserver.cc:533] Webserver started at http://127.2.243.65:42745/ using document root <none> and password file <none>
I20260709 13:17:54.019212  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:54.019402  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:54.019650  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:54.021111  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/instance:
uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-ftjc"
I20260709 13:17:54.027196  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:54.031316  4109 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.032244  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:17:54.032824  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-ftjc"
I20260709 13:17:54.033286  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:54.058441  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:54.060096  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:54.062049  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:54.065038  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:54.065302  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.065611  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:54.065840  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.120996  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:36237
I20260709 13:17:54.121127  4171 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:36237 every 8 connection(s)
I20260709 13:17:54.126799  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:54.136256  4176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.138334  4177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.140568  4179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.141512  3021 server_base.cc:1061] running on GCE node
I20260709 13:17:54.142791  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:54.143079  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:54.143381  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603074143310 us; error 0 us; skew 500 ppm
I20260709 13:17:54.144039  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:54.147143  3021 webserver.cc:533] Webserver started at http://127.2.243.66:39331/ using document root <none> and password file <none>
I20260709 13:17:54.147746  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:54.147962  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:54.148293  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:54.149793  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/instance:
uuid: "34e6205f3c1d434193126fef20d73800"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-ftjc"
I20260709 13:17:54.153775  4172 heartbeater.cc:344] Connected to a master server at 127.2.243.126:38007
I20260709 13:17:54.154245  4172 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:54.155082  4172 heartbeater.cc:507] Master 127.2.243.126:38007 requested a full tablet report, sending...
I20260709 13:17:54.157142  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:17:54.157748  4045 ts_manager.cc:194] Registered new tserver with Master: 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:17:54.159791  4045 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42412
I20260709 13:17:54.162130  4184 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.163403  3021 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:54.163759  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root
uuid: "34e6205f3c1d434193126fef20d73800"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-ftjc"
I20260709 13:17:54.164106  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:54.188797  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:54.190259  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:54.191987  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:54.194604  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:54.194880  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.195155  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:54.195348  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.247587  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.66:45005
I20260709 13:17:54.247805  4246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.66:45005 every 8 connection(s)
I20260709 13:17:54.253218  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:54.261983  4250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.264586  4251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.267928  3021 server_base.cc:1061] running on GCE node
W20260709 13:17:54.268788  4253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.269794  4247 heartbeater.cc:344] Connected to a master server at 127.2.243.126:38007
I20260709 13:17:54.269922  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:54.270421  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:54.270481  4247 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:54.270622  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603074270584 us; error 0 us; skew 500 ppm
I20260709 13:17:54.271347  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:54.271550  4247 heartbeater.cc:507] Master 127.2.243.126:38007 requested a full tablet report, sending...
I20260709 13:17:54.274365  3021 webserver.cc:533] Webserver started at http://127.2.243.67:38721/ using document root <none> and password file <none>
I20260709 13:17:54.274518  4045 ts_manager.cc:194] Registered new tserver with Master: 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:54.275018  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:54.275266  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:54.275552  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:54.276223  4045 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42420
I20260709 13:17:54.277228  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/instance:
uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-ftjc"
I20260709 13:17:54.283298  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:17:54.287161  4258 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.288152  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:17:54.288544  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root
uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-ftjc"
I20260709 13:17:54.288895  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:54.305310  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:54.306730  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:54.308476  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:54.311101  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:54.311362  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.311645  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:54.311841  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.365351  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.67:40585
I20260709 13:17:54.365561  4320 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.67:40585 every 8 connection(s)
I20260709 13:17:54.382431  4321 heartbeater.cc:344] Connected to a master server at 127.2.243.126:38007
I20260709 13:17:54.382925  4321 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:54.383805  4321 heartbeater.cc:507] Master 127.2.243.126:38007 requested a full tablet report, sending...
I20260709 13:17:54.386224  4045 ts_manager.cc:194] Registered new tserver with Master: 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:54.387295  3021 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017949234s
I20260709 13:17:54.387826  4045 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42424
I20260709 13:17:54.420806  4045 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42434:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:54.428022  4045 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:54.683336  4212 tablet_service.cc:1511] Processing CreateTablet for tablet 38e2ffb00e35435085552a2adb73fcc2 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:54.685981  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e2ffb00e35435085552a2adb73fcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.698194  4211 tablet_service.cc:1511] Processing CreateTablet for tablet 033774cd1e264e69977f9f6f2e5a42e8 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:54.705523  4211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033774cd1e264e69977f9f6f2e5a42e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.707199  4208 tablet_service.cc:1511] Processing CreateTablet for tablet ee822f7cf89d49cb90b5fa2997ef4f4f (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:54.707482  4285 tablet_service.cc:1511] Processing CreateTablet for tablet 033774cd1e264e69977f9f6f2e5a42e8 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:54.709057  4285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033774cd1e264e69977f9f6f2e5a42e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.711323  4209 tablet_service.cc:1511] Processing CreateTablet for tablet eff857a690104e20896367b8755773e0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:54.705515  4286 tablet_service.cc:1511] Processing CreateTablet for tablet 38e2ffb00e35435085552a2adb73fcc2 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:54.717983  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee822f7cf89d49cb90b5fa2997ef4f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.718240  4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e2ffb00e35435085552a2adb73fcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.701288  4210 tablet_service.cc:1511] Processing CreateTablet for tablet f61c18f5030a4980bd0f16ae2690b843 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:54.718954  4137 tablet_service.cc:1511] Processing CreateTablet for tablet 38e2ffb00e35435085552a2adb73fcc2 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:54.720520  4137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e2ffb00e35435085552a2adb73fcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.703809  4207 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd7c9d3d77844388d8c5138c924c640 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:54.722846  4210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61c18f5030a4980bd0f16ae2690b843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.725055  4207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd7c9d3d77844388d8c5138c924c640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.726218  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 11a1f1fbec3b44838ed91074017003db (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:54.727900  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a1f1fbec3b44838ed91074017003db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.729053  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff857a690104e20896367b8755773e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.729372  4136 tablet_service.cc:1511] Processing CreateTablet for tablet 033774cd1e264e69977f9f6f2e5a42e8 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:54.731231  4205 tablet_service.cc:1511] Processing CreateTablet for tablet 5985d95b5ba74bed90f719c554bee460 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:54.732923  4205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5985d95b5ba74bed90f719c554bee460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.734766  4203 tablet_service.cc:1511] Processing CreateTablet for tablet bf26f731cd1d411a93da2187b3452b52 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:54.734639  4135 tablet_service.cc:1511] Processing CreateTablet for tablet f61c18f5030a4980bd0f16ae2690b843 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:54.736308  4204 tablet_service.cc:1511] Processing CreateTablet for tablet 42018491ecaa43a29d99307d7ccd824b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:54.737114  4203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf26f731cd1d411a93da2187b3452b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.737923  4204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42018491ecaa43a29d99307d7ccd824b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.739964  4131 tablet_service.cc:1511] Processing CreateTablet for tablet 11a1f1fbec3b44838ed91074017003db (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:54.742624  4134 tablet_service.cc:1511] Processing CreateTablet for tablet eff857a690104e20896367b8755773e0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:54.743139  4129 tablet_service.cc:1511] Processing CreateTablet for tablet 42018491ecaa43a29d99307d7ccd824b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:54.745447  4133 tablet_service.cc:1511] Processing CreateTablet for tablet ee822f7cf89d49cb90b5fa2997ef4f4f (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:54.746559  4128 tablet_service.cc:1511] Processing CreateTablet for tablet bf26f731cd1d411a93da2187b3452b52 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:54.748189  4132 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd7c9d3d77844388d8c5138c924c640 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:54.750976  4130 tablet_service.cc:1511] Processing CreateTablet for tablet 5985d95b5ba74bed90f719c554bee460 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:54.754948  4284 tablet_service.cc:1511] Processing CreateTablet for tablet f61c18f5030a4980bd0f16ae2690b843 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:54.756914  4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61c18f5030a4980bd0f16ae2690b843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.731231  4136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033774cd1e264e69977f9f6f2e5a42e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.760758  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61c18f5030a4980bd0f16ae2690b843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.761768  4128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf26f731cd1d411a93da2187b3452b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.762982  4129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42018491ecaa43a29d99307d7ccd824b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.765223  4131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a1f1fbec3b44838ed91074017003db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.765976  4133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee822f7cf89d49cb90b5fa2997ef4f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.772914  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff857a690104e20896367b8755773e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.775187  4283 tablet_service.cc:1511] Processing CreateTablet for tablet eff857a690104e20896367b8755773e0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:54.776865  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd7c9d3d77844388d8c5138c924c640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.779584  4282 tablet_service.cc:1511] Processing CreateTablet for tablet ee822f7cf89d49cb90b5fa2997ef4f4f (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:54.780827  4130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5985d95b5ba74bed90f719c554bee460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.783399  4281 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd7c9d3d77844388d8c5138c924c640 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:54.776952  4283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff857a690104e20896367b8755773e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.792328  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee822f7cf89d49cb90b5fa2997ef4f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.793359  4280 tablet_service.cc:1511] Processing CreateTablet for tablet 11a1f1fbec3b44838ed91074017003db (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:54.795130  4280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a1f1fbec3b44838ed91074017003db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.804207  4278 tablet_service.cc:1511] Processing CreateTablet for tablet 42018491ecaa43a29d99307d7ccd824b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:54.805876  4279 tablet_service.cc:1511] Processing CreateTablet for tablet 5985d95b5ba74bed90f719c554bee460 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:54.805909  4278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42018491ecaa43a29d99307d7ccd824b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.817013  4279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5985d95b5ba74bed90f719c554bee460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.820802  4281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd7c9d3d77844388d8c5138c924c640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.825419  4277 tablet_service.cc:1511] Processing CreateTablet for tablet bf26f731cd1d411a93da2187b3452b52 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:54.827270  4277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf26f731cd1d411a93da2187b3452b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.851043  4204 tablet_service.cc:1511] Processing CreateTablet for tablet fee6dae3af1842289de63342b7a950f9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:54.865777  4339 tablet_bootstrap.cc:492] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:54.881213  4136 tablet_service.cc:1511] Processing CreateTablet for tablet 7abf29f1bff94e6397d4a2561e35ef1b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:54.888801  4136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abf29f1bff94e6397d4a2561e35ef1b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:54.904470  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:54.927237  4204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee6dae3af1842289de63342b7a950f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.941383  4137 tablet_service.cc:1511] Processing CreateTablet for tablet fee6dae3af1842289de63342b7a950f9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:54.941628  4131 tablet_service.cc:1511] Processing CreateTablet for tablet 6091d765c73842c992d8c60523872ccc (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:54.943008  4137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee6dae3af1842289de63342b7a950f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.956861  4131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6091d765c73842c992d8c60523872ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.966022  4282 tablet_service.cc:1511] Processing CreateTablet for tablet 7abf29f1bff94e6397d4a2561e35ef1b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:54.967708  4340 tablet_bootstrap.cc:492] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:54.967782  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abf29f1bff94e6397d4a2561e35ef1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.983688  4339 tablet_bootstrap.cc:654] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.989426  4211 tablet_service.cc:1511] Processing CreateTablet for tablet 7abf29f1bff94e6397d4a2561e35ef1b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:54.996533  4211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abf29f1bff94e6397d4a2561e35ef1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.997516  4286 tablet_service.cc:1511] Processing CreateTablet for tablet fee6dae3af1842289de63342b7a950f9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:54.999054  4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee6dae3af1842289de63342b7a950f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.999541  4208 tablet_service.cc:1511] Processing CreateTablet for tablet 70df96ad70f0416db400b7395b0d7b9e (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:55.001030  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 4661232a8b934fa0b9135bf4650bfd02 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:55.003008  4284 tablet_service.cc:1511] Processing CreateTablet for tablet 6091d765c73842c992d8c60523872ccc (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:55.001585  4340 tablet_bootstrap.cc:654] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.003713  4207 tablet_service.cc:1511] Processing CreateTablet for tablet 151524a8517e4b8ebc7308777c98105e (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:55.010775  4210 tablet_service.cc:1511] Processing CreateTablet for tablet e6478d83fa954184a297fb7466378df1 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:55.004496  4205 tablet_service.cc:1511] Processing CreateTablet for tablet 6091d765c73842c992d8c60523872ccc (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:55.014251  4341 tablet_bootstrap.cc:492] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:55.006670  4134 tablet_service.cc:1511] Processing CreateTablet for tablet 3e71d21bb0584872aaf6dcba10ac49fc (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:55.017272  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e71d21bb0584872aaf6dcba10ac49fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.006671  4128 tablet_service.cc:1511] Processing CreateTablet for tablet 4661232a8b934fa0b9135bf4650bfd02 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:55.020890  4128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4661232a8b934fa0b9135bf4650bfd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.009711  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70df96ad70f0416db400b7395b0d7b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.017252  4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6091d765c73842c992d8c60523872ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.007237  4133 tablet_service.cc:1511] Processing CreateTablet for tablet 70df96ad70f0416db400b7395b0d7b9e (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:54.989785  4281 tablet_service.cc:1511] Processing CreateTablet for tablet 70df96ad70f0416db400b7395b0d7b9e (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:55.031726  4133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70df96ad70f0416db400b7395b0d7b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.027278  4207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151524a8517e4b8ebc7308777c98105e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.031950  4281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70df96ad70f0416db400b7395b0d7b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.036549  4209 tablet_service.cc:1511] Processing CreateTablet for tablet 0334f31959bc48878664996813e359b4 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:54.999859  4212 tablet_service.cc:1511] Processing CreateTablet for tablet 3e71d21bb0584872aaf6dcba10ac49fc (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:55.047353  4205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6091d765c73842c992d8c60523872ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.050422  4210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6478d83fa954184a297fb7466378df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.053012  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4661232a8b934fa0b9135bf4650bfd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.065908  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0334f31959bc48878664996813e359b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.066697  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e71d21bb0584872aaf6dcba10ac49fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:55.068804  4030 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 68066.5us
I20260709 13:17:55.073254  4135 tablet_service.cc:1511] Processing CreateTablet for tablet 0334f31959bc48878664996813e359b4 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:55.074232  4277 tablet_service.cc:1511] Processing CreateTablet for tablet 1270a058111c4161ba865afa3630bfb7 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:55.075176  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0334f31959bc48878664996813e359b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.075860  4277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1270a058111c4161ba865afa3630bfb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.055369  4136 tablet_service.cc:1511] Processing CreateTablet for tablet e6478d83fa954184a297fb7466378df1 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:55.085970  4136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6478d83fa954184a297fb7466378df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.088937  4283 tablet_service.cc:1511] Processing CreateTablet for tablet 151524a8517e4b8ebc7308777c98105e (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:55.090481  4283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151524a8517e4b8ebc7308777c98105e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.043509  4130 tablet_service.cc:1511] Processing CreateTablet for tablet 151524a8517e4b8ebc7308777c98105e (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:55.098860  4340 tablet_bootstrap.cc:492] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:55.110458  4340 ts_tablet_manager.cc:1403] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.010s
I20260709 13:17:55.110773  4285 tablet_service.cc:1511] Processing CreateTablet for tablet 3e71d21bb0584872aaf6dcba10ac49fc (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:55.113524  4203 tablet_service.cc:1511] Processing CreateTablet for tablet 1270a058111c4161ba865afa3630bfb7 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:55.114156  4340 raft_consensus.cc:359] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.115023  4340 raft_consensus.cc:385] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.115168  4203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1270a058111c4161ba865afa3630bfb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.115394  4340 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.123456  4204 tablet_service.cc:1511] Processing CreateTablet for tablet 27a95e60f9ae4eea85c4a330ff8078c7 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 13:17:55.073318  4031 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 68456.2us
I20260709 13:17:55.128016  4278 tablet_service.cc:1511] Processing CreateTablet for tablet 0334f31959bc48878664996813e359b4 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:55.129953  4278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0334f31959bc48878664996813e359b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.126739  4341 tablet_bootstrap.cc:654] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.137275  4340 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.156934  4130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151524a8517e4b8ebc7308777c98105e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.163177  4172 heartbeater.cc:499] Master 127.2.243.126:38007 was elected leader, sending a full tablet report...
I20260709 13:17:55.145609  4204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a95e60f9ae4eea85c4a330ff8078c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.147071  4285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e71d21bb0584872aaf6dcba10ac49fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.181391  4339 tablet_bootstrap.cc:492] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:55.199092  4339 ts_tablet_manager.cc:1403] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.334s	user 0.021s	sys 0.027s
I20260709 13:17:55.216421  4280 tablet_service.cc:1511] Processing CreateTablet for tablet e6478d83fa954184a297fb7466378df1 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:55.218469  4280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6478d83fa954184a297fb7466378df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.226181  4132 tablet_service.cc:1511] Processing CreateTablet for tablet 1270a058111c4161ba865afa3630bfb7 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:55.227854  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1270a058111c4161ba865afa3630bfb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.229866  4137 tablet_service.cc:1511] Processing CreateTablet for tablet 27a95e60f9ae4eea85c4a330ff8078c7 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:55.230122  4136 tablet_service.cc:1511] Processing CreateTablet for tablet 584cfa5b7a8849d1bb573f5304d7cce9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:55.231562  4137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a95e60f9ae4eea85c4a330ff8078c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.233654  4136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584cfa5b7a8849d1bb573f5304d7cce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.233974  4134 tablet_service.cc:1511] Processing CreateTablet for tablet 10d1753ccc1e4c2d98ff3195cd6bb590 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:55.235522  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d1753ccc1e4c2d98ff3195cd6bb590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.239166  4286 tablet_service.cc:1511] Processing CreateTablet for tablet 27a95e60f9ae4eea85c4a330ff8078c7 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:55.239455  4205 tablet_service.cc:1511] Processing CreateTablet for tablet 584cfa5b7a8849d1bb573f5304d7cce9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:55.254354  4205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584cfa5b7a8849d1bb573f5304d7cce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.216050  4339 raft_consensus.cc:359] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.249884  4281 tablet_service.cc:1511] Processing CreateTablet for tablet 584cfa5b7a8849d1bb573f5304d7cce9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:55.257052  4339 raft_consensus.cc:385] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.257493  4339 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.258669  4281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584cfa5b7a8849d1bb573f5304d7cce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.244135  4208 tablet_service.cc:1511] Processing CreateTablet for tablet ab416835542d4f11852821a8161b8f7b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:55.265491  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab416835542d4f11852821a8161b8f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.271967  4282 tablet_service.cc:1511] Processing CreateTablet for tablet ab416835542d4f11852821a8161b8f7b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:55.273671  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab416835542d4f11852821a8161b8f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.250066  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 7522b19b153a491c9d822b8ffb2becc5 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:55.239459  4211 tablet_service.cc:1511] Processing CreateTablet for tablet 10d1753ccc1e4c2d98ff3195cd6bb590 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:55.275461  4211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d1753ccc1e4c2d98ff3195cd6bb590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.280022  4247 heartbeater.cc:499] Master 127.2.243.126:38007 was elected leader, sending a full tablet report...
I20260709 13:17:55.285719  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7522b19b153a491c9d822b8ffb2becc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.263393  4278 tablet_service.cc:1511] Processing CreateTablet for tablet 10d1753ccc1e4c2d98ff3195cd6bb590 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:55.252444  4209 tablet_service.cc:1511] Processing CreateTablet for tablet 527025007d0641e3a50bfc3a9d2e5b80 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:55.292371  4278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d1753ccc1e4c2d98ff3195cd6bb590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.292732  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 527025007d0641e3a50bfc3a9d2e5b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.258518  4339 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.289566  4203 tablet_service.cc:1511] Processing CreateTablet for tablet a767a88581024d12b14e9f965193d404 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:55.309307  4203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a767a88581024d12b14e9f965193d404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.260453  4279 tablet_service.cc:1511] Processing CreateTablet for tablet 4661232a8b934fa0b9135bf4650bfd02 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:55.339691  4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a95e60f9ae4eea85c4a330ff8078c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.251958  4129 tablet_service.cc:1511] Processing CreateTablet for tablet ab416835542d4f11852821a8161b8f7b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:55.357348  4279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4661232a8b934fa0b9135bf4650bfd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.385236  4134 tablet_service.cc:1511] Processing CreateTablet for tablet 7522b19b153a491c9d822b8ffb2becc5 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:55.387209  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7522b19b153a491c9d822b8ffb2becc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.367375  4341 tablet_bootstrap.cc:492] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:55.357496  4136 tablet_service.cc:1511] Processing CreateTablet for tablet a767a88581024d12b14e9f965193d404 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:55.391129  4321 heartbeater.cc:499] Master 127.2.243.126:38007 was elected leader, sending a full tablet report...
I20260709 13:17:55.395879  4281 tablet_service.cc:1511] Processing CreateTablet for tablet 7522b19b153a491c9d822b8ffb2becc5 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:55.397704  4281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7522b19b153a491c9d822b8ffb2becc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.404980  4339 ts_tablet_manager.cc:1434] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.192s	user 0.008s	sys 0.014s
I20260709 13:17:55.405668  4132 tablet_service.cc:1511] Processing CreateTablet for tablet 527025007d0641e3a50bfc3a9d2e5b80 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:55.358675  4340 ts_tablet_manager.cc:1434] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.248s	user 0.012s	sys 0.024s
I20260709 13:17:55.410131  4340 tablet_bootstrap.cc:492] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:55.411702  4284 tablet_service.cc:1511] Processing CreateTablet for tablet a767a88581024d12b14e9f965193d404 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:55.413087  4129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab416835542d4f11852821a8161b8f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.413203  4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a767a88581024d12b14e9f965193d404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.420629  4341 ts_tablet_manager.cc:1403] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.407s	user 0.034s	sys 0.012s
W20260709 13:17:55.340469  4030 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 133617us
I20260709 13:17:55.423722  4128 tablet_service.cc:1511] Processing CreateTablet for tablet 729a3ec3cbd04254ac398836ae71b77d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:55.425158  4136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a767a88581024d12b14e9f965193d404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.427713  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 527025007d0641e3a50bfc3a9d2e5b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.427933  4280 tablet_service.cc:1511] Processing CreateTablet for tablet 527025007d0641e3a50bfc3a9d2e5b80 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:55.436040  4339 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:55.437001  4128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729a3ec3cbd04254ac398836ae71b77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.444907  4208 tablet_service.cc:1511] Processing CreateTablet for tablet 729a3ec3cbd04254ac398836ae71b77d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:55.445463  4340 tablet_bootstrap.cc:654] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.446457  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729a3ec3cbd04254ac398836ae71b77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.456120  4341 raft_consensus.cc:359] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.457283  4341 raft_consensus.cc:385] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.457700  4341 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.458912  4341 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.496631  4280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 527025007d0641e3a50bfc3a9d2e5b80. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:55.501458  4031 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47230.5us
I20260709 13:17:55.518764  4340 tablet_bootstrap.cc:492] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:55.519428  4340 ts_tablet_manager.cc:1403] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.006s
I20260709 13:17:55.522058  4282 tablet_service.cc:1511] Processing CreateTablet for tablet ad5c2c5dc1b340968b54f2a9a970cfce (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:55.523981  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5c2c5dc1b340968b54f2a9a970cfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.525540  4339 tablet_bootstrap.cc:654] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.528645  4344 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.529238  4344 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.522146  4341 ts_tablet_manager.cc:1434] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.000s
I20260709 13:17:55.533890  4341 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:55.541523  4344 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:55.548372  4135 tablet_service.cc:1511] Processing CreateTablet for tablet 09ba8b2d18b04025b73da88c20e6dbe0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:55.550171  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ba8b2d18b04025b73da88c20e6dbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.552237  4132 tablet_service.cc:1511] Processing CreateTablet for tablet ad5c2c5dc1b340968b54f2a9a970cfce (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:55.554208  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5c2c5dc1b340968b54f2a9a970cfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.561820  4279 tablet_service.cc:1511] Processing CreateTablet for tablet 729a3ec3cbd04254ac398836ae71b77d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:55.563442  4279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729a3ec3cbd04254ac398836ae71b77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.563530  4339 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:55.564198  4339 ts_tablet_manager.cc:1403] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.007s
I20260709 13:17:55.570416  4348 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.571190  4348 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.580143  4348 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:17:55.584693  4340 raft_consensus.cc:359] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.589174  4340 raft_consensus.cc:385] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.589699  4340 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.567823  4339 raft_consensus.cc:359] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.590384  4339 raft_consensus.cc:385] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.590617  4340 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.594362  4340 ts_tablet_manager.cc:1434] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:17:55.595654  4340 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:55.601511  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 09ba8b2d18b04025b73da88c20e6dbe0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:55.603183  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ba8b2d18b04025b73da88c20e6dbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.599859  4209 tablet_service.cc:1511] Processing CreateTablet for tablet ad5c2c5dc1b340968b54f2a9a970cfce (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:55.590773  4339 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.610513  4278 tablet_service.cc:1511] Processing CreateTablet for tablet 09ba8b2d18b04025b73da88c20e6dbe0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:55.612119  4278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ba8b2d18b04025b73da88c20e6dbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.610517  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5c2c5dc1b340968b54f2a9a970cfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.630373  4341 tablet_bootstrap.cc:654] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.636749  4132 tablet_service.cc:1511] Processing CreateTablet for tablet ccbf9cc060a440feab4ab0c62d18794f (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:55.638536  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbf9cc060a440feab4ab0c62d18794f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.611501  4339 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.603185  4340 tablet_bootstrap.cc:654] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.666097  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:55.669480  4186 leader_election.cc:343] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.693125  4203 tablet_service.cc:1511] Processing CreateTablet for tablet ccbf9cc060a440feab4ab0c62d18794f (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:55.694767  4203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbf9cc060a440feab4ab0c62d18794f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.703091  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:17:55.707801  4187 leader_election.cc:343] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.708407  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:55.710276  4344 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:55.711542  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:55.719007  4286 tablet_service.cc:1511] Processing CreateTablet for tablet ccbf9cc060a440feab4ab0c62d18794f (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:55.720973  4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbf9cc060a440feab4ab0c62d18794f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.722860  4339 ts_tablet_manager.cc:1434] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.158s	user 0.009s	sys 0.000s
I20260709 13:17:55.723485  4346 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.724447  4339 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:55.724035  4346 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:17:55.730055  4261 leader_election.cc:343] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.732688  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:55.733557  4147 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:55.735589  4340 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:55.736546  4340 ts_tablet_manager.cc:1403] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.005s
I20260709 13:17:55.736660  4346 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:55.722939  4341 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:55.742565  4341 ts_tablet_manager.cc:1403] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.209s	user 0.029s	sys 0.005s
I20260709 13:17:55.740528  4134 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7cd0a583da4bb18010d5a62595ea88 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:55.744534  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7cd0a583da4bb18010d5a62595ea88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.748814  4341 raft_consensus.cc:359] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.749742  4341 raft_consensus.cc:385] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.750072  4341 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.750830  4340 raft_consensus.cc:359] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.751727  4340 raft_consensus.cc:385] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.752094  4340 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.751323  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7cd0a583da4bb18010d5a62595ea88 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:55.753788  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7cd0a583da4bb18010d5a62595ea88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.754420  4282 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7cd0a583da4bb18010d5a62595ea88 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:55.756313  4340 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.758879  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7cd0a583da4bb18010d5a62595ea88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.765141  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:17:55.767418  4208 tablet_service.cc:1511] Processing CreateTablet for tablet c130eddd78204cee994818f0043bf88c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:55.766760  4129 tablet_service.cc:1511] Processing CreateTablet for tablet c130eddd78204cee994818f0043bf88c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:55.769140  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c130eddd78204cee994818f0043bf88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.793473  4129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c130eddd78204cee994818f0043bf88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.778489  4348 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.790338  4278 tablet_service.cc:1511] Processing CreateTablet for tablet c130eddd78204cee994818f0043bf88c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:55.776798  4340 ts_tablet_manager.cc:1434] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:17:55.794252  4348 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.794760  4348 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.795111  4278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c130eddd78204cee994818f0043bf88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.805403  4340 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:55.808632  4341 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.838138  4339 tablet_bootstrap.cc:654] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.870363  4340 tablet_bootstrap.cc:654] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.880050  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:55.887423  4135 tablet_service.cc:1511] Processing CreateTablet for tablet f1a8ad10a3aa47109171ff50298ccf9b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:55.889559  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a8ad10a3aa47109171ff50298ccf9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:55.892685  4112 leader_election.cc:343] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.902818  4362 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.907737  4341 ts_tablet_manager.cc:1434] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.165s	user 0.029s	sys 0.023s
W20260709 13:17:55.908710  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:55.909317  4341 tablet_bootstrap.cc:492] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:55.916320  4203 tablet_service.cc:1511] Processing CreateTablet for tablet f1a8ad10a3aa47109171ff50298ccf9b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:55.919524  4203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a8ad10a3aa47109171ff50298ccf9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.923945  4286 tablet_service.cc:1511] Processing CreateTablet for tablet f1a8ad10a3aa47109171ff50298ccf9b (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:55.924906  4134 tablet_service.cc:1511] Processing CreateTablet for tablet 434e24168b204a82b4cafcc2cba44c46 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:55.925973  4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a8ad10a3aa47109171ff50298ccf9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.926321  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 434e24168b204a82b4cafcc2cba44c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.903589  4362 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.937101  4209 tablet_service.cc:1511] Processing CreateTablet for tablet 434e24168b204a82b4cafcc2cba44c46 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:55.939225  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 434e24168b204a82b4cafcc2cba44c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.960280  4132 tablet_service.cc:1511] Processing CreateTablet for tablet 78c7d9fa8715457fb7cd31f0ea47ae92 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:55.961609  4282 tablet_service.cc:1511] Processing CreateTablet for tablet 434e24168b204a82b4cafcc2cba44c46 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:55.962167  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c7d9fa8715457fb7cd31f0ea47ae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.963141  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 434e24168b204a82b4cafcc2cba44c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.965745  4208 tablet_service.cc:1511] Processing CreateTablet for tablet 78c7d9fa8715457fb7cd31f0ea47ae92 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:55.967341  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c7d9fa8715457fb7cd31f0ea47ae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.971566  4346 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.972179  4346 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:55.977065  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:55.978921  4362 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:17:55.979384  4112 leader_election.cc:343] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.980157  4346 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:55.980819  4279 tablet_service.cc:1511] Processing CreateTablet for tablet 78c7d9fa8715457fb7cd31f0ea47ae92 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:55.982312  4279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c7d9fa8715457fb7cd31f0ea47ae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.985667  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:55.994445  4339 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:55.995113  4339 ts_tablet_manager.cc:1403] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.271s	user 0.019s	sys 0.031s
I20260709 13:17:55.995509  4137 tablet_service.cc:1511] Processing CreateTablet for tablet c93b2eb873344f43936dabea6e173ea0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:55.997177  4137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93b2eb873344f43936dabea6e173ea0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:55.998104  4261 leader_election.cc:343] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.999534  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:56.000375  4222 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:56.000406  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:56.001933  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:56.002172  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:56.003187  4362 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.003611  4362 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.003962  4362 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:56.004071  4111 leader_election.cc:343] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.004750  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:56.006794  4346 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.020293  4341 tablet_bootstrap.cc:654] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.020901  4204 tablet_service.cc:1511] Processing CreateTablet for tablet c93b2eb873344f43936dabea6e173ea0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:56.022440  4204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93b2eb873344f43936dabea6e173ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.017431  4339 raft_consensus.cc:359] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.024909  4339 raft_consensus.cc:385] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.025295  4339 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.026149  4339 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.026958  4278 tablet_service.cc:1511] Processing CreateTablet for tablet c93b2eb873344f43936dabea6e173ea0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:56.028481  4278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93b2eb873344f43936dabea6e173ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.029736  4128 tablet_service.cc:1511] Processing CreateTablet for tablet f776151073534d2e9012d8a291b66b5a (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:56.031232  4128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f776151073534d2e9012d8a291b66b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.032842  4339 ts_tablet_manager.cc:1434] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.003s
I20260709 13:17:56.034101  4339 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:56.047166  4211 tablet_service.cc:1511] Processing CreateTablet for tablet f776151073534d2e9012d8a291b66b5a (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:56.049017  4211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f776151073534d2e9012d8a291b66b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.050412  4340 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:56.051090  4340 ts_tablet_manager.cc:1403] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.246s	user 0.038s	sys 0.026s
I20260709 13:17:56.054648  4340 raft_consensus.cc:359] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.062178  4344 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.066540  4344 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.069345  4344 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:56.070528  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:56.073367  4348 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.073979  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:56.074481  4339 tablet_bootstrap.cc:654] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.074957  4296 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:17:56.076716  4187 leader_election.cc:343] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:56.077695  4186 leader_election.cc:343] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.078178  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:56.078905  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:56.080188  4346 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.083091  4279 tablet_service.cc:1511] Processing CreateTablet for tablet f776151073534d2e9012d8a291b66b5a (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:56.083702  4344 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.084751  4279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f776151073534d2e9012d8a291b66b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.088495  4340 raft_consensus.cc:385] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.088915  4340 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.089946  4340 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.098549  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:17:56.101751  4261 leader_election.cc:343] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.103991  4362 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.105894  4135 tablet_service.cc:1511] Processing CreateTablet for tablet da0810d325774d7181018ff01e71333a (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:56.107462  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0810d325774d7181018ff01e71333a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.110069  4340 ts_tablet_manager.cc:1434] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.059s	user 0.002s	sys 0.006s
I20260709 13:17:56.125852  4340 tablet_bootstrap.cc:492] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:56.126303  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:56.129488  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:56.130247  4341 tablet_bootstrap.cc:492] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:56.130852  4341 ts_tablet_manager.cc:1403] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.222s	user 0.011s	sys 0.005s
W20260709 13:17:56.132042  4261 leader_election.cc:343] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.135325  4340 tablet_bootstrap.cc:654] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.135910  4348 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:17:56.123070  4346 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.142763  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:56.143849  4222 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.153388  4147 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:56.155922  4362 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:56.156100  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:17:56.163131  4209 tablet_service.cc:1511] Processing CreateTablet for tablet da0810d325774d7181018ff01e71333a (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:56.164883  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0810d325774d7181018ff01e71333a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.166100  4362 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.166932  4362 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:56.167778  4137 tablet_service.cc:1511] Processing CreateTablet for tablet e24b8745010349f4b91ac3fb893c50d0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:56.169425  4137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24b8745010349f4b91ac3fb893c50d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.172209  4204 tablet_service.cc:1511] Processing CreateTablet for tablet e24b8745010349f4b91ac3fb893c50d0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:56.172850  4278 tablet_service.cc:1511] Processing CreateTablet for tablet da0810d325774d7181018ff01e71333a (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:56.173728  4204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24b8745010349f4b91ac3fb893c50d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.168236  4362 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.175179  4339 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:56.181676  4339 ts_tablet_manager.cc:1403] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.148s	user 0.052s	sys 0.040s
I20260709 13:17:56.167730  4341 raft_consensus.cc:359] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.175309  4278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0810d325774d7181018ff01e71333a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.184651  4341 raft_consensus.cc:385] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.185279  4341 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.186214  4341 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.177049  4222 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:56.188333  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:56.192162  4348 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.192832  4348 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:56.193830  4348 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.195245  4339 raft_consensus.cc:359] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.196112  4339 raft_consensus.cc:385] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.196517  4339 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.200376  4340 tablet_bootstrap.cc:492] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:56.200978  4340 ts_tablet_manager.cc:1403] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.002s
I20260709 13:17:56.213271  4134 tablet_service.cc:1511] Processing CreateTablet for tablet 537f9faaf59648debe160e6df5d91fcd (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:56.215432  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537f9faaf59648debe160e6df5d91fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.216840  4128 tablet_service.cc:1511] Processing CreateTablet for tablet 002295ea4e164178a447d55ccde98422 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:56.217218  4286 tablet_service.cc:1511] Processing CreateTablet for tablet e24b8745010349f4b91ac3fb893c50d0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:56.218008  4282 tablet_service.cc:1511] Processing CreateTablet for tablet 537f9faaf59648debe160e6df5d91fcd (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:56.218469  4128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002295ea4e164178a447d55ccde98422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.218848  4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24b8745010349f4b91ac3fb893c50d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.197455  4339 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.221276  4208 tablet_service.cc:1511] Processing CreateTablet for tablet 537f9faaf59648debe160e6df5d91fcd (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:56.227229  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537f9faaf59648debe160e6df5d91fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.230813  4203 tablet_service.cc:1511] Processing CreateTablet for tablet 002295ea4e164178a447d55ccde98422 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:56.231467  4341 ts_tablet_manager.cc:1434] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.100s	user 0.001s	sys 0.010s
I20260709 13:17:56.231814  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537f9faaf59648debe160e6df5d91fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.232455  4203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002295ea4e164178a447d55ccde98422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.232726  4341 tablet_bootstrap.cc:492] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:56.243949  4044 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.245113  4280 tablet_service.cc:1511] Processing CreateTablet for tablet 002295ea4e164178a447d55ccde98422 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:56.246881  4280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002295ea4e164178a447d55ccde98422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.249724  4129 tablet_service.cc:1511] Processing CreateTablet for tablet fcc0e559b40a475ea99ac69d7dbea6c0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:56.249958  4206 tablet_service.cc:1511] Processing CreateTablet for tablet fcc0e559b40a475ea99ac69d7dbea6c0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:56.251384  4129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc0e559b40a475ea99ac69d7dbea6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.251479  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc0e559b40a475ea99ac69d7dbea6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.252745  4339 ts_tablet_manager.cc:1434] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:17:56.256909  4284 tablet_service.cc:1511] Processing CreateTablet for tablet fcc0e559b40a475ea99ac69d7dbea6c0 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:56.258559  4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc0e559b40a475ea99ac69d7dbea6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.254336  4132 tablet_service.cc:1511] Processing CreateTablet for tablet b9ebd7fa04d4401f96670bd2866c719c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:56.261245  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ebd7fa04d4401f96670bd2866c719c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.265213  4339 tablet_bootstrap.cc:492] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:56.265409  4207 tablet_service.cc:1511] Processing CreateTablet for tablet b9ebd7fa04d4401f96670bd2866c719c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:56.270500  4207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ebd7fa04d4401f96670bd2866c719c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.265272  4285 tablet_service.cc:1511] Processing CreateTablet for tablet b9ebd7fa04d4401f96670bd2866c719c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:56.273350  4285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ebd7fa04d4401f96670bd2866c719c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.292138  4281 tablet_service.cc:1511] Processing CreateTablet for tablet d2e2dc5c77a5416995232da7a676ae73 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:56.293967  4281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e2dc5c77a5416995232da7a676ae73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.298332  4344 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.298885  4344 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.300133  4136 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca04a09529497898d86f573a0e1189 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:56.301193  4206 tablet_service.cc:1511] Processing CreateTablet for tablet d2e2dc5c77a5416995232da7a676ae73 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:56.301193  4283 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca04a09529497898d86f573a0e1189 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:56.301821  4136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca04a09529497898d86f573a0e1189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.302791  4283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca04a09529497898d86f573a0e1189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.302984  4344 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:56.303846  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:56.304703  4147 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:56.306155  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:56.308413  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:56.310245  4186 leader_election.cc:343] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.309993  4131 tablet_service.cc:1511] Processing CreateTablet for tablet a94558f1f2d64f6b8e16501cb7d48d78 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:56.311615  4131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94558f1f2d64f6b8e16501cb7d48d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.312856  4209 tablet_service.cc:1511] Processing CreateTablet for tablet a94558f1f2d64f6b8e16501cb7d48d78 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:56.314659  4344 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.315135  4344 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.315559  4344 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.321760  4135 tablet_service.cc:1511] Processing CreateTablet for tablet d9ed971e9cd64f17bc8646a1d19e3622 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:56.323572  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ed971e9cd64f17bc8646a1d19e3622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.299381  4204 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca04a09529497898d86f573a0e1189 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:56.302795  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e2dc5c77a5416995232da7a676ae73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.327642  4277 tablet_service.cc:1511] Processing CreateTablet for tablet a94558f1f2d64f6b8e16501cb7d48d78 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:56.329406  4277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94558f1f2d64f6b8e16501cb7d48d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.297789  4211 tablet_service.cc:1511] Processing CreateTablet for tablet d9ed971e9cd64f17bc8646a1d19e3622 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:56.341111  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94558f1f2d64f6b8e16501cb7d48d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.340619  4133 tablet_service.cc:1511] Processing CreateTablet for tablet 96704063be1347b0bf621569c72ae1fd (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:56.341882  4204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca04a09529497898d86f573a0e1189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.342314  4133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96704063be1347b0bf621569c72ae1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.343022  4212 tablet_service.cc:1511] Processing CreateTablet for tablet 96704063be1347b0bf621569c72ae1fd (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:56.344545  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96704063be1347b0bf621569c72ae1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.352623  4339 tablet_bootstrap.cc:654] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.353341  4211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ed971e9cd64f17bc8646a1d19e3622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.292138  4279 tablet_service.cc:1511] Processing CreateTablet for tablet d9ed971e9cd64f17bc8646a1d19e3622 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:56.295665  4340 raft_consensus.cc:359] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.358723  4340 raft_consensus.cc:385] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.359153  4340 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.363512  4341 tablet_bootstrap.cc:654] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.366348  4346 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.366962  4346 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.368119  4137 tablet_service.cc:1511] Processing CreateTablet for tablet d2e2dc5c77a5416995232da7a676ae73 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:56.369701  4137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e2dc5c77a5416995232da7a676ae73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.370597  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:56.371093  4130 tablet_service.cc:1511] Processing CreateTablet for tablet e6b9a320ff854b5998471937010702d5 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:56.371728  4346 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:56.372785  4130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b9a320ff854b5998471937010702d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:56.373206  4111 leader_election.cc:343] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.372852  4340 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.373355  4210 tablet_service.cc:1511] Processing CreateTablet for tablet e6b9a320ff854b5998471937010702d5 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:56.374969  4210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b9a320ff854b5998471937010702d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.375375  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:17:56.377807  4112 leader_election.cc:343] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.378506  4112 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:56.380307  4346 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.398805  4279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ed971e9cd64f17bc8646a1d19e3622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.404034  4131 tablet_service.cc:1511] Processing CreateTablet for tablet bb7d207ddadd4505a2b62ff61258cff1 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:56.393514  4344 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.410108  4131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7d207ddadd4505a2b62ff61258cff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.429569  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:56.448737  4147 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.466956  4339 tablet_bootstrap.cc:492] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:56.467600  4339 ts_tablet_manager.cc:1403] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.203s	user 0.017s	sys 0.014s
I20260709 13:17:56.469224  4207 tablet_service.cc:1511] Processing CreateTablet for tablet 57a7dac49b784166afd62631b44900c8 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:56.470885  4207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a7dac49b784166afd62631b44900c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.471629  4339 raft_consensus.cc:359] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.476536  4339 raft_consensus.cc:385] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.476599  4285 tablet_service.cc:1511] Processing CreateTablet for tablet 96704063be1347b0bf621569c72ae1fd (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:56.478340  4285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96704063be1347b0bf621569c72ae1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.481856  4340 ts_tablet_manager.cc:1434] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.272s	user 0.011s	sys 0.007s
I20260709 13:17:56.487620  4340 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:56.477133  4339 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.497061  4348 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.497315  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:56.497781  4348 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.498127  4277 tablet_service.cc:1511] Processing CreateTablet for tablet bb7d207ddadd4505a2b62ff61258cff1 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:17:56.500972  4186 leader_election.cc:343] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.502197  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:56.500234  4348 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:56.503065  4222 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:56.502200  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:56.504511  4203 tablet_service.cc:1511] Processing CreateTablet for tablet a35e1cee8a15436dbfaf75dd67824aad (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:56.505803  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:17:56.506801  4261 leader_election.cc:343] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.507812  4348 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.508219  4348 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.511232  4348 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.502310  4147 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:56.521104  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:56.525089  4208 tablet_service.cc:1511] Processing CreateTablet for tablet bb7d207ddadd4505a2b62ff61258cff1 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:56.471822  4128 tablet_service.cc:1511] Processing CreateTablet for tablet 57a7dac49b784166afd62631b44900c8 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:56.491992  4344 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:56.499696  4277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7d207ddadd4505a2b62ff61258cff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.548275  4128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a7dac49b784166afd62631b44900c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.549644  4373 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.550079  4212 tablet_service.cc:1511] Processing CreateTablet for tablet 17b099e5e28a475fa86a6f1efaa21ed9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:56.555310  4373 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:17:56.556713  4373 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.546262  4133 tablet_service.cc:1511] Processing CreateTablet for tablet a35e1cee8a15436dbfaf75dd67824aad (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:56.565915  4133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35e1cee8a15436dbfaf75dd67824aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.541932  4203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35e1cee8a15436dbfaf75dd67824aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.572940  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b099e5e28a475fa86a6f1efaa21ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.543793  4339 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.577921  4134 tablet_service.cc:1511] Processing CreateTablet for tablet 17b099e5e28a475fa86a6f1efaa21ed9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:56.579203  4136 tablet_service.cc:1511] Processing CreateTablet for tablet e2c23c7c663f4647955b43f85d642e1c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:56.579690  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b099e5e28a475fa86a6f1efaa21ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.581969  4280 tablet_service.cc:1511] Processing CreateTablet for tablet 57a7dac49b784166afd62631b44900c8 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:56.602020  4286 tablet_service.cc:1511] Processing CreateTablet for tablet a35e1cee8a15436dbfaf75dd67824aad (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:56.602420  4278 tablet_service.cc:1511] Processing CreateTablet for tablet 17b099e5e28a475fa86a6f1efaa21ed9 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:56.604516  4209 tablet_service.cc:1511] Processing CreateTablet for tablet e2c23c7c663f4647955b43f85d642e1c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:17:56.604807  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 83872.2us
I20260709 13:17:56.607637  4341 tablet_bootstrap.cc:492] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:56.609760  4341 ts_tablet_manager.cc:1403] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.377s	user 0.014s	sys 0.014s
I20260709 13:17:56.608798  4339 ts_tablet_manager.cc:1434] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.141s	user 0.010s	sys 0.000s
I20260709 13:17:56.615952  4136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c23c7c663f4647955b43f85d642e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.615206  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7d207ddadd4505a2b62ff61258cff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.618049  4280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a7dac49b784166afd62631b44900c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.626451  4282 tablet_service.cc:1511] Processing CreateTablet for tablet e2c23c7c663f4647955b43f85d642e1c (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:56.627627  4341 raft_consensus.cc:359] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.628535  4341 raft_consensus.cc:385] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.628882  4341 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.629767  4341 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.637452  4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35e1cee8a15436dbfaf75dd67824aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.638616  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c23c7c663f4647955b43f85d642e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.640147  4278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b099e5e28a475fa86a6f1efaa21ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.643803  4339 tablet_bootstrap.cc:492] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:56.640851  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c23c7c663f4647955b43f85d642e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.649271  4362 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.649914  4362 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.650022  4348 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.651899  4340 tablet_bootstrap.cc:654] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.652446  4362 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:56.655627  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:56.657202  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:56.661624  4346 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.662357  4261 leader_election.cc:343] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.662184  4346 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:17:56.663139  4261 leader_election.cc:343] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.664606  4346 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:56.666435  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:56.667344  4222 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:17:56.670346  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:56.671576  4346 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.672138  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:56.672161  4346 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.672459  4045 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.632203  4341 ts_tablet_manager.cc:1434] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 13:17:56.678049  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:56.678572  4341 tablet_bootstrap.cc:492] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:56.680728  4348 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:56.680809  4283 tablet_service.cc:1511] Processing CreateTablet for tablet e6b9a320ff854b5998471937010702d5 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:56.685348  4283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b9a320ff854b5998471937010702d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.693305  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:56.703164  4131 tablet_service.cc:1511] Processing CreateTablet for tablet 151a7707aeab4292bf6804cdfbf0cf06 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:17:56.682322  4261 consensus_peers.cc:597] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:56.721604  4112 leader_election.cc:343] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.729548  4209 tablet_service.cc:1511] Processing CreateTablet for tablet 151a7707aeab4292bf6804cdfbf0cf06 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:56.731015  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151a7707aeab4292bf6804cdfbf0cf06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.737021  4282 tablet_service.cc:1511] Processing CreateTablet for tablet 151a7707aeab4292bf6804cdfbf0cf06 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:56.738427  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151a7707aeab4292bf6804cdfbf0cf06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:56.735885  4261 leader_election.cc:343] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.741477  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:17:56.743325  4362 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.743924  4348 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.744580  4346 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:56.745158  4346 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.746291  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:56.746937  4221 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.754822  4221 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
W20260709 13:17:56.760917  4374 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:56.765893  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:56.769160  4131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151a7707aeab4292bf6804cdfbf0cf06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.769340  4348 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.770007  4348 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:56.771129  4348 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.777305  4132 tablet_service.cc:1511] Processing CreateTablet for tablet e9d67bbe0103433095fb80de46cf624d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:56.779059  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9d67bbe0103433095fb80de46cf624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.785892  4339 tablet_bootstrap.cc:654] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:56.789353  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 111437us
I20260709 13:17:56.795940  4212 tablet_service.cc:1511] Processing CreateTablet for tablet e9d67bbe0103433095fb80de46cf624d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:56.798435  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9d67bbe0103433095fb80de46cf624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.799976  4279 tablet_service.cc:1511] Processing CreateTablet for tablet e9d67bbe0103433095fb80de46cf624d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:56.809407  4279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9d67bbe0103433095fb80de46cf624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.817109  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:56.818847  4135 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcd7e7f18b74faf9bbcd8060013bfa2 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:56.837149  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcd7e7f18b74faf9bbcd8060013bfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.822248  4362 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:56.842020  4111 leader_election.cc:343] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.822183  4285 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcd7e7f18b74faf9bbcd8060013bfa2 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:56.842685  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:56.843711  4285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcd7e7f18b74faf9bbcd8060013bfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.843475  4208 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcd7e7f18b74faf9bbcd8060013bfa2 (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:56.843755  4380 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.835106  4340 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:56.845165  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcd7e7f18b74faf9bbcd8060013bfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.845698  4340 ts_tablet_manager.cc:1403] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.358s	user 0.008s	sys 0.012s
I20260709 13:17:56.846439  4341 tablet_bootstrap.cc:654] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.858554  4137 tablet_service.cc:1511] Processing CreateTablet for tablet 40b291caa9a64e83948693294f96069d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:56.861150  4137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b291caa9a64e83948693294f96069d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.863236  4346 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.871335  4209 tablet_service.cc:1511] Processing CreateTablet for tablet 40b291caa9a64e83948693294f96069d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:56.872822  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b291caa9a64e83948693294f96069d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.878515  4282 tablet_service.cc:1511] Processing CreateTablet for tablet 40b291caa9a64e83948693294f96069d (DEFAULT_TABLE table=test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:56.879236  4340 raft_consensus.cc:359] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.880029  4282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b291caa9a64e83948693294f96069d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.880280  4340 raft_consensus.cc:385] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.885030  4340 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.886363  4340 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:56.914657  4348 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:56.957299  4045 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:17:56.962698  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:56.972282  4376 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:56.970399  4340 ts_tablet_manager.cc:1434] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.004s
I20260709 13:17:56.989208  4340 tablet_bootstrap.cc:492] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.026501  4339 tablet_bootstrap.cc:492] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:57.027277  4339 ts_tablet_manager.cc:1403] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.384s	user 0.025s	sys 0.004s
I20260709 13:17:57.031417  4339 raft_consensus.cc:359] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.032105  4340 tablet_bootstrap.cc:654] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.015216  4044 catalog_manager.cc:5697] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:57.041443  4186 consensus_peers.cc:597] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:57.041604  4339 raft_consensus.cc:385] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.053740  4339 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.054709  4339 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.055791  4341 tablet_bootstrap.cc:492] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.059541  4341 ts_tablet_manager.cc:1403] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.381s	user 0.026s	sys 0.028s
I20260709 13:17:57.066221  4339 ts_tablet_manager.cc:1434] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:17:57.067639  4339 tablet_bootstrap.cc:492] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:57.091331  4341 raft_consensus.cc:359] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.094933  4341 raft_consensus.cc:385] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.095453  4341 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.096755  4341 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.100523  4341 ts_tablet_manager.cc:1434] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:17:57.105578  4339 tablet_bootstrap.cc:654] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.123468  4341 tablet_bootstrap.cc:492] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.125545  4339 tablet_bootstrap.cc:492] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:57.125979  4340 tablet_bootstrap.cc:492] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:57.126299  4339 ts_tablet_manager.cc:1403] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.005s
I20260709 13:17:57.126436  4340 ts_tablet_manager.cc:1403] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.146s	user 0.035s	sys 0.036s
I20260709 13:17:57.130185  4339 raft_consensus.cc:359] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.130095  4340 raft_consensus.cc:359] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.131362  4340 raft_consensus.cc:385] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.131362  4339 raft_consensus.cc:385] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.131906  4340 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.132014  4339 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.133352  4339 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.133380  4340 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.136909  4340 ts_tablet_manager.cc:1434] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 13:17:57.138456  4340 tablet_bootstrap.cc:492] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.146656  4340 tablet_bootstrap.cc:654] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.148553  4341 tablet_bootstrap.cc:654] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.163544  4341 tablet_bootstrap.cc:492] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.164222  4341 ts_tablet_manager.cc:1403] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.011s
I20260709 13:17:57.168222  4341 raft_consensus.cc:359] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.169205  4341 raft_consensus.cc:385] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.169539  4341 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.170675  4341 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.177088  4339 ts_tablet_manager.cc:1434] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:17:57.183720  4341 ts_tablet_manager.cc:1434] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:17:57.189553  4339 tablet_bootstrap.cc:492] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:57.191076  4384 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.192452  4341 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.192968  4384 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.198890  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.199813  4147 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:57.201422  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:57.202476  4348 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:57.202991  4348 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.202785  4384 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.203642  4348 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.206650  4341 tablet_bootstrap.cc:654] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.210541  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.213442  4384 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:57.215035  4261 leader_election.cc:343] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.216543  4348 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.219652  4348 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.219792  4346 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.220382  4346 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.222863  4346 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.225040  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.225839  4222 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:57.227373  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:57.227686  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:57.228814  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:57.229063  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:57.229496  4147 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:57.230662  4111 leader_election.cc:343] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.232542  4346 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:57.233014  4346 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.233397  4346 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.235857  4341 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.236719  4341 ts_tablet_manager.cc:1403] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.013s
I20260709 13:17:57.241669  4341 raft_consensus.cc:359] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.242480  4341 raft_consensus.cc:385] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.243090  4341 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
W20260709 13:17:57.243541  4261 leader_election.cc:343] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.244132  4341 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.248307  4346 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.252029  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:57.252787  4221 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.253172  4341 ts_tablet_manager.cc:1434] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.005s
I20260709 13:17:57.256459  4341 tablet_bootstrap.cc:492] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.262686  4221 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:57.264820  4340 tablet_bootstrap.cc:492] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:57.264972  4341 tablet_bootstrap.cc:654] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.265383  4340 ts_tablet_manager.cc:1403] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.127s	user 0.044s	sys 0.077s
I20260709 13:17:57.267163  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:57.268203  4380 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:57.269232  4340 raft_consensus.cc:359] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.269980  4340 raft_consensus.cc:385] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.270262  4340 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.270999  4373 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.271195  4340 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.271485  4373 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.266135  4147 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:57.273590  4373 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.273713  4340 ts_tablet_manager.cc:1434] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:57.274835  4340 tablet_bootstrap.cc:492] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.275501  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:57.277284  4186 leader_election.cc:343] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.279102  4341 tablet_bootstrap.cc:492] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.279673  4341 ts_tablet_manager.cc:1403] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:17:57.280663  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:57.281208  4340 tablet_bootstrap.cc:654] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:57.282487  4111 leader_election.cc:343] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.283147  4341 raft_consensus.cc:359] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.283978  4341 raft_consensus.cc:385] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.284286  4341 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.284441  4380 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:17:57.285208  4348 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.285421  4380 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.285728  4348 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.287869  4348 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.288281  4346 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.288715  4341 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.291476  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.292234  4341 ts_tablet_manager.cc:1434] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:57.292626  4145 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:57.293458  4341 tablet_bootstrap.cc:492] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.295614  4340 tablet_bootstrap.cc:492] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:57.296227  4340 ts_tablet_manager.cc:1403] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:17:57.289258  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.297631  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.298528  4147 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:57.298547  4221 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:57.299582  4340 raft_consensus.cc:359] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.301380  4340 raft_consensus.cc:385] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.301715  4340 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.301590  4187 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:57.302520  4340 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.303020  4373 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:57.303434  4373 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.303773  4373 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.304906  4340 ts_tablet_manager.cc:1434] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:17:57.305950  4340 tablet_bootstrap.cc:492] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.306001  4341 tablet_bootstrap.cc:654] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:57.307556  4261 consensus_peers.cc:597] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:57.308317  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:17:57.310163  4348 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:57.310745  4348 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:57.311685  4348 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.312633  4340 tablet_bootstrap.cc:654] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.313412  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:57.320377  4384 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:57.321101  4384 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.321573  4384 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.314026  4045 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.349218  4373 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.349030  4044 catalog_manager.cc:5697] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.352607  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:57.353322  4147 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.354790  4339 tablet_bootstrap.cc:654] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.362285  4384 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.365813  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:57.366603  4145 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.367693  4348 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.366344  4373 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.372601  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:57.370175  4348 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:17:57.374883  4186 leader_election.cc:343] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.376459  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.383160  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.384709  4221 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:17:57.385357  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:57.386421  4222 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.387195  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:17:57.388847  4362 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.383111  4341 tablet_bootstrap.cc:492] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.391526  4341 ts_tablet_manager.cc:1403] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.049s
I20260709 13:17:57.393229  4384 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.400650  4341 raft_consensus.cc:359] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.405993  4341 raft_consensus.cc:385] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.406423  4341 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.396610  4145 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:57.407812  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:57.408867  4341 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.409682  4340 tablet_bootstrap.cc:492] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:57.410295  4340 ts_tablet_manager.cc:1403] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.105s	user 0.042s	sys 0.055s
I20260709 13:17:57.411988  4339 tablet_bootstrap.cc:492] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:57.412644  4339 ts_tablet_manager.cc:1403] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.024s
I20260709 13:17:57.413203  4384 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:57.413316  4222 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:57.412562  4362 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:57.413571  4340 raft_consensus.cc:359] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.414482  4340 raft_consensus.cc:385] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.393496  4348 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.414844  4340 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.415706  4340 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.417900  4339 raft_consensus.cc:359] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.418689  4339 raft_consensus.cc:385] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.418979  4339 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.418975  4340 ts_tablet_manager.cc:1434] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:57.420022  4339 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.420593  4340 tablet_bootstrap.cc:492] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.422884  4339 ts_tablet_manager.cc:1434] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:17:57.425721  4384 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:57.426544  4339 tablet_bootstrap.cc:492] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:57.426931  4384 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.430435  4340 tablet_bootstrap.cc:654] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.445528  4339 tablet_bootstrap.cc:654] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.450670  4147 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:57.454430  4187 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:57.454896  4045 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.455814  4373 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:57.456355  4373 raft_consensus.cc:697] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:17:57.458635  4341 ts_tablet_manager.cc:1434] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.016s
I20260709 13:17:57.458451  4373 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.460325  4341 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.469499  4376 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.470469  4341 tablet_bootstrap.cc:654] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.470160  4376 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.472918  4376 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.475467  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.477840  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:57.478700  4296 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
W20260709 13:17:57.481380  4187 leader_election.cc:343] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.482580  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:57.484325  4344 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.485038  4344 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.487465  4344 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.490321  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.491412  4145 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:17:57.492841  4340 tablet_bootstrap.cc:492] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:57.493551  4340 ts_tablet_manager.cc:1403] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.073s	user 0.037s	sys 0.031s
I20260709 13:17:57.496845  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:57.499001  4340 raft_consensus.cc:359] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.499516  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:57.500104  4340 raft_consensus.cc:385] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.488191  4344 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:57.500741  4340 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.501740  4376 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.502207  4340 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.500819  4344 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.506287  4344 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.511236  4341 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.511461  4339 tablet_bootstrap.cc:492] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:57.512317  4339 ts_tablet_manager.cc:1403] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.002s
I20260709 13:17:57.512318  4341 ts_tablet_manager.cc:1403] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.010s
I20260709 13:17:57.516711  4410 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.516907  4341 raft_consensus.cc:359] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.517398  4410 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.518541  4340 ts_tablet_manager.cc:1434] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.025s	user 0.019s	sys 0.001s
I20260709 13:17:57.518796  4341 raft_consensus.cc:385] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.519325  4341 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.520018  4340 tablet_bootstrap.cc:492] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.520150  4341 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.522989  4341 ts_tablet_manager.cc:1434] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:57.525478  4410 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.526552  4341 tablet_bootstrap.cc:492] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.527055  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.528276  4044 catalog_manager.cc:5697] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:57.529376  4261 leader_election.cc:343] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.527366  4340 tablet_bootstrap.cc:654] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.532941  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.533768  4222 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:57.534772  4341 tablet_bootstrap.cc:654] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.535570  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:57.544152  4410 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:57.544916  4410 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.545384  4410 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.552644  4339 raft_consensus.cc:359] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.553568  4339 raft_consensus.cc:385] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.553891  4339 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.555063  4341 tablet_bootstrap.cc:492] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.555609  4341 ts_tablet_manager.cc:1403] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.011s
I20260709 13:17:57.557243  4410 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.558888  4341 raft_consensus.cc:359] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.565310  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:57.561026  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:57.567078  4222 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:57.568027  4261 leader_election.cc:343] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.559562  4410 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.559672  4341 raft_consensus.cc:385] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.571012  4341 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.573160  4340 tablet_bootstrap.cc:492] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:57.573791  4340 ts_tablet_manager.cc:1403] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.022s
I20260709 13:17:57.576500  4222 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:57.576265  4344 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.576536  4340 raft_consensus.cc:359] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.577412  4340 raft_consensus.cc:385] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.577701  4340 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.578001  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:57.578943  4340 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.579454  4344 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.573222  4341 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.580915  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:57.581303  4362 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:57.581599  4340 ts_tablet_manager.cc:1434] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:17:57.581586  4296 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.581931  4362 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:57.582516  4341 ts_tablet_manager.cc:1434] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.003s
I20260709 13:17:57.582836  4340 tablet_bootstrap.cc:492] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.583503  4341 tablet_bootstrap.cc:492] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.582935  4362 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.585426  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:57.587512  4373 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.588107  4373 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.589836  4376 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:57.590584  4340 tablet_bootstrap.cc:654] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.554857  4339 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.590986  4373 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.600111  4339 ts_tablet_manager.cc:1434] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.004s
I20260709 13:17:57.601369  4339 tablet_bootstrap.cc:492] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:57.609352  4339 tablet_bootstrap.cc:654] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.609804  4294 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.614408  4341 tablet_bootstrap.cc:654] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.592746  4410 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.593394  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:57.594080  4187 leader_election.cc:343] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.594561  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.624862  4410 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.626291  4341 tablet_bootstrap.cc:492] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.626905  4341 ts_tablet_manager.cc:1403] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.004s
I20260709 13:17:57.627655  4410 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.630441  4341 raft_consensus.cc:359] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.630686  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.631264  4341 raft_consensus.cc:385] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.631682  4341 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.626291  4339 tablet_bootstrap.cc:492] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:57.632709  4339 ts_tablet_manager.cc:1403] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.005s
I20260709 13:17:57.632558  4341 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.634739  4341 ts_tablet_manager.cc:1434] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 13:17:57.624275  4186 leader_election.cc:343] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.635850  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.636703  4147 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:17:57.636986  4187 leader_election.cc:343] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.637504  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:57.638813  4373 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:57.640233  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:17:57.641566  4410 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.642422  4296 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:57.638929  4341 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.645009  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:57.646508  4373 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:57.647287  4373 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:17:57.646183  4339 raft_consensus.cc:359] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.648175  4339 raft_consensus.cc:385] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.648550  4339 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.649312  4339 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.655390  4339 ts_tablet_manager.cc:1434] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:17:57.656002  4340 tablet_bootstrap.cc:492] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:57.656783  4340 ts_tablet_manager.cc:1403] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.074s	user 0.030s	sys 0.019s
I20260709 13:17:57.656888  4339 tablet_bootstrap.cc:492] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:57.660400  4410 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:57.644537  4044 catalog_manager.cc:5697] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.662088  4222 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.673524  4362 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:17:57.674207  4362 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.679721  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:57.682852  4373 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.686779  4380 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:57.687927  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.692597  4341 tablet_bootstrap.cc:654] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.690162  4339 tablet_bootstrap.cc:654] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.689527  4340 raft_consensus.cc:359] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.693157  4340 raft_consensus.cc:385] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.693522  4340 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.694288  4340 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.696410  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:17:57.697368  4340 ts_tablet_manager.cc:1434] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 13:17:57.698173  4410 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.698952  4340 tablet_bootstrap.cc:492] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.689476  4362 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.702481  4147 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.710444  4340 tablet_bootstrap.cc:654] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.739140  4341 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.740160  4341 ts_tablet_manager.cc:1403] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.024s
I20260709 13:17:57.744835  4339 tablet_bootstrap.cc:492] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:57.745505  4339 ts_tablet_manager.cc:1403] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.009s
I20260709 13:17:57.751554  4045 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.754881  4339 raft_consensus.cc:359] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.755847  4339 raft_consensus.cc:385] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.756151  4339 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.757108  4339 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.759809  4341 raft_consensus.cc:359] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.760978  4341 raft_consensus.cc:385] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.761425  4341 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.762627  4341 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.776010  4341 ts_tablet_manager.cc:1434] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:17:57.777273  4402 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:57.779685  4341 tablet_bootstrap.cc:492] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:57.782248  4380 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:17:57.783221  4339 ts_tablet_manager.cc:1434] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.009s
I20260709 13:17:57.782842  4380 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.788264  4339 tablet_bootstrap.cc:492] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:57.790627  4380 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.795915  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:57.799428  4340 tablet_bootstrap.cc:492] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:57.799829  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.800138  4340 ts_tablet_manager.cc:1403] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.006s
I20260709 13:17:57.801851  4112 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:57.803542  4380 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.803608  4340 raft_consensus.cc:359] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.804659  4340 raft_consensus.cc:385] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.805032  4340 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.806118  4341 tablet_bootstrap.cc:654] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.805800  4340 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.808723  4340 ts_tablet_manager.cc:1434] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:57.810061  4340 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:57.820873  4340 tablet_bootstrap.cc:654] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.823486  4380 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.824169  4380 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.827932  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:57.828785  4296 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:57.831061  4433 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.831910  4433 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.832773  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.833563  4220 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:57.835155  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:57.835450  4433 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.836392  4433 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:57.836941  4433 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.837416  4433 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.843426  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.844636  4220 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:57.846509  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:57.847656  4346 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:57.848145  4346 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.848608  4346 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.849932  4362 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:57.852881  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:57.855193  4111 leader_election.cc:343] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.855099  4376 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:57.856974  4380 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.858604  4433 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.863749  4433 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.865479  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:57.866590  4295 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.867604  4376 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.868151  4376 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.872300  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:57.873191  4221 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.873159  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:57.875726  4186 leader_election.cc:343] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.882375  4376 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.883428  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:17:57.893877  4187 leader_election.cc:343] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.894768  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:57.896054  4376 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:57.897814  4410 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:57.900013  4410 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:57.895776  4346 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.934698  4339 tablet_bootstrap.cc:700] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent opening tablet: real 0.119s	user 0.001s	sys 0.003s
I20260709 13:17:57.937322  4339 tablet_bootstrap.cc:654] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.943512  4362 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.944885  4221 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:57.944514  4362 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.946339  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:57.947364  4433 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:57.947925  4433 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:17:57.949661  4433 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.953837  4384 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:57.957201  4346 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.959003  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:57.964174  4341 tablet_bootstrap.cc:492] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:57.969973  4341 ts_tablet_manager.cc:1403] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.192s	user 0.020s	sys 0.032s
I20260709 13:17:57.973560  4341 raft_consensus.cc:359] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.984558  4341 raft_consensus.cc:385] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.985110  4341 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.986908  4346 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.987535  4346 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.990337  4346 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:57.991381  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:57.986083  4341 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:57.948055  4362 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:57.976131  4222 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.982611  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:57.994716  4296 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:57.996130  4341 ts_tablet_manager.cc:1434] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
W20260709 13:17:57.993971  4112 leader_election.cc:343] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.983565  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:58.009344  4221 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:58.010480  4341 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:58.010689  4295 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:58.012697  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:17:58.029124  4261 leader_election.cc:343] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.030148  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.030297  4222 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:58.034827  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:58.036060  4433 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.038024  4433 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:17:58.004391  4296 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:58.039101  4433 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:17:58.043889  4111 leader_election.cc:343] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.044693  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:17:58.047240  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:58.049964  4346 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.049458  4339 tablet_bootstrap.cc:492] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:58.033416  4341 tablet_bootstrap.cc:654] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.051492  4339 ts_tablet_manager.cc:1403] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.266s	user 0.046s	sys 0.040s
I20260709 13:17:58.058552  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:58.059852  4362 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.060668  4362 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.061156  4362 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.064234  4340 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.064888  4340 ts_tablet_manager.cc:1403] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.255s	user 0.060s	sys 0.053s
I20260709 13:17:58.068215  4340 raft_consensus.cc:359] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.069339  4340 raft_consensus.cc:385] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.069289  4376 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:58.069885  4340 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.070434  4362 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.070842  4340 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.073843  4340 ts_tablet_manager.cc:1434] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:58.075115  4340 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.074832  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:17:58.077323  4261 leader_election.cc:343] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.078894  4362 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:58.084430  4339 raft_consensus.cc:359] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.087248  4339 raft_consensus.cc:385] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.087707  4339 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.088632  4339 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.092008  4339 ts_tablet_manager.cc:1434] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 13:17:58.093195  4339 tablet_bootstrap.cc:492] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:58.094310  4341 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:58.094832  4341 ts_tablet_manager.cc:1403] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.011s
I20260709 13:17:58.098477  4341 raft_consensus.cc:359] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.099154  4341 raft_consensus.cc:385] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.099409  4341 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.099094  4344 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.096884  4444 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.109175  4344 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.106767  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:58.101155  4341 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.109588  4444 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.110863  4222 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.112504  4444 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:58.113201  4341 ts_tablet_manager.cc:1434] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.009s
I20260709 13:17:58.113788  4344 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.113822  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.114260  4341 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:58.114682  4296 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:58.116163  4186 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:58.117254  4344 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.117723  4344 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.117790  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.118247  4344 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:58.120257  4261 leader_election.cc:343] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.122205  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.122699  4340 tablet_bootstrap.cc:654] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.129225  4222 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:58.130776  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:17:58.133754  4187 leader_election.cc:343] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.126011  4044 catalog_manager.cc:5697] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.135838  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:58.137421  4044 catalog_manager.cc:5697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.139277  4362 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.139746  4340 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.139837  4362 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:58.140327  4340 ts_tablet_manager.cc:1403] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.007s
I20260709 13:17:58.142584  4339 tablet_bootstrap.cc:654] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.142493  4362 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.145987  4344 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.147418  4220 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:17:58.150043  4340 raft_consensus.cc:359] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.150895  4340 raft_consensus.cc:385] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.151193  4340 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.151840  4340 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.154062  4341 tablet_bootstrap.cc:654] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.152738  4261 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:17:58.154930  4444 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.157675  4340 ts_tablet_manager.cc:1434] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:17:58.158955  4340 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.165987  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:58.166853  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:17:58.168061  4187 leader_election.cc:343] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.167595  4344 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.172618  4444 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.176702  4044 catalog_manager.cc:5697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.193352  4340 tablet_bootstrap.cc:654] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.196820  4341 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:58.197248  4339 tablet_bootstrap.cc:492] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:58.197417  4341 ts_tablet_manager.cc:1403] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.009s
I20260709 13:17:58.198483  4339 ts_tablet_manager.cc:1403] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.004s
W20260709 13:17:58.200209  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.200277  4344 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:58.201803  4341 raft_consensus.cc:359] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.202597  4341 raft_consensus.cc:385] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.202865  4341 raft_consensus.cc:740] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.203619  4341 consensus_queue.cc:260] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.206070  4341 ts_tablet_manager.cc:1434] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:58.207154  4341 tablet_bootstrap.cc:492] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:58.208141  4296 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:58.208863  4339 raft_consensus.cc:359] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.211706  4339 raft_consensus.cc:385] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.212293  4339 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.216846  4341 tablet_bootstrap.cc:654] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.213632  4339 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.217489  4384 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:58.220317  4339 ts_tablet_manager.cc:1434] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:17:58.223285  4340 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.223837  4340 ts_tablet_manager.cc:1403] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.011s
I20260709 13:17:58.227207  4340 raft_consensus.cc:359] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.228065  4340 raft_consensus.cc:385] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.228380  4340 raft_consensus.cc:740] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.229156  4340 consensus_queue.cc:260] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.231546  4340 ts_tablet_manager.cc:1434] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:58.234418  4186 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:58.238313  4340 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.238672  4344 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.239267  4344 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:17:58.240156  4344 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.241115  4341 tablet_bootstrap.cc:492] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:58.241830  4341 ts_tablet_manager.cc:1403] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.019s
I20260709 13:17:58.245508  4341 raft_consensus.cc:359] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.250232  4341 raft_consensus.cc:385] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.250582  4341 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.251398  4341 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.252987  4340 tablet_bootstrap.cc:654] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.254583  4341 ts_tablet_manager.cc:1434] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:58.256024  4341 tablet_bootstrap.cc:492] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:58.264686  4341 tablet_bootstrap.cc:654] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.265242  4340 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.265782  4340 ts_tablet_manager.cc:1403] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.016s
I20260709 13:17:58.267655  4339 tablet_bootstrap.cc:492] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:58.273487  4340 raft_consensus.cc:359] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.274346  4340 raft_consensus.cc:385] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.274669  4340 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.282320  4340 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.292503  4339 tablet_bootstrap.cc:654] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.293157  4340 ts_tablet_manager.cc:1434] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:17:58.292588  4146 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.294384  4340 tablet_bootstrap.cc:492] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.301731  4433 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.302471  4433 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.305717  4433 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.307847  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:58.309369  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:58.314723  4111 leader_election.cc:343] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:58.315470  4112 leader_election.cc:343] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.315974  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:58.317394  4373 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:58.317458  4433 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.321521  4341 tablet_bootstrap.cc:492] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:58.322041  4341 ts_tablet_manager.cc:1403] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.026s
I20260709 13:17:58.324620  4339 tablet_bootstrap.cc:492] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:58.325285  4339 ts_tablet_manager.cc:1403] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.007s
I20260709 13:17:58.326790  4340 tablet_bootstrap.cc:654] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.329792  4339 raft_consensus.cc:359] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.330602  4339 raft_consensus.cc:385] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.330760  4341 raft_consensus.cc:359] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.331027  4339 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.331576  4341 raft_consensus.cc:385] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.331908  4341 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.331257  4045 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.332214  4339 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.332965  4341 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.335392  4341 ts_tablet_manager.cc:1434] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:17:58.339206  4341 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:58.339877  4339 ts_tablet_manager.cc:1434] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:17:58.341523  4339 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:58.345934  4340 tablet_bootstrap.cc:492] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.346552  4340 ts_tablet_manager.cc:1403] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.006s
I20260709 13:17:58.349397  4339 tablet_bootstrap.cc:654] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.349571  4340 raft_consensus.cc:359] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.350337  4340 raft_consensus.cc:385] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.350760  4341 tablet_bootstrap.cc:654] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.351028  4340 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.351974  4340 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.355067  4340 ts_tablet_manager.cc:1434] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:58.356775  4340 tablet_bootstrap.cc:492] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.364282  4340 tablet_bootstrap.cc:654] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.372015  4339 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:58.372783  4339 ts_tablet_manager.cc:1403] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.010s
I20260709 13:17:58.375305  4341 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:58.375676  4339 raft_consensus.cc:359] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.376271  4341 ts_tablet_manager.cc:1403] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.013s
I20260709 13:17:58.376492  4339 raft_consensus.cc:385] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.376809  4339 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.377677  4339 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.379703  4341 raft_consensus.cc:359] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.380142  4339 ts_tablet_manager.cc:1434] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:17:58.380609  4341 raft_consensus.cc:385] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.381011  4341 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.381795  4339 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:58.382833  4341 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.386816  4341 ts_tablet_manager.cc:1434] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:17:58.388170  4341 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:58.392000  4340 tablet_bootstrap.cc:492] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.392745  4340 ts_tablet_manager.cc:1403] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.005s
I20260709 13:17:58.398301  4373 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.398890  4373 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.400039  4340 raft_consensus.cc:359] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.400617  4376 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.400800  4340 raft_consensus.cc:385] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.401162  4340 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.401213  4376 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.402118  4339 tablet_bootstrap.cc:654] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.403723  4376 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.405552  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.406646  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:17:58.407318  4186 leader_election.cc:343] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:58.408246  4187 leader_election.cc:343] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.408607  4376 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.408757  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:58.410948  4416 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.411335  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.409577  4340 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.410645  4376 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.411983  4341 tablet_bootstrap.cc:654] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.412133  4296 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:58.409966  4373 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.414005  4376 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.414500  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.416841  4340 ts_tablet_manager.cc:1434] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:17:58.418082  4340 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.421710  4186 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:58.423779  4433 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:58.424382  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.424764  4340 tablet_bootstrap.cc:654] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.425160  4147 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:58.426446  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.427380  4296 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:58.432271  4340 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.432969  4340 ts_tablet_manager.cc:1403] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.009s
I20260709 13:17:58.432886  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:58.436647  4373 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.437103  4373 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.437501  4373 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.437328  4340 raft_consensus.cc:359] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.438171  4340 raft_consensus.cc:385] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.438498  4340 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
W20260709 13:17:58.438580  4187 leader_election.cc:343] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.439267  4340 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.440954  4339 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:58.441514  4339 ts_tablet_manager.cc:1403] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.011s
I20260709 13:17:58.441830  4340 ts_tablet_manager.cc:1434] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:58.442349  4416 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.442727  4416 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.442904  4340 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.443077  4416 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.459033  4340 tablet_bootstrap.cc:654] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.461745  4341 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:58.464951  4341 ts_tablet_manager.cc:1403] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.017s
I20260709 13:17:58.473784  4340 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.474445  4340 ts_tablet_manager.cc:1403] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.006s
I20260709 13:17:58.474542  4376 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.475044  4339 raft_consensus.cc:359] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.475116  4376 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.476073  4339 raft_consensus.cc:385] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.476440  4339 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.477383  4339 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.477932  4340 raft_consensus.cc:359] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.478623  4340 raft_consensus.cc:385] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.478920  4340 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.479799  4339 ts_tablet_manager.cc:1434] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:17:58.479665  4340 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.479730  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.480973  4339 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
W20260709 13:17:58.482506  4186 leader_election.cc:343] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.483335  4376 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.483197  4341 raft_consensus.cc:359] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.488201  4341 raft_consensus.cc:385] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.488741  4341 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.489598  4341 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.482668  4340 ts_tablet_manager.cc:1434] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:58.490516  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.491415  4340 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.473940  4373 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.494138  4416 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.496007  4339 tablet_bootstrap.cc:654] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.496663  4433 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:58.497862  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:58.499941  4295 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.503791  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:58.504472  4416 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.504716  4294 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.509706  4339 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:58.510313  4339 ts_tablet_manager.cc:1403] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.000s
I20260709 13:17:58.513366  4294 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:58.513542  4416 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.514173  4341 ts_tablet_manager.cc:1434] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:17:58.514148  4416 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.514904  4186 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:58.513381  4339 raft_consensus.cc:359] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.517057  4339 raft_consensus.cc:385] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.517234  4376 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.517403  4339 raft_consensus.cc:740] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.517812  4376 raft_consensus.cc:697] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:17:58.518764  4376 consensus_queue.cc:237] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.520268  4416 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.521270  4339 consensus_queue.cc:260] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.521934  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:58.523466  4186 leader_election.cc:343] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.523813  4339 ts_tablet_manager.cc:1434] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:58.525103  4339 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:58.527031  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:58.527365  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.527951  4146 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.528112  4145 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:58.503707  4373 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:17:58.530759  4187 leader_election.cc:343] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.531309  4187 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:58.531473  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:58.532151  4147 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.532328  4416 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.533414  4416 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.533958  4416 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.534838  4340 tablet_bootstrap.cc:654] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.540593  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:58.541942  4373 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.542392  4373 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.542958  4373 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.544555  4416 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.546063  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.547122  4294 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:58.548485  4341 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:58.553517  4186 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:58.554803  4416 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.555244  4416 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.555624  4416 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.544557  4146 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:58.569862  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.556468  4295 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:58.578516  4362 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.581225  4362 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.584836  4362 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:58.574400  4147 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:58.588550  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:58.603574  4433 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:58.610867  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.614936  4341 tablet_bootstrap.cc:654] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.613173  4147 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:58.635249  4373 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.613849  4344 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:58.616439  4187 leader_election.cc:343] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:58.651031  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 62683.1us
I20260709 13:17:58.654959  4416 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.656090  4340 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:58.656764  4339 tablet_bootstrap.cc:654] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.656800  4340 ts_tablet_manager.cc:1403] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.006s
I20260709 13:17:58.662626  4373 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.663048  4340 raft_consensus.cc:359] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.663880  4340 raft_consensus.cc:385] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.664217  4340 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.664858  4340 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.664646  4362 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.670042  4362 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.672734  4340 ts_tablet_manager.cc:1434] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:17:58.684999  4340 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:58.660763  4344 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:17:58.672819  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:58.672266  4362 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:58.674342  4416 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.676838  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:58.684768  4433 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.677328  4346 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:17:58.686115  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.696921  4222 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:58.698544  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:58.697151  4146 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.702389  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:58.697989  4433 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:17:58.708941  4187 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.710021  4187 leader_election.cc:343] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.710705  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:58.711925  4344 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.713332  4433 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.697808  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:58.718943  4362 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.720563  4362 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.720963  4362 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.722008  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:58.722751  4295 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.730847  4339 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:58.731617  4339 ts_tablet_manager.cc:1403] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.207s	user 0.007s	sys 0.011s
I20260709 13:17:58.724377  4042 catalog_manager.cc:5697] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.745426  4146 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:58.756320  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.772073  4341 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:58.772702  4341 ts_tablet_manager.cc:1403] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.252s	user 0.021s	sys 0.018s
I20260709 13:17:58.773459  4346 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.774233  4346 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.775729  4341 raft_consensus.cc:359] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.776513  4341 raft_consensus.cc:385] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.776803  4341 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.779803  4341 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.765534  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:58.784545  4339 raft_consensus.cc:359] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.785693  4339 raft_consensus.cc:385] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.784420  4346 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.786114  4339 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.788074  4339 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.787328  4384 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:17:58.798987  4339 ts_tablet_manager.cc:1434] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.067s	user 0.011s	sys 0.000s
W20260709 13:17:58.786300  4186 leader_election.cc:343] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.790802  4416 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.794380  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:58.803851  4416 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:17:58.795668  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:58.804932  4416 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.795889  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:58.794934  4295 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:17:58.805788  4346 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.813630  4296 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:58.810842  4222 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:58.815011  4341 ts_tablet_manager.cc:1434] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.007s
I20260709 13:17:58.815521  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:58.815424  4362 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.816118  4341 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:58.816696  4346 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.817076  4346 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.817417  4346 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.818073  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.825676  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:58.827224  4222 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:58.831279  4339 tablet_bootstrap.cc:492] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:58.831797  4146 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:58.832830  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 66970.3us
I20260709 13:17:58.836026  4344 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:17:58.842303  4362 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:58.836418  4186 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:58.858759  4344 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.859254  4340 tablet_bootstrap.cc:654] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.859421  4344 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:17:58.865374  4362 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.866142  4362 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.868731  4362 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:58.860451  4344 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.873150  4339 tablet_bootstrap.cc:654] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:58.880263  4261 leader_election.cc:343] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.883348  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:58.900795  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:58.901702  4218 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.884286  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:58.915493  4346 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:58.918037  4341 tablet_bootstrap.cc:654] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.918969  4346 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:58.958830  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:58.894313  4147 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.911168  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:58.971936  4485 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.972851  4485 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.973625  4485 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.978070  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:17:58.971235  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 86849.1us
I20260709 13:17:58.979918  4222 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.990896  4340 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:59.036073  4340 ts_tablet_manager.cc:1403] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.351s	user 0.024s	sys 0.016s
I20260709 13:17:59.035812  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:59.045622  4295 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.047127  4341 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:59.058441  4295 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:59.048095  4341 ts_tablet_manager.cc:1403] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.005s
I20260709 13:17:59.043797  4218 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:59.062768  4416 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.064446  4339 tablet_bootstrap.cc:492] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:59.065438  4339 ts_tablet_manager.cc:1403] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.234s	user 0.018s	sys 0.003s
W20260709 13:17:59.070863  4261 leader_election.cc:343] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.060015  4147 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:59.081905  4340 raft_consensus.cc:359] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.082877  4340 raft_consensus.cc:385] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.083285  4340 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
W20260709 13:17:59.085382  4261 leader_election.cc:343] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.084204  4340 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.089888  4340 ts_tablet_manager.cc:1434] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:17:59.091758  4340 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:59.092549  4341 raft_consensus.cc:359] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.093430  4341 raft_consensus.cc:385] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.093279  4416 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.093797  4341 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.094637  4341 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.095258  4222 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:59.097144  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:59.085994  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:17:59.099642  4433 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:59.100126  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:59.100260  4433 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:17:59.102337  4485 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.102955  4433 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.105481  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:59.106025  4484 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.107029  4484 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.107643  4484 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:59.114001  4484 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.116665  4043 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.122536  4339 raft_consensus.cc:359] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.129487  4043 catalog_manager.cc:5697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.131072  4341 ts_tablet_manager.cc:1434] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:17:59.131685  4339 raft_consensus.cc:385] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.132788  4339 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.134263  4339 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.141999  4341 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:59.147689  4339 ts_tablet_manager.cc:1434] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.002s
I20260709 13:17:59.150148  4485 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:59.174247  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:59.175251  4220 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.183568  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:59.190172  4340 tablet_bootstrap.cc:654] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:59.191697  4261 leader_election.cc:343] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.204824  4339 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:59.210548  4220 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:59.213102  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:59.214162  4484 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.214758  4484 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:59.215831  4484 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.217895  4341 tablet_bootstrap.cc:654] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.221176  4340 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:59.221804  4340 ts_tablet_manager.cc:1403] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.006s
I20260709 13:17:59.225210  4340 raft_consensus.cc:359] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.226035  4340 raft_consensus.cc:385] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.226352  4340 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.229743  4476 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.229898  4340 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.233016  4339 tablet_bootstrap.cc:654] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.244995  4416 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.250913  4380 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.251784  4380 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:17:59.253142  4186 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:59.257285  4339 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:59.257931  4339 ts_tablet_manager.cc:1403] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.005s
I20260709 13:17:59.257886  4380 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.258581  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:59.259420  4220 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:59.261077  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:59.261504  4339 raft_consensus.cc:359] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.262223  4339 raft_consensus.cc:385] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.262506  4339 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.263248  4339 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.265126  4476 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.266364  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:59.267124  4296 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:59.267269  4433 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.267673  4433 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.268036  4433 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.281842  4339 ts_tablet_manager.cc:1434] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:17:59.283347  4339 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:59.291996  4339 tablet_bootstrap.cc:654] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.292069  4433 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.296139  4341 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:59.297261  4341 ts_tablet_manager.cc:1403] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.156s	user 0.032s	sys 0.028s
I20260709 13:17:59.300411  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:59.301165  4220 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.301586  4341 raft_consensus.cc:359] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.302352  4341 raft_consensus.cc:385] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.302664  4341 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.303671  4341 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.294118  4042 catalog_manager.cc:5697] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.306618  4341 ts_tablet_manager.cc:1434] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:59.305971  4042 catalog_manager.cc:5697] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.308194  4341 tablet_bootstrap.cc:492] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:59.309592  4340 ts_tablet_manager.cc:1434] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.000s
I20260709 13:17:59.310977  4340 tablet_bootstrap.cc:492] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:59.313998  4433 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.316186  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:59.316928  4295 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.318049  4339 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:59.318627  4339 ts_tablet_manager.cc:1403] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.010s
I20260709 13:17:59.326826  4341 tablet_bootstrap.cc:654] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.326591  4339 raft_consensus.cc:359] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.327690  4339 raft_consensus.cc:385] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.328122  4339 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.329035  4339 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.330055  4295 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:59.331704  4339 ts_tablet_manager.cc:1434] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:59.333070  4339 tablet_bootstrap.cc:492] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:59.332257  4111 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:59.334055  4433 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.334791  4433 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:17:59.336773  4380 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.336189  4433 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.337528  4380 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.342129  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:59.343855  4339 tablet_bootstrap.cc:654] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.345343  4380 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.348886  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:59.351802  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:59.353042  4380 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.356266  4146 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.367408  4220 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:17:59.363695  4045 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.380475  4362 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.381860  4362 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.385603  4362 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:59.390096  4416 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.399302  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:59.400501  4220 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:17:59.402323  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:17:59.403465  4362 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.403899  4362 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.404266  4362 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.426115  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:59.427287  4340 tablet_bootstrap.cc:654] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:59.428558  4261 leader_election.cc:343] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.435137  4339 tablet_bootstrap.cc:492] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:59.435930  4339 ts_tablet_manager.cc:1403] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.029s
I20260709 13:17:59.411284  4043 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.444160  4362 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.447402  4362 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:17:59.453197  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:17:59.454268  4218 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.461020  4475 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:59.462028  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:59.462330  4339 raft_consensus.cc:359] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.463039  4339 raft_consensus.cc:385] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.463366  4339 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.464177  4339 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:17:59.464075  4261 leader_election.cc:343] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.468004  4339 ts_tablet_manager.cc:1434] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.002s
I20260709 13:17:59.480666  4341 tablet_bootstrap.cc:492] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:17:59.481622  4341 ts_tablet_manager.cc:1403] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.174s	user 0.033s	sys 0.042s
I20260709 13:17:59.488982  4339 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:59.496590  4218 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:17:59.501300  4340 tablet_bootstrap.cc:492] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:59.502202  4340 ts_tablet_manager.cc:1403] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.192s	user 0.017s	sys 0.014s
I20260709 13:17:59.498521  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:59.508721  4362 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.512104  4362 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:17:59.514895  4433 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.517869  4433 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.509951  4341 raft_consensus.cc:359] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.518774  4341 raft_consensus.cc:385] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.519075  4341 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.522410  4341 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.524323  4433 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.526160  4362 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.527334  4341 ts_tablet_manager.cc:1434] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:17:59.528680  4341 tablet_bootstrap.cc:492] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:17:59.531052  4340 raft_consensus.cc:359] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.533427  4340 raft_consensus.cc:385] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.533721  4340 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.532608  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:59.537953  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:59.538681  4339 tablet_bootstrap.cc:654] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.539516  4340 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.545332  4045 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.548149  4340 ts_tablet_manager.cc:1434] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.005s
I20260709 13:17:59.549132  4147 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.549394  4340 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:59.555166  4341 tablet_bootstrap.cc:654] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.554997  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:59.563374  4380 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.567919  4475 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.568737  4475 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.573132  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:59.574805  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:17:59.575021  4187 leader_election.cc:343] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.575682  4295 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:59.577055  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:59.577422  4339 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:59.577981  4339 ts_tablet_manager.cc:1403] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.008s
I20260709 13:17:59.578105  4476 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.578506  4476 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.578928  4476 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.581745  4340 tablet_bootstrap.cc:654] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.584501  4475 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.586234  4339 raft_consensus.cc:359] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.587071  4339 raft_consensus.cc:385] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.587347  4339 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.588119  4339 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.590679  4339 ts_tablet_manager.cc:1434] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:59.591879  4339 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:59.603540  4339 tablet_bootstrap.cc:654] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.623764  4339 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:59.624318  4339 ts_tablet_manager.cc:1403] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.006s
I20260709 13:17:59.632218  4339 raft_consensus.cc:359] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.633104  4339 raft_consensus.cc:385] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.633406  4339 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.635500  4373 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.636296  4373 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.637117  4339 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.640182  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:59.641010  4147 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:59.642503  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:59.644172  4433 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.645246  4416 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.645673  4416 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.646059  4416 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.655681  4362 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.656421  4485 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.661638  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:59.665361  4373 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:17:59.667658  4186 leader_election.cc:343] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.673748  4339 ts_tablet_manager.cc:1434] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:17:59.675114  4339 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:17:59.675630  4433 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.685511  4433 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.686147  4433 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.688921  4433 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.685060  4042 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.695592  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:59.700946  4485 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.704401  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:59.705757  4339 tablet_bootstrap.cc:654] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.708909  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:17:59.712247  4433 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.719031  4475 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.720189  4475 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.725175  4475 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.726452  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:17:59.726822  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:17:59.711616  4476 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.744741  4296 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:17:59.761241  4146 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:59.764286  4187 leader_election.cc:343] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.769466  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:17:59.774319  4416 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.845441  4340 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:17:59.845929  4476 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.846074  4340 ts_tablet_manager.cc:1403] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.297s	user 0.030s	sys 0.031s
I20260709 13:17:59.846624  4476 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.847043  4476 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.847411  4476 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.851415  4144 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:59.850567  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84369.3us
I20260709 13:17:59.855152  4340 raft_consensus.cc:359] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.855978  4340 raft_consensus.cc:385] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.856310  4340 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.857451  4340 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.857354  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:59.866235  4339 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:17:59.867460  4339 ts_tablet_manager.cc:1403] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.193s	user 0.026s	sys 0.086s
I20260709 13:17:59.873927  4341 tablet_bootstrap.cc:492] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
W20260709 13:17:59.861191  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 91892.5us
I20260709 13:17:59.875856  4340 ts_tablet_manager.cc:1434] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.029s	user 0.000s	sys 0.007s
I20260709 13:17:59.876874  4341 ts_tablet_manager.cc:1403] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.349s	user 0.011s	sys 0.010s
I20260709 13:17:59.881625  4433 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.882280  4433 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.886487  4524 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.908058  4340 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:17:59.910254  4476 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:17:59.912750  4187 leader_election.cc:343] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.913470  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:17:59.930624  4295 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:59.937598  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51186.9us
I20260709 13:17:59.940666  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:17:59.916646  4339 raft_consensus.cc:359] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.941891  4339 raft_consensus.cc:385] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.948653  4339 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.952266  4339 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.943032  4218 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:17:59.954124  4341 raft_consensus.cc:359] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.957698  4341 raft_consensus.cc:385] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.958218  4341 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.944123  4476 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.965675  4485 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.967197  4416 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.957079  4433 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:17:59.969908  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:17:59.976118  4340 tablet_bootstrap.cc:654] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.977887  4339 ts_tablet_manager.cc:1434] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.001s
I20260709 13:17:59.967648  4341 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:17:59.982149  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:59.983316  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:17:59.984037  4143 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.984452  4532 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.995157  4433 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.995954  4433 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.996572  4433 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.003479  4339 tablet_bootstrap.cc:492] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:00.008508  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:00.012605  4341 ts_tablet_manager.cc:1434] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.135s	user 0.012s	sys 0.014s
I20260709 13:18:00.013792  4295 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:00.021477  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:00.022231  4294 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:00.022245  4187 leader_election.cc:343] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.036628  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:00.049265  4341 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:00.052414  4143 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:00.056018  4433 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.095075  4340 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:00.095606  4340 ts_tablet_manager.cc:1403] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.188s	user 0.010s	sys 0.032s
I20260709 13:18:00.097400  4484 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:00.099015  4111 leader_election.cc:343] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:00.100553  4261 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.111950  4339 tablet_bootstrap.cc:654] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.113101  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:00.093189  4294 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:00.117784  4416 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:00.115345  4186 leader_election.cc:343] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.125617  4416 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:00.128108  4416 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.134923  4433 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.136214  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:00.138561  4220 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.141855  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:00.143494  4476 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.144059  4476 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:00.145012  4476 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.154742  4433 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.160750  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:00.162760  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:00.164325  4522 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.164883  4522 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:00.162611  4433 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.165760  4522 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.168856  4340 raft_consensus.cc:359] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.169709  4340 raft_consensus.cc:385] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.170130  4340 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.172212  4340 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.179863  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:00.187088  4221 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:00.204332  4433 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.209250  4112 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:00.210888  4433 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.228044  4340 ts_tablet_manager.cc:1434] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.132s	user 0.010s	sys 0.000s
I20260709 13:18:00.237057  4341 tablet_bootstrap.cc:654] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:00.201839  4111 leader_election.cc:343] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.245110  4340 tablet_bootstrap.cc:492] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:00.219539  4433 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:00.246335  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48445us
I20260709 13:18:00.261077  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:00.247357  4433 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:00.278769  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:00.300992  4220 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:00.301451  4341 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:00.302008  4341 ts_tablet_manager.cc:1403] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.253s	user 0.024s	sys 0.025s
I20260709 13:18:00.302724  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:00.303603  4111 leader_election.cc:343] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.304005  4532 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.304636  4532 raft_consensus.cc:697] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:00.305522  4532 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.306310  4433 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.309020  4433 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.310155  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:00.310827  4220 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.311748  4339 tablet_bootstrap.cc:492] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:00.317169  4339 ts_tablet_manager.cc:1403] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.331s	user 0.019s	sys 0.029s
I20260709 13:18:00.320820  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:00.321341  4339 raft_consensus.cc:359] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.322304  4339 raft_consensus.cc:385] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.322912  4339 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.332739  4341 raft_consensus.cc:359] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.333840  4341 raft_consensus.cc:385] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.334174  4341 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.334973  4341 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.337396  4341 ts_tablet_manager.cc:1434] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 13:18:00.339107  4341 tablet_bootstrap.cc:492] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:00.325385  4339 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:00.324460  4111 leader_election.cc:343] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.344864  4044 catalog_manager.cc:5697] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.347987  4340 tablet_bootstrap.cc:654] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.342344  4220 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:00.351207  4112 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:00.352415  4485 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.352919  4485 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.355505  4485 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:00.358029  4339 ts_tablet_manager.cc:1434] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:18:00.360261  4339 tablet_bootstrap.cc:492] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:00.355190  4532 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.365283  4341 tablet_bootstrap.cc:654] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.362969  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:00.370860  4532 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:00.374584  4532 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.378327  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:00.385753  4042 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.387737  4042 catalog_manager.cc:5697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.388222  4220 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:00.390821  4042 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.396951  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:00.399232  4485 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.410388  4485 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.414350  4340 tablet_bootstrap.cc:492] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:00.415434  4340 ts_tablet_manager.cc:1403] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.008s
I20260709 13:18:00.419391  4485 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.419241  4340 raft_consensus.cc:359] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.420310  4340 raft_consensus.cc:385] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.420801  4340 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.420192  4485 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.421903  4340 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.423210  4339 tablet_bootstrap.cc:654] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.424408  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:00.423429  4485 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:00.427887  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:00.435354  4340 ts_tablet_manager.cc:1434] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:18:00.442718  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:00.447073  4485 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.448719  4340 tablet_bootstrap.cc:492] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:00.452628  4294 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.454952  4341 tablet_bootstrap.cc:492] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:00.456557  4341 ts_tablet_manager.cc:1403] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.024s
I20260709 13:18:00.461314  4340 tablet_bootstrap.cc:654] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.466969  4042 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.470392  4341 raft_consensus.cc:359] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.478581  4341 raft_consensus.cc:385] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.479053  4341 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.483322  4340 tablet_bootstrap.cc:492] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:00.485945  4339 tablet_bootstrap.cc:492] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:00.486552  4339 ts_tablet_manager.cc:1403] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.127s	user 0.020s	sys 0.008s
I20260709 13:18:00.490366  4340 ts_tablet_manager.cc:1403] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.003s
I20260709 13:18:00.489887  4339 raft_consensus.cc:359] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.492408  4339 raft_consensus.cc:385] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.491807  4341 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.492758  4339 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.493593  4339 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.495864  4341 ts_tablet_manager.cc:1434] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.004s
I20260709 13:18:00.496170  4339 ts_tablet_manager.cc:1434] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:00.497305  4341 tablet_bootstrap.cc:492] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:00.497457  4339 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:00.502612  4340 raft_consensus.cc:359] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.503362  4340 raft_consensus.cc:385] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.503654  4340 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.504326  4340 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.506685  4340 ts_tablet_manager.cc:1434] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:18:00.522622  4340 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:00.527855  4532 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.529350  4532 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.531772  4532 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.533806  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:00.534600  4220 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:00.534688  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:00.538941  4294 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:00.538043  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:00.542780  4532 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.543316  4532 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.543869  4532 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.545809  4341 tablet_bootstrap.cc:654] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.547458  4340 tablet_bootstrap.cc:654] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.550482  4339 tablet_bootstrap.cc:654] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.553779  4532 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.558025  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:00.558876  4220 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.559789  4341 tablet_bootstrap.cc:492] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:00.560400  4341 ts_tablet_manager.cc:1403] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.002s
I20260709 13:18:00.567502  4532 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.569979  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:00.570740  4293 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.571897  4339 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:00.573132  4339 ts_tablet_manager.cc:1403] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.006s
I20260709 13:18:00.573261  4340 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:00.573890  4340 ts_tablet_manager.cc:1403] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.052s	user 0.002s	sys 0.016s
I20260709 13:18:00.564167  4341 raft_consensus.cc:359] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.577250  4341 raft_consensus.cc:385] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.577579  4341 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.577697  4340 raft_consensus.cc:359] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.580549  4340 raft_consensus.cc:385] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.581064  4340 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.581261  4293 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:00.578385  4341 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.581969  4340 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.579041  4339 raft_consensus.cc:359] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.582974  4339 raft_consensus.cc:385] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.583388  4339 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.584545  4340 ts_tablet_manager.cc:1434] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:00.585719  4341 ts_tablet_manager.cc:1434] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:18:00.580055  4220 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:00.587467  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:00.588439  4532 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.588953  4532 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:00.589862  4532 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.593097  4341 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:00.584252  4339 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.585747  4340 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:00.601783  4341 tablet_bootstrap.cc:654] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.603605  4339 ts_tablet_manager.cc:1434] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:18:00.604964  4339 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:00.607031  4340 tablet_bootstrap.cc:654] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:00.612143  4186 consensus_peers.cc:597] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.622140  4416 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.625221  4475 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.625716  4339 tablet_bootstrap.cc:654] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.628101  4042 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.636425  4341 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:00.640928  4341 ts_tablet_manager.cc:1403] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.004s
I20260709 13:18:00.642387  4146 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.644531  4341 raft_consensus.cc:359] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.645486  4341 raft_consensus.cc:385] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.645833  4341 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.646875  4341 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.649281  4341 ts_tablet_manager.cc:1434] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:00.655777  4341 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:00.665525  4341 tablet_bootstrap.cc:654] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.671787  4416 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.675668  4416 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.709431  4145 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.716329  4341 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:00.720937  4341 ts_tablet_manager.cc:1403] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.011s
I20260709 13:18:00.726882  4341 raft_consensus.cc:359] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.723264  4340 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:00.729132  4340 ts_tablet_manager.cc:1403] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.002s
I20260709 13:18:00.732090  4340 raft_consensus.cc:359] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.732872  4340 raft_consensus.cc:385] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.733126  4340 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.733794  4340 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.735661  4340 ts_tablet_manager.cc:1434] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:00.737257  4340 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:00.744468  4341 raft_consensus.cc:385] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.744866  4341 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.746665  4341 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.749264  4341 ts_tablet_manager.cc:1434] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
I20260709 13:18:00.750568  4341 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:00.755043  4567 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.755264  4532 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.756196  4567 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.757236  4339 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:00.757882  4339 ts_tablet_manager.cc:1403] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.153s	user 0.030s	sys 0.009s
I20260709 13:18:00.749061  4569 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:18:00.760576  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:00.761370  4293 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:00.762928  4186 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:00.763942  4569 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.764433  4569 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.764880  4569 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.772156  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:00.776064  4340 tablet_bootstrap.cc:654] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.779640  4567 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.783919  4567 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.784550  4567 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.779526  4341 tablet_bootstrap.cc:654] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.787470  4567 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.783346  4339 raft_consensus.cc:359] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.788789  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:00.789196  4339 raft_consensus.cc:385] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.789103  4532 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:00.790736  4186 leader_election.cc:343] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:00.791038  4187 leader_election.cc:343] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.789671  4339 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.795861  4339 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.798352  4339 ts_tablet_manager.cc:1434] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:18:00.799679  4339 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:00.802423  4340 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:00.803232  4340 ts_tablet_manager.cc:1403] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.066s	user 0.000s	sys 0.014s
I20260709 13:18:00.804797  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:00.807408  4187 leader_election.cc:343] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.808815  4569 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.807900  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:00.814934  4568 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.819749  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:00.821288  4187 leader_election.cc:343] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.822045  4341 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:00.822685  4341 ts_tablet_manager.cc:1403] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.004s
I20260709 13:18:00.826046  4341 raft_consensus.cc:359] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.829373  4341 raft_consensus.cc:385] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.812536  4340 raft_consensus.cc:359] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.829932  4340 raft_consensus.cc:385] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.832739  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:00.833436  4296 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.828855  4569 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.830276  4340 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.841022  4340 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.845285  4340 ts_tablet_manager.cc:1434] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.004s
I20260709 13:18:00.845774  4341 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.848353  4296 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:00.849885  4186 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:00.850813  4568 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.849285  4341 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.851394  4568 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:00.852391  4568 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.856796  4569 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.857456  4569 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.857924  4339 tablet_bootstrap.cc:654] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.861156  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:00.851257  4340 tablet_bootstrap.cc:492] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
W20260709 13:18:00.862537  4187 leader_election.cc:343] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.863914  4569 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.864612  4341 ts_tablet_manager.cc:1434] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.002s
I20260709 13:18:00.865156  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:00.865782  4341 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
W20260709 13:18:00.866945  4186 leader_election.cc:343] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.867621  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:00.868674  4569 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.874667  4341 tablet_bootstrap.cc:654] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.881201  4295 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.895012  4339 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:00.895634  4339 ts_tablet_manager.cc:1403] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.000s
I20260709 13:18:00.897514  4340 tablet_bootstrap.cc:654] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.898690  4339 raft_consensus.cc:359] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.899523  4339 raft_consensus.cc:385] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.899830  4339 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.904325  4433 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.906917  4340 tablet_bootstrap.cc:492] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:00.907506  4340 ts_tablet_manager.cc:1403] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.005s
I20260709 13:18:00.912189  4341 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:00.911194  4042 catalog_manager.cc:5697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.912782  4341 ts_tablet_manager.cc:1403] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.006s
I20260709 13:18:00.913491  4339 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.914623  4433 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.915119  4433 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.919726  4341 raft_consensus.cc:359] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.920557  4341 raft_consensus.cc:385] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.920827  4341 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.921300  4532 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.921801  4532 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.921994  4341 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.925276  4341 ts_tablet_manager.cc:1434] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:18:00.926479  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:00.926736  4340 raft_consensus.cc:359] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.927428  4340 raft_consensus.cc:385] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.927747  4340 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.930251  4532 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:00.930536  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:00.928627  4340 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.933277  4339 ts_tablet_manager.cc:1434] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.005s
I20260709 13:18:00.933126  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:00.934831  4532 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.935953  4340 ts_tablet_manager.cc:1434] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 13:18:00.937100  4339 tablet_bootstrap.cc:492] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:00.926484  4341 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:00.941387  4340 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:00.948503  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:00.950940  4220 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:00.965077  4485 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.965975  4485 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:00.970805  4485 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.018195  4484 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.019129  4484 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.023286  4484 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.084620  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:01.085373  4147 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:01.089764  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:01.091734  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:01.094195  4530 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.094630  4530 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.094992  4530 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.095588  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.096374  4222 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:01.097137  4147 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.099022  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:01.101758  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.107990  4584 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.108614  4584 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.108985  4584 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.115025  4341 tablet_bootstrap.cc:654] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.113236  4433 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:01.128867  4485 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.133776  4485 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.147046  4340 tablet_bootstrap.cc:654] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:01.153136  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47213.3us
I20260709 13:18:01.189936  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:01.182122  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:01.183495  4485 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.157979  4530 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.207415  4261 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:01.210279  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.211174  4221 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:01.213083  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:01.209193  4589 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.214233  4588 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:01.224318  4261 leader_election.cc:343] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.226490  4530 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:01.232129  4339 tablet_bootstrap.cc:654] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.227864  4588 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.253019  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:01.248209  4588 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.268626  4289 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.276615  4340 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:01.277278  4340 ts_tablet_manager.cc:1403] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.339s	user 0.028s	sys 0.013s
I20260709 13:18:01.278676  4341 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:01.279290  4341 ts_tablet_manager.cc:1403] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.353s	user 0.022s	sys 0.030s
I20260709 13:18:01.285456  4590 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.288995  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:01.289733  4221 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.290445  4584 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.294603  4296 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:01.294471  4433 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:01.299437  4584 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.315662  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:01.317289  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:01.318223  4145 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:01.318709  4339 tablet_bootstrap.cc:492] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:01.319258  4339 ts_tablet_manager.cc:1403] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.382s	user 0.012s	sys 0.010s
I20260709 13:18:01.320921  4340 raft_consensus.cc:359] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.321830  4340 raft_consensus.cc:385] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.321957  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:01.322166  4340 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.323434  4485 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.323371  4340 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.322953  4341 raft_consensus.cc:359] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.326929  4341 raft_consensus.cc:385] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.327457  4341 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.328979  4340 ts_tablet_manager.cc:1434] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:18:01.328801  4341 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.332904  4341 ts_tablet_manager.cc:1434] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.002s
I20260709 13:18:01.337244  4476 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.337877  4476 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:01.339542  4187 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.340903  4476 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:01.341915  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:01.343912  4187 leader_election.cc:343] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.347798  4341 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:01.371697  4340 tablet_bootstrap.cc:492] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:01.421020  4339 raft_consensus.cc:359] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.421828  4339 raft_consensus.cc:385] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.422205  4339 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.424095  4339 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.431329  4339 ts_tablet_manager.cc:1434] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.006s
I20260709 13:18:01.431234  4568 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:01.432569  4339 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:01.412096  4476 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.441674  4476 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.429800  4532 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:18:01.454180  4476 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:01.456254  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:01.451683  4221 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:01.465029  4340 tablet_bootstrap.cc:654] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.474745  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:01.483513  4588 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.488667  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:01.491865  4187 leader_election.cc:343] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:01.499634  4186 leader_election.cc:343] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.500437  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:01.502496  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:01.505910  4261 leader_election.cc:343] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.504908  4567 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.516312  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:01.517410  4222 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.518649  4341 tablet_bootstrap.cc:654] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.496675  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:01.523303  4532 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.523900  4532 raft_consensus.cc:697] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:01.520802  4588 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:01.526232  4186 leader_election.cc:343] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.526822  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:01.526258  4532 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:01.530100  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:01.536063  4476 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.545135  4222 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:01.546613  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:01.548898  4584 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.549494  4584 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:01.550367  4584 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:01.542414  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55854us
I20260709 13:18:01.563992  4339 tablet_bootstrap.cc:654] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.590914  4042 catalog_manager.cc:5697] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.605007  4044 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.609740  4340 tablet_bootstrap.cc:492] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:01.610363  4340 ts_tablet_manager.cc:1403] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.239s	user 0.018s	sys 0.008s
I20260709 13:18:01.610530  4341 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:01.611052  4341 ts_tablet_manager.cc:1403] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.264s	user 0.019s	sys 0.061s
I20260709 13:18:01.613694  4340 raft_consensus.cc:359] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.613895  4341 raft_consensus.cc:359] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.615033  4341 raft_consensus.cc:385] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.615551  4341 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.617377  4339 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:01.614836  4340 raft_consensus.cc:385] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.617976  4339 ts_tablet_manager.cc:1403] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.002s
I20260709 13:18:01.618011  4340 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.616912  4341 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.625488  4341 ts_tablet_manager.cc:1434] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:18:01.625021  4340 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.626662  4341 tablet_bootstrap.cc:492] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:01.621321  4339 raft_consensus.cc:359] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.630087  4339 raft_consensus.cc:385] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.630956  4339 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.631896  4339 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.634415  4339 ts_tablet_manager.cc:1434] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:18:01.634788  4341 tablet_bootstrap.cc:654] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.638134  4339 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:01.644085  4340 ts_tablet_manager.cc:1434] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:18:01.645874  4340 tablet_bootstrap.cc:492] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:01.651263  4339 tablet_bootstrap.cc:654] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.652415  4341 tablet_bootstrap.cc:492] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:01.653074  4341 ts_tablet_manager.cc:1403] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 13:18:01.655113  4584 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.655716  4584 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.662170  4341 raft_consensus.cc:359] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.662987  4341 raft_consensus.cc:385] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.663261  4341 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.663522  4339 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:01.664079  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:01.663988  4341 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.664826  4339 ts_tablet_manager.cc:1403] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.002s
W20260709 13:18:01.666029  4261 leader_election.cc:343] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.667579  4341 ts_tablet_manager.cc:1434] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:18:01.668241  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.668792  4341 tablet_bootstrap.cc:492] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:01.668975  4220 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:01.670516  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:01.671412  4485 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.671834  4485 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.672257  4485 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.676539  4591 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.677198  4591 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.681913  4341 tablet_bootstrap.cc:654] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.689296  4591 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:01.690392  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:01.694296  4340 tablet_bootstrap.cc:654] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.694772  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.697156  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:01.667801  4339 raft_consensus.cc:359] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.698750  4532 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.699164  4339 raft_consensus.cc:385] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.699565  4339 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.700488  4339 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.702399  4339 ts_tablet_manager.cc:1434] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:18:01.703516  4339 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:01.708742  4568 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.716126  4568 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.728674  4584 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.735366  4568 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:01.735617  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:01.736543  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:01.722874  4339 tablet_bootstrap.cc:654] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:01.742017  4186 leader_election.cc:343] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:01.746539  4187 leader_election.cc:343] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.748306  4187 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:01.753525  4485 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.754082  4584 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.756619  4568 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.758698  4485 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.760172  4340 tablet_bootstrap.cc:492] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:01.763345  4340 ts_tablet_manager.cc:1403] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.022s
I20260709 13:18:01.764722  4339 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:01.765272  4339 ts_tablet_manager.cc:1403] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.002s
I20260709 13:18:01.766750  4340 raft_consensus.cc:359] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.767540  4340 raft_consensus.cc:385] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.760766  4341 tablet_bootstrap.cc:492] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:01.759904  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:01.769469  4341 ts_tablet_manager.cc:1403] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.101s	user 0.023s	sys 0.041s
I20260709 13:18:01.769666  4146 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.771239  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:01.771971  4221 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.772924  4341 raft_consensus.cc:359] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.760277  4584 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.768258  4339 raft_consensus.cc:359] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.774353  4339 raft_consensus.cc:385] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.774685  4339 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.773763  4341 raft_consensus.cc:385] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.775280  4341 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.767859  4340 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.776863  4340 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.777159  4341 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.779665  4341 ts_tablet_manager.cc:1434] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:01.779948  4340 ts_tablet_manager.cc:1434] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:18:01.781985  4339 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.784308  4146 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:01.785794  4340 tablet_bootstrap.cc:492] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:01.787490  4584 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.788141  4341 tablet_bootstrap.cc:492] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:01.789659  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:01.789633  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:01.791267  4584 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.791019  4146 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:01.792125  4584 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:01.793223  4584 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.796192  4339 ts_tablet_manager.cc:1434] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:18:01.796135  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:01.797217  4485 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.797626  4339 tablet_bootstrap.cc:492] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:01.797923  4485 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.798409  4340 tablet_bootstrap.cc:654] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.798408  4485 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.801937  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.802733  4220 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:01.803668  4341 tablet_bootstrap.cc:654] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.807250  4221 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:01.810758  4339 tablet_bootstrap.cc:654] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.820443  4339 tablet_bootstrap.cc:492] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:01.821168  4339 ts_tablet_manager.cc:1403] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:18:01.824926  4339 raft_consensus.cc:359] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.825558  4339 raft_consensus.cc:385] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.825766  4339 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.826292  4339 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.828220  4339 ts_tablet_manager.cc:1434] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:01.829515  4339 tablet_bootstrap.cc:492] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:01.830753  4341 tablet_bootstrap.cc:492] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:01.831296  4341 ts_tablet_manager.cc:1403] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.007s
I20260709 13:18:01.834988  4485 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.835873  4341 raft_consensus.cc:359] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.838367  4341 raft_consensus.cc:385] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.839035  4341 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.841434  4339 tablet_bootstrap.cc:654] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.840893  4341 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.845865  4485 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.847038  4341 ts_tablet_manager.cc:1434] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:18:01.848289  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:01.849319  4145 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.854390  4339 tablet_bootstrap.cc:492] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:01.855065  4339 ts_tablet_manager.cc:1403] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 13:18:01.859755  4339 raft_consensus.cc:359] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.860603  4339 raft_consensus.cc:385] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.860906  4339 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.861696  4339 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.865448  4591 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.866170  4340 tablet_bootstrap.cc:492] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:01.866093  4591 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.867069  4340 ts_tablet_manager.cc:1403] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.022s
I20260709 13:18:01.868683  4591 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:01.863226  4341 tablet_bootstrap.cc:492] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:01.869433  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.870175  4220 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:01.871645  4339 ts_tablet_manager.cc:1434] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:18:01.872556  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:01.872898  4339 tablet_bootstrap.cc:492] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:01.873342  4296 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:01.873750  4591 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.874293  4591 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.875712  4112 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:01.876668  4590 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.877426  4590 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.877887  4590 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.884613  4484 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.885352  4484 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.887588  4484 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.889675  4340 raft_consensus.cc:359] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.891594  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.889896  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:01.893545  4220 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:01.896678  4340 raft_consensus.cc:385] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.897617  4340 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.898836  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:01.900048  4532 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.900483  4340 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.904062  4341 tablet_bootstrap.cc:654] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.905582  4339 tablet_bootstrap.cc:654] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.884832  4591 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:01.905263  4340 ts_tablet_manager.cc:1434] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 13:18:01.913321  4340 tablet_bootstrap.cc:492] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:01.913014  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:01.922890  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:01.923683  4220 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.927451  4532 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:01.928977  4261 leader_election.cc:343] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.928905  4145 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:01.911154  4590 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.933895  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:01.948246  4147 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.948786  4219 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:01.950351  4532 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:01.933702  4341 tablet_bootstrap.cc:492] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:01.952600  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:01.952971  4341 ts_tablet_manager.cc:1403] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.004s
I20260709 13:18:01.953289  4219 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.960114  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:01.966885  4583 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.967518  4583 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:01.968492  4583 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.967832  4341 raft_consensus.cc:359] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.972623  4341 raft_consensus.cc:385] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.972959  4485 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.973176  4341 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.973616  4485 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.974393  4341 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:01.976298  4485 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:01.979606  4340 tablet_bootstrap.cc:654] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.988755  4220 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:01.992424  4341 ts_tablet_manager.cc:1434] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 13:18:01.994853  4341 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:01.994256  4043 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.001776  4590 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.003832  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:02.004906  4145 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:02.007839  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:18:02.001085  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59589.5us
I20260709 13:18:02.008723  4296 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:02.012745  4248 tablet.cc:2406] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:02.015913  4341 tablet_bootstrap.cc:654] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.016882  4590 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:02.020856  4219 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:02.026680  4339 tablet_bootstrap.cc:492] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:02.027974  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:02.032243  4339 ts_tablet_manager.cc:1403] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.160s	user 0.023s	sys 0.018s
I20260709 13:18:02.032470  4220 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:02.034333  4112 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:02.035705  4339 raft_consensus.cc:359] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.036762  4339 raft_consensus.cc:385] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.037015  4339 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.037685  4339 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.038662  4532 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.039156  4532 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:02.039999  4532 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.042903  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:02.047403  4339 ts_tablet_manager.cc:1434] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:18:02.050988  4339 tablet_bootstrap.cc:492] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:02.060549  4522 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.060840  4296 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:02.061358  4522 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.072185  4583 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.077787  4583 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.078210  4583 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.080091  4339 tablet_bootstrap.cc:654] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.086678  4522 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.087481  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:02.089030  4186 leader_election.cc:343] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.091277  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:02.076865  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:02.093246  4485 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.093716  4485 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.094103  4485 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:02.095162  4187 leader_election.cc:343] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.095670  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:02.096946  4522 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.102813  4485 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.103240  4484 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.105690  4340 tablet_bootstrap.cc:492] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:02.105830  4485 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:02.106389  4340 ts_tablet_manager.cc:1403] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.194s	user 0.021s	sys 0.027s
I20260709 13:18:02.093173  4339 tablet_bootstrap.cc:492] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:02.108769  4339 ts_tablet_manager.cc:1403] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.002s
I20260709 13:18:02.110597  4340 raft_consensus.cc:359] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.111616  4340 raft_consensus.cc:385] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.112025  4340 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.100880  4583 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.117606  4339 raft_consensus.cc:359] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.118428  4339 raft_consensus.cc:385] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.118718  4339 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.119391  4339 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.120963  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:02.121683  4219 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.120973  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:02.124827  4145 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.125913  4339 ts_tablet_manager.cc:1434] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:18:02.127130  4339 tablet_bootstrap.cc:492] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:02.130125  4219 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:02.112975  4340 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.132987  4485 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.132237  4583 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:02.134883  4340 ts_tablet_manager.cc:1434] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:18:02.137391  4340 tablet_bootstrap.cc:492] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:02.138968  4339 tablet_bootstrap.cc:654] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.143356  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:02.144054  4147 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.147259  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:02.147974  4221 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.150071  4341 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:02.150619  4341 ts_tablet_manager.cc:1403] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.156s	user 0.030s	sys 0.017s
I20260709 13:18:02.149663  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:02.151417  4484 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.151911  4484 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:02.152822  4484 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.152628  4044 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.153579  4341 raft_consensus.cc:359] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.154264  4341 raft_consensus.cc:385] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.154526  4341 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.163225  4221 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:02.164114  4340 tablet_bootstrap.cc:654] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.164084  4341 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.169600  4341 ts_tablet_manager.cc:1434] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.005s
I20260709 13:18:02.173106  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:02.177346  4485 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.177945  4485 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:02.179059  4485 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.185539  4341 tablet_bootstrap.cc:492] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:02.187845  4147 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:02.192294  4145 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:02.209937  4339 tablet_bootstrap.cc:492] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:02.211261  4339 ts_tablet_manager.cc:1403] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.012s
I20260709 13:18:02.209187  4044 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.219383  4341 tablet_bootstrap.cc:654] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.220326  4339 raft_consensus.cc:359] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.223076  4340 tablet_bootstrap.cc:492] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:02.227442  4339 raft_consensus.cc:385] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.227860  4340 ts_tablet_manager.cc:1403] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.005s
I20260709 13:18:02.227826  4339 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.229091  4339 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.231375  4339 ts_tablet_manager.cc:1434] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:18:02.231254  4340 raft_consensus.cc:359] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.232209  4340 raft_consensus.cc:385] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.232596  4340 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.233438  4340 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.235827  4340 ts_tablet_manager.cc:1434] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:02.237490  4340 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:02.242986  4043 catalog_manager.cc:5697] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.244971  4340 tablet_bootstrap.cc:654] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.250171  4043 catalog_manager.cc:5697] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.251705  4339 tablet_bootstrap.cc:492] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:02.279655  4341 tablet_bootstrap.cc:492] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:02.283859  4341 ts_tablet_manager.cc:1403] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.029s
I20260709 13:18:02.304556  4340 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:02.305497  4340 ts_tablet_manager.cc:1403] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.005s
I20260709 13:18:02.311398  4341 raft_consensus.cc:359] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.313426  4341 raft_consensus.cc:385] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.313683  4341 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.316591  4341 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.317610  4340 raft_consensus.cc:359] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.318413  4340 raft_consensus.cc:385] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.318673  4340 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.319392  4340 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.319721  4341 ts_tablet_manager.cc:1434] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.003s
I20260709 13:18:02.321979  4340 ts_tablet_manager.cc:1434] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:18:02.322633  4341 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:02.322867  4340 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:02.329298  4340 tablet_bootstrap.cc:654] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.330641  4341 tablet_bootstrap.cc:654] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.347538  4341 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:02.348352  4341 ts_tablet_manager.cc:1403] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.010s
I20260709 13:18:02.355276  4341 raft_consensus.cc:359] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.356320  4341 raft_consensus.cc:385] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.356660  4341 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.357527  4341 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.360796  4341 ts_tablet_manager.cc:1434] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:18:02.362092  4341 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:02.364740  4584 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.365324  4584 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.367883  4584 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:02.369494  4341 tablet_bootstrap.cc:654] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.371054  4339 tablet_bootstrap.cc:654] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.372994  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:02.374418  4261 leader_election.cc:343] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.378242  4340 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:02.378875  4340 ts_tablet_manager.cc:1403] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.006s
I20260709 13:18:02.382085  4341 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:02.382236  4340 raft_consensus.cc:359] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.382697  4341 ts_tablet_manager.cc:1403] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:18:02.383049  4340 raft_consensus.cc:385] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.383468  4340 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.384744  4340 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.389212  4340 ts_tablet_manager.cc:1434] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:18:02.390317  4340 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:02.390280  4341 raft_consensus.cc:359] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.391304  4341 raft_consensus.cc:385] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.391664  4341 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.392544  4341 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.395898  4341 ts_tablet_manager.cc:1434] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:18:02.397276  4341 tablet_bootstrap.cc:492] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:02.398749  4340 tablet_bootstrap.cc:654] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.405397  4341 tablet_bootstrap.cc:654] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.409147  4476 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.409694  4476 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.410475  4340 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:02.410904  4340 ts_tablet_manager.cc:1403] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:18:02.411721  4476 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.418181  4341 tablet_bootstrap.cc:492] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:02.418949  4341 ts_tablet_manager.cc:1403] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:18:02.423043  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:02.422880  4341 raft_consensus.cc:359] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.428992  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:02.431149  4187 leader_election.cc:343] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.464763  4646 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.465497  4646 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.468381  4646 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.469949  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:02.471558  4187 leader_election.cc:343] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.424383  4341 raft_consensus.cc:385] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.507798  4341 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.508517  4341 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.510373  4485 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.510944  4485 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.510339  4341 ts_tablet_manager.cc:1434] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.091s	user 0.012s	sys 0.000s
I20260709 13:18:02.512920  4341 tablet_bootstrap.cc:492] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:02.514019  4485 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:02.520934  4341 tablet_bootstrap.cc:654] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.526714  4341 tablet_bootstrap.cc:492] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:02.527158  4341 ts_tablet_manager.cc:1403] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:18:02.529860  4341 raft_consensus.cc:359] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.530589  4341 raft_consensus.cc:385] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.530890  4341 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.532434  4647 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:02.531590  4341 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.535634  4341 ts_tablet_manager.cc:1434] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:02.537446  4341 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:02.544996  4341 tablet_bootstrap.cc:654] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.550974  4341 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:02.551466  4341 ts_tablet_manager.cc:1403] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.007s
I20260709 13:18:02.554297  4341 raft_consensus.cc:359] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.555018  4341 raft_consensus.cc:385] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.555310  4341 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.555837  4341 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.558318  4341 ts_tablet_manager.cc:1434] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:02.559301  4341 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:02.560854  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:02.561720  4290 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:02.563216  4530 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.563943  4530 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.570698  4340 raft_consensus.cc:359] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.574230  4340 raft_consensus.cc:385] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.574971  4340 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.575690  4341 tablet_bootstrap.cc:654] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.576031  4340 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.577251  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:02.579310  4340 ts_tablet_manager.cc:1434] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.168s	user 0.010s	sys 0.001s
I20260709 13:18:02.581414  4340 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:02.585676  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:02.588776  4218 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:02.590225  4340 tablet_bootstrap.cc:654] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.591885  4530 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.592934  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:02.596055  4530 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.596964  4530 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.597502  4530 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.607098  4522 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.607918  4522 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.609364  4433 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.610126  4433 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.610988  4522 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.614144  4433 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.616904  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:02.617909  4218 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:02.621531  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:02.622685  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:18:02.623386  4186 leader_election.cc:343] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.623538  4532 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.623905  4532 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.623860  4186 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:02.624378  4532 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.624625  4484 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.624850  4568 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.625268  4568 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.625666  4568 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.625399  4484 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.627801  4484 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:02.628754  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:02.631319  4339 tablet_bootstrap.cc:492] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:02.631790  4339 ts_tablet_manager.cc:1403] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.400s	user 0.017s	sys 0.006s
I20260709 13:18:02.632210  4476 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.642343  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:02.642632  4584 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:02.643209  4222 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:02.645815  4639 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:02.647011  4261 leader_election.cc:343] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.647462  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:02.650496  4583 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.654522  4568 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.657915  4568 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.660507  4339 raft_consensus.cc:359] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.661306  4339 raft_consensus.cc:385] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.661585  4339 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.662232  4339 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.665500  4339 ts_tablet_manager.cc:1434] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.004s
I20260709 13:18:02.665283  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:02.665939  4147 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.670535  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:02.677398  4147 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
W20260709 13:18:02.677467  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:02.680035  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:02.696799  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:02.699230  4340 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:02.699901  4340 ts_tablet_manager.cc:1403] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.119s	user 0.034s	sys 0.024s
I20260709 13:18:02.702082  4341 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:02.702577  4341 ts_tablet_manager.cc:1403] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.036s
I20260709 13:18:02.703181  4339 tablet_bootstrap.cc:492] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:02.693897  4584 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.701426  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:02.706678  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:02.701611  4522 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.714619  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:02.717760  4530 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.725028  4522 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:02.725829  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:02.726118  4522 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.726745  4290 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.709990  4584 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.724751  4295 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:02.733945  4485 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.730058  4584 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.734941  4484 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:02.738191  4591 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.741919  4583 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.749490  4341 raft_consensus.cc:359] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.751209  4341 raft_consensus.cc:385] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.751542  4341 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.757757  4653 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:18:02.761215  4341 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.766427  4485 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.766978  4485 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.744623  4568 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.769425  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:02.748463  4583 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.742465  4484 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:18:02.788712  4485 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:02.797292  4341 ts_tablet_manager.cc:1434] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.094s	user 0.010s	sys 0.000s
I20260709 13:18:02.775586  4568 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.806121  4339 tablet_bootstrap.cc:654] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.761346  4656 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:18:02.809437  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:02.810374  4568 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:02.809530  4341 tablet_bootstrap.cc:492] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:02.812605  4340 raft_consensus.cc:359] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.820901  4340 raft_consensus.cc:385] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.821300  4340 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.828492  4217 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:02.830785  4290 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:02.831128  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:02.831815  4220 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.834929  4340 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.845778  4530 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:02.858035  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 105424us
W20260709 13:18:02.870618  4261 leader_election.cc:343] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.847640  4220 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:02.882091  4340 ts_tablet_manager.cc:1434] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.180s	user 0.010s	sys 0.000s
I20260709 13:18:02.845649  4532 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:02.879997  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:02.987227  4340 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:02.989917  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:02.993906  4341 tablet_bootstrap.cc:654] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.995312  4485 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.995803  4485 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.996419  4485 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.003595  4583 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:03.004925  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:03.006320  4532 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:03.012912  4261 leader_election.cc:343] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.986127  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:03.029301  4187 leader_election.cc:343] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.999783  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:02.986510  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:03.035265  4484 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:18:03.037636  4143 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 1: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:03.050089  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:03.088980  4661 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.089555  4661 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:03.104902  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 125700us
I20260709 13:18:03.117005  4591 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.094055  4584 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.136315  4485 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.137434  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:03.138051  4215 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.125828  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:03.141592  4339 tablet_bootstrap.cc:492] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:03.142629  4339 ts_tablet_manager.cc:1403] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.448s	user 0.027s	sys 0.001s
I20260709 13:18:03.143956  4485 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:03.159731  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:03.162357  4187 leader_election.cc:343] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:03.167374  4261 leader_election.cc:343] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:03.185519  4261 leader_election.cc:343] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.186188  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:03.187572  4261 leader_election.cc:343] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.188225  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:03.189932  4485 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.180168  4289 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:18:03.180235  4660 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:18:03.186582  4295 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:03.181893  4656 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.196503  4653 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.213253  4341 tablet_bootstrap.cc:492] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:03.213887  4341 ts_tablet_manager.cc:1403] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.413s	user 0.014s	sys 0.010s
I20260709 13:18:03.210696  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:03.235672  4217 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.209661  4656 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.292675  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:03.293433  4664 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
W20260709 13:18:03.373725  4672 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:18:03.386158  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:03.376227  4215 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:03.406618  4656 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:03.406944  4657 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:18:03.434814  4243 debug-util.cc:398] Leaking SignalData structure 0x7b0800175000 after lost signal to thread 3024
I20260709 13:18:03.474049  4339 raft_consensus.cc:359] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.475188  4339 raft_consensus.cc:385] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.475553  4339 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.510339  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:03.442775  4584 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:03.568135  4341 raft_consensus.cc:359] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.569234  4341 raft_consensus.cc:385] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.569591  4341 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.570673  4341 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.579571  4339 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.582531  4341 ts_tablet_manager.cc:1434] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.368s	user 0.014s	sys 0.006s
W20260709 13:18:03.579059  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08000c29e0 after lost signal to thread 4079
I20260709 13:18:03.584152  4341 tablet_bootstrap.cc:492] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
W20260709 13:18:03.584201  4243 debug-util.cc:398] Leaking SignalData structure 0x7b0800157d60 after lost signal to thread 4171
I20260709 13:18:03.584818  4340 tablet_bootstrap.cc:654] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:03.585507  4243 debug-util.cc:398] Leaking SignalData structure 0x7b0800033760 after lost signal to thread 4246
W20260709 13:18:03.587100  4243 debug-util.cc:398] Leaking SignalData structure 0x7b080026f180 after lost signal to thread 4320
I20260709 13:18:03.589437  4217 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:03.590921  4339 ts_tablet_manager.cc:1434] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.448s	user 0.017s	sys 0.018s
I20260709 13:18:03.594053  4339 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:03.597160  4341 tablet_bootstrap.cc:654] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.601330  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:03.614288  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:03.615154  4221 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:03.623025  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:03.625756  4653 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.626497  4653 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:03.627632  4653 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.632210  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:03.639166  4340 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:03.639810  4340 ts_tablet_manager.cc:1403] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.659s	user 0.019s	sys 0.035s
I20260709 13:18:03.642670  4341 tablet_bootstrap.cc:492] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:03.643426  4341 ts_tablet_manager.cc:1403] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.005s
I20260709 13:18:03.646481  4341 raft_consensus.cc:359] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.647764  4341 raft_consensus.cc:385] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.648110  4341 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.650571  4341 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.667511  4341 ts_tablet_manager.cc:1434] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:18:03.675328  4339 tablet_bootstrap.cc:654] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.675765  4341 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:03.688930  4659 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.689401  4659 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.689747  4659 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.690212  4661 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:03.689811  4340 raft_consensus.cc:359] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.690788  4340 raft_consensus.cc:385] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.691159  4340 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.691891  4340 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:03.687247  4686 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:18:03.712940  4340 ts_tablet_manager.cc:1434] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.001s
I20260709 13:18:03.725114  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:03.728974  4658 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:18:03.727881  4261 leader_election.cc:343] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:03.736611  4261 leader_election.cc:343] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.737399  4659 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.742399  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:03.743993  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:03.744380  4671 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.737229  4042 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.757651  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:03.758365  4675 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.758852  4675 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:03.751129  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:03.760895  4261 leader_election.cc:343] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.740191  4659 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:03.765208  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:18:03.771201  4591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.014s	sys 0.023s
I20260709 13:18:03.774305  4340 tablet_bootstrap.cc:492] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
W20260709 13:18:03.772531  4591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.014s	sys 0.023s
I20260709 13:18:03.781224  4675 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.787554  4679 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.773967  4530 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:03.789713  4339 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:03.776723  4568 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:03.794061  4568 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.794481  4530 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.801093  4530 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:03.802841  4339 ts_tablet_manager.cc:1403] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.209s	user 0.013s	sys 0.007s
I20260709 13:18:03.803323  4568 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:03.804970  4522 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:03.810802  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:03.792578  4591 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:03.806267  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:03.813937  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:03.807204  4639 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:03.819403  4639 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.823669  4213 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.829272  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:03.829659  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:03.829901  4296 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.816427  4653 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.827317  4639 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:03.841606  4653 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.834259  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:03.847751  4653 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:03.848003  4295 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:03.848451  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:03.851342  4591 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.866089  4339 raft_consensus.cc:359] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.866763  4339 raft_consensus.cc:385] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.867189  4339 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.867815  4339 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.874051  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:03.875842  4339 ts_tablet_manager.cc:1434] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 13:18:03.879010  4296 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:03.882470  4341 tablet_bootstrap.cc:654] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.885874  4340 tablet_bootstrap.cc:654] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.887858  4339 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:03.895737  4213 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
W20260709 13:18:03.913271  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84507.3us
I20260709 13:18:03.919104  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:03.922873  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:03.935454  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:03.939783  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:03.941798  4213 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:03.927049  4656 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.944169  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:03.946116  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:03.944321  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:03.950322  4701 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.956287  4697 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.957475  4340 tablet_bootstrap.cc:492] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:03.957952  4340 ts_tablet_manager.cc:1403] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.195s	user 0.011s	sys 0.008s
I20260709 13:18:03.956804  4697 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.959493  4697 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:03.960835  4186 leader_election.cc:343] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.961283  4186 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:03.955005  4044 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.962283  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:03.965477  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:03.948184  4656 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:03.968366  4646 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.969149  4656 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.967713  4568 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:03.967890  4530 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:03.970290  4261 leader_election.cc:343] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.966931  4679 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.973842  4339 tablet_bootstrap.cc:654] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.978014  4340 raft_consensus.cc:359] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.978760  4340 raft_consensus.cc:385] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.979048  4340 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.985241  4340 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.990401  4701 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.991241  4701 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:03.998155  4701 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:03.999111  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:04.001412  4261 leader_election.cc:343] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.009032  4340 ts_tablet_manager.cc:1434] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.001s
I20260709 13:18:04.010614  4340 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:03.999871  4697 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.007839  4568 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.022512  4568 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.021523  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:04.030771  4339 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:04.043562  4213 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:04.043882  4339 ts_tablet_manager.cc:1403] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.156s	user 0.019s	sys 0.009s
I20260709 13:18:04.043185  4341 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:04.044893  4341 ts_tablet_manager.cc:1403] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.375s	user 0.015s	sys 0.022s
I20260709 13:18:04.042709  4690 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.049889  4690 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.054190  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:04.054975  4291 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:04.054750  4339 raft_consensus.cc:359] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.052409  4568 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.055591  4339 raft_consensus.cc:385] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.055953  4339 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.056787  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:04.056666  4339 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.059026  4339 ts_tablet_manager.cc:1434] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.006s
I20260709 13:18:04.060058  4339 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:04.053586  4690 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.060676  4568 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.061262  4568 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.061731  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:04.061646  4568 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.065963  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:04.066885  4112 leader_election.cc:343] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.068718  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:18:04.071024  4187 leader_election.cc:343] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.071714  4701 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.073874  4701 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.074461  4701 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.072595  4697 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:04.073137  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:04.076862  4291 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:04.074926  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:04.082849  4261 leader_election.cc:343] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.083151  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:04.083905  4690 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.084569  4690 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.084684  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:04.085088  4690 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.085348  4220 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.093430  4341 raft_consensus.cc:359] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.094271  4341 raft_consensus.cc:385] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.094790  4341 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.096402  4341 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.098445  4679 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.101541  4220 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:04.101261  4679 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.103441  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:04.098701  4340 tablet_bootstrap.cc:654] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.104132  4656 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:04.107153  4659 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.107743  4659 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:04.108711  4659 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.109934  4701 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.112011  4701 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:04.112722  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:04.113783  4341 ts_tablet_manager.cc:1434] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.003s
I20260709 13:18:04.114236  4679 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.114806  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:04.115252  4341 tablet_bootstrap.cc:492] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:04.115434  4296 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:04.116644  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:04.120468  4679 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.120922  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:04.123148  4339 tablet_bootstrap.cc:654] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:04.118431  4261 leader_election.cc:343] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.120944  4679 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.126111  4679 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.126892  4568 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.129861  4219 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:04.124099  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:04.139820  4261 consensus_peers.cc:597] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.144426  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:04.138129  4139 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:04.151422  4695 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.152994  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:04.147015  4701 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:18:04.156909  4187 leader_election.cc:343] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.152120  4695 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.160049  4695 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:04.162828  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:04.163738  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:04.164222  4261 leader_election.cc:343] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.165179  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:04.165542  4341 tablet_bootstrap.cc:654] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.167018  4296 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:04.168040  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:04.168826  4646 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:18:04.168956  4261 leader_election.cc:343] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.169574  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:04.167526  4568 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.171361  4695 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.201436  4679 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.202478  4340 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:04.203158  4340 ts_tablet_manager.cc:1403] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.193s	user 0.025s	sys 0.000s
I20260709 13:18:04.183462  4690 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.225467  4679 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.226778  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:04.227325  4296 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.227807  4341 tablet_bootstrap.cc:492] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:04.226667  4340 raft_consensus.cc:359] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.228971  4340 raft_consensus.cc:385] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.229406  4340 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.230458  4340 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.234076  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:04.234805  4142 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.235436  4341 ts_tablet_manager.cc:1403] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.008s
I20260709 13:18:04.244155  4339 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:04.245033  4339 ts_tablet_manager.cc:1403] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.185s	user 0.002s	sys 0.016s
I20260709 13:18:04.240001  4341 raft_consensus.cc:359] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.246389  4341 raft_consensus.cc:385] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.246731  4341 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.247961  4340 ts_tablet_manager.cc:1434] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:18:04.249230  4341 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.250176  4340 tablet_bootstrap.cc:492] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:04.251426  4339 raft_consensus.cc:359] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.252235  4339 raft_consensus.cc:385] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.252571  4339 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.254779  4341 ts_tablet_manager.cc:1434] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.005s
I20260709 13:18:04.253319  4339 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.255833  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:18:04.257391  4112 leader_election.cc:343] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.257753  4339 ts_tablet_manager.cc:1434] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:18:04.259173  4339 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:04.259361  4341 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:04.262205  4690 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.262050  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:04.263136  4291 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.267027  4339 tablet_bootstrap.cc:654] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.263386  4142 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:04.269822  4187 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:04.270642  4679 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.271449  4675 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.274013  4675 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.271083  4340 tablet_bootstrap.cc:654] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.316803  4042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 72) took 1449 ms. Trace:
I20260709 13:18:04.307176  4043 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 78) took 1100 ms. Trace:
I20260709 13:18:04.262127  4296 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:04.271175  4679 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:04.335662  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:04.340050  4220 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 1: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:04.271893  4530 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 13:18:04.320338  4043 rpcz_store.cc:276] 0709 13:18:03.215562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.217226 (+  1664us) service_pool.cc:224] Handling call
0709 13:18:04.307070 (+1089844us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2769,"reported_tablets":2}
I20260709 13:18:04.330467  4291 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:04.349735  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:04.349834  4679 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.352802  4111 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:04.342913  4675 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.353977  4690 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.379298  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:04.319022  4042 rpcz_store.cc:276] 0709 13:18:02.881573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.891679 (+ 10106us) service_pool.cc:224] Handling call
0709 13:18:04.316721 (+1425042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:03.869437 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:03.880439 (+ 11002us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:03.882494 (+  2055us) write_op.cc:435] Acquired schema lock
0709 13:18:03.883528 (+  1034us) tablet.cc:662] Decoding operations
0709 13:18:03.888700 (+  5172us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:03.888768 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:03.888796 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:03.890031 (+  1235us) tablet.cc:701] Row locks acquired
0709 13:18:03.890047 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:18:03.890209 (+   162us) write_op.cc:270] Start()
0709 13:18:03.890325 (+   116us) write_op.cc:276] Timestamp: P: 1783603083890162 usec, L: 0
0709 13:18:03.890352 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:03.902728 (+ 12376us) log.cc:844] Serialized 537 byte log entry
0709 13:18:04.069680 (+166952us) op_driver.cc:464] REPLICATION: finished
0709 13:18:04.155464 (+ 85784us) write_op.cc:301] APPLY: starting
0709 13:18:04.159296 (+  3832us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:04.171941 (+ 12645us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:04.189746 (+ 17805us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:04.190062 (+   316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:04.190237 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:04.190284 (+    47us) write_op.cc:312] APPLY: finished
0709 13:18:04.190525 (+   241us) log.cc:844] Serialized 22 byte log entry
0709 13:18:04.190723 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.190801 (+    78us) write_op.cc:454] Released schema lock
0709 13:18:04.190840 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:04.191241 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.191269 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":92616,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":80541,"apply.run_cpu_time_us":2294,"apply.run_wall_time_us":40646,"num_ops":1,"prepare.queue_time_us":87925,"prepare.run_cpu_time_us":18475,"prepare.run_wall_time_us":99168,"raft.queue_time_us":130272,"raft.run_cpu_time_us":20575,"raft.run_wall_time_us":130981,"replication_time_us":179121,"thread_start_us":211273,"threads_started":4,"wal-append.queue_time_us":48666}]]}
I20260709 13:18:04.392429  4718 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.404611  4341 tablet_bootstrap.cc:654] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.419826  4339 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:04.420563  4339 ts_tablet_manager.cc:1403] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.162s	user 0.028s	sys 0.021s
I20260709 13:18:04.409149  4718 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:04.417996  4591 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:18:04.445269  4339 raft_consensus.cc:359] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.447556  4340 tablet_bootstrap.cc:492] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:04.447893  4339 raft_consensus.cc:385] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.448246  4339 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.448206  4340 ts_tablet_manager.cc:1403] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.199s	user 0.012s	sys 0.012s
I20260709 13:18:04.451485  4718 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.453954  4339 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.471782  4339 ts_tablet_manager.cc:1434] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 13:18:04.473135  4339 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:04.457381  4700 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.475956  4700 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.499017  4700 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:04.490353  4591 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:18:04.506086  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:04.494537  4690 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:04.507961  4261 leader_election.cc:343] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.515784  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:04.517393  4340 raft_consensus.cc:359] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.518188  4340 raft_consensus.cc:385] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.518584  4700 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.518817  4340 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.520102  4341 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
W20260709 13:18:04.523820  4261 leader_election.cc:343] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.520629  4341 ts_tablet_manager.cc:1403] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.261s	user 0.024s	sys 0.021s
I20260709 13:18:04.524600  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:04.526294  4697 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.527308  4697 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.494972  4717 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:18:04.528203  4340 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.541846  4339 tablet_bootstrap.cc:654] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.541656  4341 raft_consensus.cc:359] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.542461  4341 raft_consensus.cc:385] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.542793  4341 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.545418  4340 ts_tablet_manager.cc:1434] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.000s
I20260709 13:18:04.546918  4341 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.552523  4341 ts_tablet_manager.cc:1434] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:18:04.560956  4341 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:04.570744  4340 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:04.618059  4042 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.622772  4042 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.624764  4042 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.630767  4717 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.641654  4717 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.646631  4717 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.653061  4341 tablet_bootstrap.cc:654] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.673697  4339 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:04.674419  4339 ts_tablet_manager.cc:1403] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.010s
I20260709 13:18:04.668094  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:04.675999  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:04.689926  4292 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:04.695250  4215 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:04.705410  4141 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.723951  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:04.725059  4530 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.725159  4568 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.726099  4568 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.725484  4530 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.731909  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:04.731949  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:04.715303  4695 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.745829  4187 leader_election.cc:343] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.728268  4568 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.744392  4339 raft_consensus.cc:359] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.732858  4530 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.750165  4339 raft_consensus.cc:385] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.750561  4339 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.755522  4530 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.745172  4292 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:04.762202  4186 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:18:04.766855  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 95489.5us
I20260709 13:18:04.747548  4695 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.766139  4568 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.779101  4340 tablet_bootstrap.cc:654] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:04.789351  4728 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:18:04.785833  4695 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:04.781800  4339 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.788950  4568 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.804206  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:04.806329  4677 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.809053  4530 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.809310  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:04.797959  4341 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:04.815948  4341 ts_tablet_manager.cc:1403] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.255s	user 0.028s	sys 0.006s
I20260709 13:18:04.813632  4568 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.821450  4339 ts_tablet_manager.cc:1434] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.147s	user 0.010s	sys 0.005s
I20260709 13:18:04.825130  4697 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.830431  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:04.831344  4213 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:04.835315  4261 leader_election.cc:343] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.846506  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:04.847448  4289 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.847100  4568 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.850873  4568 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:04.855412  4697 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.856932  4339 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
W20260709 13:18:04.858325  4261 leader_election.cc:343] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.859066  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:04.859236  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:04.860023  4142 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.863483  4215 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.868572  4697 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.880620  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:04.881376  4288 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:04.897087  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:04.907516  4341 raft_consensus.cc:359] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.908732  4341 raft_consensus.cc:385] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.909050  4341 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.910234  4341 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:04.935712  4341 ts_tablet_manager.cc:1434] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.002s
I20260709 13:18:04.942618  4340 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:04.948189  4340 ts_tablet_manager.cc:1403] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.398s	user 0.008s	sys 0.021s
I20260709 13:18:04.946533  4341 tablet_bootstrap.cc:492] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:04.965279  4675 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:04.965273  4213 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:05.042282  4662 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.042958  4662 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.043169  4288 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:05.044409  4142 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:05.045197  4186 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:05.046675  4568 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.047320  4568 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:05.048456  4568 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.053793  4289 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:05.058944  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:05.060089  4734 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.060678  4734 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:05.061636  4734 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.064200  4339 tablet_bootstrap.cc:654] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.065308  4646 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:18:05.072548  4340 raft_consensus.cc:359] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.080446  4340 raft_consensus.cc:385] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.080927  4340 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.086313  4340 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.096138  4737 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.115127  4340 ts_tablet_manager.cc:1434] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.166s	user 0.009s	sys 0.002s
I20260709 13:18:05.136647  4340 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:05.141842  4662 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:05.138546  4677 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.143167  4677 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.143520  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:05.145526  4677 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:05.149065  4341 tablet_bootstrap.cc:654] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.170730  4738 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.171736  4738 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.186697  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:05.228420  4186 leader_election.cc:343] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.233945  4738 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:05.283427  4340 tablet_bootstrap.cc:654] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.369310  4339 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:05.370195  4339 ts_tablet_manager.cc:1403] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.514s	user 0.024s	sys 0.034s
I20260709 13:18:05.387431  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:05.392158  4261 leader_election.cc:343] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.395608  4339 raft_consensus.cc:359] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.398420  4339 raft_consensus.cc:385] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.399251  4339 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.400315  4339 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.405331  4339 ts_tablet_manager.cc:1434] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
W20260709 13:18:05.426470  4751 log.cc:927] Time spent T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.004s
W20260709 13:18:05.431228  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 300857us
I20260709 13:18:05.439873  4341 tablet_bootstrap.cc:492] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
W20260709 13:18:05.441423  4749 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
I20260709 13:18:05.443519  4341 ts_tablet_manager.cc:1403] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.497s	user 0.021s	sys 0.015s
I20260709 13:18:05.445549  4339 tablet_bootstrap.cc:492] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:05.451560  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:05.452680  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:05.453084  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:05.475632  4340 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:05.476258  4340 ts_tablet_manager.cc:1403] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.342s	user 0.016s	sys 0.010s
I20260709 13:18:05.482788  4042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 79) took 1031 ms. Trace:
I20260709 13:18:05.494103  4043 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.495103  4341 raft_consensus.cc:359] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.503122  4341 raft_consensus.cc:385] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.503437  4341 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.504206  4341 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.506942  4341 ts_tablet_manager.cc:1434] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:18:05.508153  4341 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:05.513363  4530 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.483235  4042 rpcz_store.cc:276] 0709 13:18:04.451879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.452056 (+   177us) service_pool.cc:224] Handling call
0709 13:18:05.482719 (+1030663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:04.704668 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:04.764378 (+ 59710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:04.764954 (+   576us) write_op.cc:435] Acquired schema lock
0709 13:18:04.766793 (+  1839us) tablet.cc:662] Decoding operations
0709 13:18:04.869399 (+102606us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:04.894579 (+ 25180us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:04.900330 (+  5751us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:04.954433 (+ 54103us) tablet.cc:701] Row locks acquired
0709 13:18:04.963017 (+  8584us) write_op.cc:260] PREPARE: finished
0709 13:18:04.965608 (+  2591us) write_op.cc:270] Start()
0709 13:18:05.024489 (+ 58881us) write_op.cc:276] Timestamp: P: 1783603084964248 usec, L: 0
0709 13:18:05.030502 (+  6013us) op_driver.cc:348] REPLICATION: starting
0709 13:18:05.090328 (+ 59826us) log.cc:844] Serialized 1307 byte log entry
0709 13:18:05.189518 (+ 99190us) op_driver.cc:464] REPLICATION: finished
0709 13:18:05.381560 (+192042us) write_op.cc:301] APPLY: starting
0709 13:18:05.381651 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:05.381806 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:05.411249 (+ 29443us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:05.431389 (+ 20140us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:05.431614 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:05.431689 (+    75us) write_op.cc:312] APPLY: finished
0709 13:18:05.431978 (+   289us) log.cc:844] Serialized 34 byte log entry
0709 13:18:05.432196 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.432313 (+   117us) write_op.cc:454] Released schema lock
0709 13:18:05.432386 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:05.432786 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.432818 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":189997,"apply.run_cpu_time_us":3131,"apply.run_wall_time_us":51222,"num_ops":3,"prepare.queue_time_us":59171,"prepare.run_cpu_time_us":7389,"prepare.run_wall_time_us":389728,"replication_time_us":149125,"thread_start_us":97917,"threads_started":2}]]}
I20260709 13:18:05.501374  4340 raft_consensus.cc:359] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.513975  4530 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.514626  4340 raft_consensus.cc:385] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.515046  4340 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.515872  4340 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.500717  4339 tablet_bootstrap.cc:654] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.502529  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:05.519610  4530 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:05.520306  4745 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:05.524168  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:05.525538  4340 ts_tablet_manager.cc:1434] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:18:05.525650  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:05.526825  4340 tablet_bootstrap.cc:492] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
W20260709 13:18:05.527228  4187 leader_election.cc:343] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.527719  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:05.529036  4757 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.530659  4701 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.531293  4701 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.536716  4701 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:05.537623  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:05.539089  4530 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.539662  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:05.543736  4261 leader_election.cc:343] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.556727  4044 catalog_manager.cc:5697] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:05.563110  4261 leader_election.cc:343] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.563771  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:05.564709  4735 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.543119  4341 tablet_bootstrap.cc:654] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.573205  4340 tablet_bootstrap.cc:654] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.577859  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:05.578516  4747 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.583204  4043 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 77) took 1025 ms. Trace:
W20260709 13:18:05.585026  4261 leader_election.cc:343] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.585525  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:05.588506  4701 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.598629  4339 tablet_bootstrap.cc:492] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:05.599347  4339 ts_tablet_manager.cc:1403] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.001s
I20260709 13:18:05.602916  4339 raft_consensus.cc:359] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.603781  4339 raft_consensus.cc:385] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.604084  4339 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.604925  4339 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.607371  4339 ts_tablet_manager.cc:1434] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:18:05.608834  4042 catalog_manager.cc:5697] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:05.611544  4339 tablet_bootstrap.cc:492] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:05.583846  4043 rpcz_store.cc:276] 0709 13:18:04.557788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.558071 (+   283us) service_pool.cc:224] Handling call
0709 13:18:05.582930 (+1024859us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:05.529826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:05.530370 (+   544us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:05.530404 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:05.530420 (+    16us) tablet.cc:662] Decoding operations
0709 13:18:05.530795 (+   375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:05.530854 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:05.530881 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:05.531063 (+   182us) tablet.cc:701] Row locks acquired
0709 13:18:05.531082 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:05.531270 (+   188us) write_op.cc:270] Start()
0709 13:18:05.531389 (+   119us) write_op.cc:276] Timestamp: P: 1783603085531221 usec, L: 0
0709 13:18:05.531413 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:05.532329 (+   916us) log.cc:844] Serialized 537 byte log entry
0709 13:18:05.537558 (+  5229us) op_driver.cc:464] REPLICATION: finished
0709 13:18:05.538161 (+   603us) write_op.cc:301] APPLY: starting
0709 13:18:05.538243 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:05.538351 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:05.538467 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:05.538686 (+   219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:05.538869 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:05.538925 (+    56us) write_op.cc:312] APPLY: finished
0709 13:18:05.539143 (+   218us) log.cc:844] Serialized 22 byte log entry
0709 13:18:05.539319 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.539423 (+   104us) write_op.cc:454] Released schema lock
0709 13:18:05.539470 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:05.539826 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.539856 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":361,"apply.run_cpu_time_us":1636,"apply.run_wall_time_us":1636,"num_ops":1,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":2803,"prepare.run_wall_time_us":2803,"replication_time_us":5973}]]}
I20260709 13:18:05.625125  4747 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.636452  4044 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 73) took 1038 ms. Trace:
I20260709 13:18:05.654496  4530 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.641261  4044 rpcz_store.cc:276] 0709 13:18:04.597753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.597896 (+   143us) service_pool.cc:224] Handling call
0709 13:18:05.636366 (+1038470us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:05.576049 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:05.576687 (+   638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:05.576727 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:18:05.576748 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:05.577160 (+   412us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:05.577217 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:05.577246 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:05.577464 (+   218us) tablet.cc:701] Row locks acquired
0709 13:18:05.577486 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:05.577644 (+   158us) write_op.cc:270] Start()
0709 13:18:05.577786 (+   142us) write_op.cc:276] Timestamp: P: 1783603085577592 usec, L: 0
0709 13:18:05.577822 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:18:05.578561 (+   739us) log.cc:844] Serialized 537 byte log entry
0709 13:18:05.580627 (+  2066us) op_driver.cc:464] REPLICATION: finished
0709 13:18:05.581141 (+   514us) write_op.cc:301] APPLY: starting
0709 13:18:05.581227 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:05.581966 (+   739us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:05.583369 (+  1403us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:05.583645 (+   276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:05.583819 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:05.583870 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:05.584101 (+   231us) log.cc:844] Serialized 22 byte log entry
0709 13:18:05.584303 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.584434 (+   131us) write_op.cc:454] Released schema lock
0709 13:18:05.584480 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:05.584827 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.584859 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5225,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":276,"apply.run_cpu_time_us":1861,"apply.run_wall_time_us":3648,"num_ops":1,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":2850,"prepare.run_wall_time_us":2850,"replication_time_us":2681}]]}
I20260709 13:18:05.660459  4341 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:05.661203  4341 ts_tablet_manager.cc:1403] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.008s
I20260709 13:18:05.668184  4339 tablet_bootstrap.cc:654] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.668310  4043 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:05.674211  4340 tablet_bootstrap.cc:492] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:05.674801  4340 ts_tablet_manager.cc:1403] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.000s
I20260709 13:18:05.673594  4043 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.682811  4341 raft_consensus.cc:359] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.684291  4341 raft_consensus.cc:385] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.684680  4341 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.685946  4341 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.693339  4340 raft_consensus.cc:359] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.694404  4340 raft_consensus.cc:385] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.695134  4753 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.707497  4753 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.710088  4753 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:05.697335  4341 ts_tablet_manager.cc:1434] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:18:05.713382  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:05.713307  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:05.704322  4340 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
W20260709 13:18:05.715816  4261 leader_election.cc:343] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:05.717659  4261 leader_election.cc:343] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.717751  4341 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:05.718196  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:05.719637  4753 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.725490  4339 tablet_bootstrap.cc:492] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:05.726153  4339 ts_tablet_manager.cc:1403] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.000s
I20260709 13:18:05.726925  4340 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.729285  4530 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.733816  4753 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.735827  4339 raft_consensus.cc:359] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.737874  4339 raft_consensus.cc:385] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.738253  4339 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.739115  4339 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.743077  4341 tablet_bootstrap.cc:654] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.736768  4753 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.747902  4753 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:05.747345  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:05.749532  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:05.750273  4217 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 0.
I20260709 13:18:05.751542  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:18:05.757858  4261 leader_election.cc:343] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.758549  4735 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.759087  4735 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.759506  4735 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.765915  4341 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:05.768996  4145 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.769683  4341 ts_tablet_manager.cc:1403] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.005s
I20260709 13:18:05.773461  4341 raft_consensus.cc:359] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.774614  4341 raft_consensus.cc:385] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.775024  4341 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.776121  4341 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.777695  4340 ts_tablet_manager.cc:1434] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.103s	user 0.010s	sys 0.001s
I20260709 13:18:05.778878  4340 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:05.742396  4339 ts_tablet_manager.cc:1434] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:18:05.781337  4339 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:05.792725  4341 ts_tablet_manager.cc:1434] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:18:05.797422  4341 tablet_bootstrap.cc:492] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:05.814276  4701 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.814956  4701 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.817283  4701 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:05.817394  4735 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.828449  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:05.826689  4735 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:05.830902  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:05.837049  4261 leader_election.cc:343] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.838282  4339 tablet_bootstrap.cc:654] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.842051  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:05.843146  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:05.839720  4213 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:05.846073  4340 tablet_bootstrap.cc:654] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.858960  4217 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.847119  4341 tablet_bootstrap.cc:654] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.866405  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:05.871357  4753 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:05.876843  4261 leader_election.cc:343] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.880918  4743 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.881923  4743 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:05.884465  4753 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.885077  4753 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.898715  4743 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:05.918336  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:05.930872  4217 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:05.935079  4288 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:05.944279  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:05.950110  4339 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:05.950791  4339 ts_tablet_manager.cc:1403] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.170s	user 0.020s	sys 0.027s
I20260709 13:18:05.954160  4186 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:05.951625  4700 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.959190  4747 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.958847  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:05.988124  4340 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:05.988757  4340 ts_tablet_manager.cc:1403] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.210s	user 0.019s	sys 0.031s
I20260709 13:18:05.976707  4747 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.992935  4747 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.997263  4341 tablet_bootstrap.cc:492] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:05.998045  4341 ts_tablet_manager.cc:1403] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.201s	user 0.023s	sys 0.017s
W20260709 13:18:05.998904  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:06.001055  4753 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.003615  4753 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:06.004914  4341 raft_consensus.cc:359] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.014212  4341 raft_consensus.cc:385] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.014642  4341 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.009927  4339 raft_consensus.cc:359] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:06.010484  4187 leader_election.cc:343] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.017331  4339 raft_consensus.cc:385] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.017773  4339 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.012985  4340 raft_consensus.cc:359] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.019105  4340 raft_consensus.cc:385] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.019917  4340 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.022748  4340 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.020733  4339 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.026224  4339 ts_tablet_manager.cc:1434] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:18:06.030102  4340 ts_tablet_manager.cc:1434] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.003s
I20260709 13:18:06.015548  4341 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.035238  4339 tablet_bootstrap.cc:492] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:06.037765  4737 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.038440  4737 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.042052  4340 tablet_bootstrap.cc:492] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:06.039638  4341 ts_tablet_manager.cc:1434] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 13:18:06.042971  4747 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.047778  4737 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.075736  4747 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.055845  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:06.077749  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:06.086978  4187 leader_election.cc:343] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.048028  4700 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:06.093356  4700 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.116446  4662 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.117347  4662 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.120283  4662 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.156809  4777 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.157846  4777 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.345820  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:06.346698  4295 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
W20260709 13:18:06.347893  4112 leader_election.cc:343] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:06.348723  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 219129us
I20260709 13:18:06.349017  4737 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.350647  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:06.351352  4290 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.354087  4340 tablet_bootstrap.cc:700] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Time spent opening tablet: real 0.239s	user 0.001s	sys 0.018s
I20260709 13:18:06.356280  4340 tablet_bootstrap.cc:654] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.370496  4339 tablet_bootstrap.cc:654] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.355294  4737 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.385859  4777 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:06.387764  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:06.388152  4341 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:06.353958  4782 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.390133  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:06.387845  4737 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.401091  4782 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.425525  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:06.434088  4341 tablet_bootstrap.cc:654] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:06.442636  4187 leader_election.cc:343] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.449296  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:06.450263  4757 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.450728  4757 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.451138  4757 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.452049  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:06.452905  4294 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:06.472048  4782 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.460162  4290 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
W20260709 13:18:06.487241  4261 leader_election.cc:343] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:06.493283  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 121110us
I20260709 13:18:06.466007  4757 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:06.479255  4111 leader_election.cc:343] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.523916  4779 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.541453  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64458us
I20260709 13:18:06.550633  4186 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:18:06.553783  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 76261.9us
I20260709 13:18:06.557578  4339 tablet_bootstrap.cc:492] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:06.558526  4339 ts_tablet_manager.cc:1403] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.524s	user 0.028s	sys 0.028s
I20260709 13:18:06.562773  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:06.566002  4757 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.566733  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:06.589012  4215 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.589458  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:06.590430  4341 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:06.590987  4341 ts_tablet_manager.cc:1403] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.014s
I20260709 13:18:06.591547  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:06.592540  4222 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:06.581051  4783 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.594772  4783 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.595185  4783 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.600283  4340 tablet_bootstrap.cc:492] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:06.601061  4340 ts_tablet_manager.cc:1403] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.559s	user 0.007s	sys 0.044s
I20260709 13:18:06.544670  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:06.549613  4779 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.608778  4294 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:06.609146  4779 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:06.601732  4788 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.187s	user 0.005s	sys 0.000s
I20260709 13:18:06.612852  4044 catalog_manager.cc:5697] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.627822  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:06.628877  4675 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.629300  4675 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.629658  4675 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.627343  4339 raft_consensus.cc:359] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.631034  4339 raft_consensus.cc:385] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.631367  4339 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.632261  4339 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.641763  4339 ts_tablet_manager.cc:1434] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:18:06.644630  4339 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:06.646909  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:06.648063  4216 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:06.567595  4786 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.654407  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:06.656412  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:06.653596  4341 raft_consensus.cc:359] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.659827  4341 raft_consensus.cc:385] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.660288  4341 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.646785  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:06.661459  4341 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.663810  4340 raft_consensus.cc:359] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.674795  4340 raft_consensus.cc:385] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.675331  4340 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.676425  4340 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.681031  4786 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:06.688589  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:06.708072  4786 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.712966  4341 ts_tablet_manager.cc:1434] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.003s
I20260709 13:18:06.714248  4341 tablet_bootstrap.cc:492] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:06.716501  4778 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.683835  4289 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:06.719599  4261 leader_election.cc:343] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.679776  4783 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.726162  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:06.728837  4340 ts_tablet_manager.cc:1434] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.127s	user 0.012s	sys 0.000s
I20260709 13:18:06.717469  4215 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:06.720804  4778 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.764657  4340 tablet_bootstrap.cc:492] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:06.766283  4778 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:06.767863  4339 tablet_bootstrap.cc:654] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.753170  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:06.774585  4112 leader_election.cc:343] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:06.782038  4261 consensus_peers.cc:597] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.777719  4530 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.783623  4530 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.784126  4530 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:06.790906  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65348.6us
I20260709 13:18:06.742722  4675 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:06.792281  4187 leader_election.cc:343] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.807127  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:06.818882  4143 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:06.831303  4783 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.813885  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:06.841308  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:18:06.851394  4112 leader_election.cc:343] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.864569  4340 tablet_bootstrap.cc:654] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:06.864809  4261 leader_election.cc:343] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.866518  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:06.873010  4753 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.873662  4753 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:06.874673  4753 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.875242  4675 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.878021  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:06.881398  4261 leader_election.cc:343] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.882268  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:18:06.886806  4112 leader_election.cc:343] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.895293  4341 tablet_bootstrap.cc:654] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:06.898216  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 82543us
I20260709 13:18:06.904585  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:06.905939  4261 leader_election.cc:343] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.906409  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:06.882575  4289 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:06.928040  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:06.908281  4779 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.931658  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:06.924795  4785 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:06.908459  4806 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.916795  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:06.909082  4776 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.938841  4786 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.943050  4288 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.951922  4747 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.962999  4747 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.965736  4747 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:06.944108  4530 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:06.979676  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:06.988873  4290 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:06.992760  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:06.998266  4782 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.960211  4786 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:07.003430  4782 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:07.011811  4804 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:18:07.015138  4530 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:07.017848  4339 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:07.018515  4339 ts_tablet_manager.cc:1403] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.374s	user 0.021s	sys 0.010s
I20260709 13:18:07.025748  4339 raft_consensus.cc:359] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.026870  4339 raft_consensus.cc:385] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.027226  4339 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.028160  4339 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.031967  4339 ts_tablet_manager.cc:1434] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:18:06.998476  4795 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.039192  4786 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.045079  4339 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:07.046867  4795 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.048892  4795 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.046540  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:07.052601  4782 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:07.061734  4341 tablet_bootstrap.cc:492] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:07.062320  4341 ts_tablet_manager.cc:1403] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.348s	user 0.014s	sys 0.007s
I20260709 13:18:07.085505  4806 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.089577  4340 tablet_bootstrap.cc:492] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:07.090448  4340 ts_tablet_manager.cc:1403] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.343s	user 0.032s	sys 0.018s
W20260709 13:18:07.094098  4111 leader_election.cc:343] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.097930  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:07.118260  4341 raft_consensus.cc:359] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.119791  4341 raft_consensus.cc:385] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.120230  4341 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.099905  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:07.121292  4341 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.142840  4341 ts_tablet_manager.cc:1434] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 13:18:07.158797  4340 raft_consensus.cc:359] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.161837  4340 raft_consensus.cc:385] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.165217  4340 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.165445  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:07.162638  4781 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.151984  4795 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.173583  4294 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:07.176116  4340 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.174387  4781 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.145043  4222 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.214130  4339 tablet_bootstrap.cc:654] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.225831  4341 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: Bootstrap starting.
I20260709 13:18:07.227612  4776 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.231683  4340 ts_tablet_manager.cc:1434] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.141s	user 0.021s	sys 0.000s
I20260709 13:18:07.228245  4776 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.252673  4776 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:07.253734  4288 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:07.256918  4222 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:07.257333  4795 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:07.260710  4781 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:07.270823  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:07.275373  4141 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.279953  4340 tablet_bootstrap.cc:492] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:07.271682  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:07.282135  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:07.298220  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:07.304438  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:07.305850  4339 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:07.306425  4339 ts_tablet_manager.cc:1403] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.262s	user 0.015s	sys 0.017s
I20260709 13:18:07.307490  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:07.310391  4783 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.310954  4783 raft_consensus.cc:697] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:07.290409  4734 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.311817  4734 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:07.311919  4783 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.312816  4734 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.290172  4781 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:07.321182  4261 leader_election.cc:343] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.342355  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:07.343513  4290 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.347491  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:07.348809  4288 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 1: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:07.351257  4781 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:07.352880  4781 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.377775  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:07.387492  4341 tablet_bootstrap.cc:654] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:07.399457  4187 leader_election.cc:343] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.407307  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:07.408186  4753 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.409013  4753 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.411155  4753 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:07.403232  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:07.422887  4790 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.423949  4786 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.424592  4142 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.425707  4290 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
W20260709 13:18:07.425966  4187 leader_election.cc:343] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.440687  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:07.443557  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:07.447201  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:07.451102  4787 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.451787  4787 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:07.452793  4787 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.458196  4339 raft_consensus.cc:359] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.459296  4339 raft_consensus.cc:385] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.459726  4339 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.460793  4339 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.463434  4339 ts_tablet_manager.cc:1434] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.157s	user 0.016s	sys 0.001s
W20260709 13:18:07.458276  4261 leader_election.cc:343] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:07.468673  4261 leader_election.cc:343] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.469041  4339 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:07.469153  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:07.474009  4042 catalog_manager.cc:5697] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.480556  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:07.481175  4142 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:07.481599  4216 raft_consensus.cc:2368] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2.
I20260709 13:18:07.463899  4757 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:07.476081  4735 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.506389  4112 leader_election.cc:400] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2.
I20260709 13:18:07.512024  4112 leader_election.cc:403] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.513103  4530 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2.
I20260709 13:18:07.523070  4340 tablet_bootstrap.cc:654] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:07.504124  4261 leader_election.cc:343] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.533084  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:07.536607  4142 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.538801  4339 tablet_bootstrap.cc:654] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.547981  4800 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.550186  4341 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: No bootstrap required, opened a new log
I20260709 13:18:07.573172  4216 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:07.573390  4341 ts_tablet_manager.cc:1403] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent bootstrapping tablet: real 0.348s	user 0.027s	sys 0.043s
I20260709 13:18:07.579196  4662 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.589210  4341 raft_consensus.cc:359] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.590288  4341 raft_consensus.cc:385] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.590692  4341 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.591540  4341 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.604089  4341 ts_tablet_manager.cc:1434] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:18:07.607461  4753 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.616428  4787 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.617147  4787 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.627758  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:07.629411  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:07.634459  4293 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 1: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:07.642117  4186 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:07.644933  4796 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.631157  4787 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:07.675825  4787 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:18:07.685738  4785 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:18:07.715889  4339 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:07.716300  4340 tablet_bootstrap.cc:492] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:07.716497  4339 ts_tablet_manager.cc:1403] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.248s	user 0.016s	sys 0.007s
I20260709 13:18:07.716845  4340 ts_tablet_manager.cc:1403] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.437s	user 0.022s	sys 0.015s
I20260709 13:18:07.723071  4339 raft_consensus.cc:359] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.724144  4339 raft_consensus.cc:385] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.724484  4339 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.728164  4339 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.730904  4339 ts_tablet_manager.cc:1434] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:18:07.732475  4339 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:07.718825  4796 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.746277  4806 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.747473  4806 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.747874  4340 raft_consensus.cc:359] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:07.748649  4340 raft_consensus.cc:385] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.748931  4340 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.749639  4340 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:07.751871  4828 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:18:07.752939  4806 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:07.764031  4340 ts_tablet_manager.cc:1434] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:18:07.768882  4043 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.772594  4530 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.766314  4340 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
W20260709 13:18:07.774832  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81176.4us
I20260709 13:18:07.785334  4043 catalog_manager.cc:5697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.787421  4043 catalog_manager.cc:5697] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.811450  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:07.817816  4734 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:07.817201  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:07.832310  4261 leader_election.cc:343] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.833381  4798 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.834159  4798 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:07.841974  4261 leader_election.cc:343] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.842540  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:07.849045  4777 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.855401  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:07.875264  4044 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 0 to 2, leader changed from <none> to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.878082  4798 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:07.886220  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:07.887259  4216 raft_consensus.cc:2393] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 1: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:07.888120  4339 tablet_bootstrap.cc:654] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.889855  4261 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:07.890316  4340 tablet_bootstrap.cc:654] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.891554  4042 catalog_manager.cc:5697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.905555  4042 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:07.907517  4187 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.909744  4530 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.935204  4781 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:18:07.944768  4833 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.985711  4757 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.993880  4662 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.994525  4662 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.035096  4339 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:08.035801  4339 ts_tablet_manager.cc:1403] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.304s	user 0.015s	sys 0.002s
I20260709 13:18:08.038869  4216 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.049870  4340 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:08.050994  4340 ts_tablet_manager.cc:1403] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.285s	user 0.045s	sys 0.026s
I20260709 13:18:08.050297  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:08.063632  4833 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.086200  4339 raft_consensus.cc:359] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.087248  4339 raft_consensus.cc:385] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.087579  4339 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.069303  4662 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.088785  4675 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.088291  4339 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.089478  4781 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.094110  4339 ts_tablet_manager.cc:1434] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.001s
I20260709 13:18:08.112206  4339 tablet_bootstrap.cc:492] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:08.111106  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:08.138412  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:08.142845  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 62298.3us
I20260709 13:18:08.154838  4845 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.155524  4845 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.166661  4845 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.169457  4339 tablet_bootstrap.cc:654] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.175239  4340 raft_consensus.cc:359] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.176000  4340 raft_consensus.cc:385] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.176326  4340 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.177093  4340 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.196702  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:08.197538  4289 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:08.201438  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:08.205296  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:08.214177  4340 ts_tablet_manager.cc:1434] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.163s	user 0.006s	sys 0.002s
I20260709 13:18:08.218914  4530 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.219485  4530 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.219856  4530 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.222276  4340 tablet_bootstrap.cc:492] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
W20260709 13:18:08.227541  4112 leader_election.cc:343] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.236720  4662 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.303635  4843 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.304456  4843 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.306632  4530 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.311547  4530 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.318804  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:08.319067  4843 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:08.322441  4112 leader_election.cc:343] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.323418  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:08.324167  4218 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:08.325553  4112 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:08.326392  4530 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.328058  4530 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.328739  4530 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.336930  4530 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.346064  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:08.346562  4530 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.346863  4290 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.347525  4340 tablet_bootstrap.cc:654] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:08.340145  4847 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.059s	user 0.003s	sys 0.003s
I20260709 13:18:08.346091  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:08.354646  4294 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:08.358057  4339 tablet_bootstrap.cc:492] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:08.358678  4339 ts_tablet_manager.cc:1403] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.249s	user 0.019s	sys 0.019s
I20260709 13:18:08.358618  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:08.363245  4339 raft_consensus.cc:359] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.359685  4218 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.371224  4290 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:08.368009  4339 raft_consensus.cc:385] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.372809  4339 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.389904  4339 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.393401  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:08.395547  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:08.396330  4290 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.396602  4734 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.397236  4734 raft_consensus.cc:697] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:08.398201  4734 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.399973  4339 ts_tablet_manager.cc:1434] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
W20260709 13:18:08.402827  4093 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:08.406939  4218 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:08.418205  4290 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:08.420166  4112 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:08.421397  4530 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.421939  4530 raft_consensus.cc:697] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:08.422686  4339 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:08.422833  4530 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.440907  4340 tablet_bootstrap.cc:492] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:08.441648  4340 ts_tablet_manager.cc:1403] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.224s	user 0.032s	sys 0.063s
I20260709 13:18:08.446334  4340 raft_consensus.cc:359] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.447243  4340 raft_consensus.cc:385] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.447580  4340 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.449602  4339 tablet_bootstrap.cc:654] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.451864  4340 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.458647  4340 ts_tablet_manager.cc:1434] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:18:08.462004  4340 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:08.472296  4043 catalog_manager.cc:5697] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.475754  4340 tablet_bootstrap.cc:654] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.478659  4339 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:08.479452  4339 ts_tablet_manager.cc:1403] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.000s
I20260709 13:18:08.502475  4339 raft_consensus.cc:359] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.503796  4339 raft_consensus.cc:385] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.508566  4339 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.517374  4339 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.521978  4339 ts_tablet_manager.cc:1434] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.002s
I20260709 13:18:08.523401  4339 tablet_bootstrap.cc:492] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:08.531056  4339 tablet_bootstrap.cc:654] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.542464  4340 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:08.543053  4340 ts_tablet_manager.cc:1403] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.028s
I20260709 13:18:08.545948  4843 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.546545  4843 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.549603  4340 raft_consensus.cc:359] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.550420  4340 raft_consensus.cc:385] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.550702  4340 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.551541  4340 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.552982  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:08.553791  4216 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:08.554498  4340 ts_tablet_manager.cc:1434] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:18:08.555187  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:08.555622  4340 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: Bootstrap starting.
I20260709 13:18:08.556095  4734 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.556634  4734 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.557006  4734 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.563824  4340 tablet_bootstrap.cc:654] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.567414  4339 tablet_bootstrap.cc:492] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:08.568231  4339 ts_tablet_manager.cc:1403] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.017s
I20260709 13:18:08.575961  4144 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.578155  4339 raft_consensus.cc:359] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.578990  4339 raft_consensus.cc:385] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.579304  4339 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.580042  4339 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.593958  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:08.594762  4294 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 0.
I20260709 13:18:08.595873  4339 ts_tablet_manager.cc:1434] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:18:08.597056  4339 tablet_bootstrap.cc:492] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Bootstrap starting.
I20260709 13:18:08.606730  4734 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.600863  4843 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.613567  4340 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: No bootstrap required, opened a new log
I20260709 13:18:08.614177  4340 ts_tablet_manager.cc:1403] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.008s
I20260709 13:18:08.617743  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:08.618558  4216 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.619108  4340 raft_consensus.cc:359] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.620265  4340 raft_consensus.cc:385] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.622032  4340 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.622200  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:08.622871  4294 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.641109  4734 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.623087  4340 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.642180  4294 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:08.687755  4216 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:08.703330  4340 ts_tablet_manager.cc:1434] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.001s
I20260709 13:18:08.704831  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:08.705394  4339 tablet_bootstrap.cc:654] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.717856  4844 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.718566  4844 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:08.719597  4844 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.725827  4143 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.749455  4339 tablet_bootstrap.cc:492] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: No bootstrap required, opened a new log
I20260709 13:18:08.750065  4339 ts_tablet_manager.cc:1403] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.020s
I20260709 13:18:08.756078  4339 raft_consensus.cc:359] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.757403  4339 raft_consensus.cc:385] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.757733  4339 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.761516  4339 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.764019  4339 ts_tablet_manager.cc:1434] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:18:08.773895  4530 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:08.774572  4530 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.779659  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:08.780656  4530 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.781277  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:08.782848  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:08.784578  4530 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:08.794463  4044 catalog_manager.cc:5697] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.823814  4044 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 0 to 1, leader changed from <none> to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.830492  4530 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.844460  4215 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.850767  4796 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.851444  4796 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.855197  4796 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.855679  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:08.857725  4290 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:08.858098  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:08.858870  4144 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 0.
I20260709 13:18:08.860113  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:08.861222  4796 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.861665  4796 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.862063  4796 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.856475  4844 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.865507  4530 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.891556  4796 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.895395  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:08.896126  4290 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.902470  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:08.917822  4140 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.901055  4796 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:08.949640  4140 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:08.953374  4187 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:08.955526  4662 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.950073  4290 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:08.956130  4662 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:08.961185  4662 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:08.989763  4530 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.058324  4044 catalog_manager.cc:5697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.226037  4844 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:09.263095  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:09.305727  4880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:09.309154  4879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:09.309940  4530 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:09.405539  4882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:09.425611  4796 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.450927  3021 server_base.cc:1061] running on GCE node
I20260709 13:18:09.452653  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:09.453004  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:09.453233  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603089453212 us; error 0 us; skew 500 ppm
I20260709 13:18:09.454062  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:09.489692  4787 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.539220  3021 webserver.cc:533] Webserver started at http://127.2.243.68:39237/ using document root <none> and password file <none>
I20260709 13:18:09.540285  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:09.540632  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:09.541217  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:09.546008  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-3-root/instance:
uuid: "b81584b21ed144698954548303f1e507"
format_stamp: "Formatted at 2026-07-09 13:18:09 on dist-test-slave-ftjc"
I20260709 13:18:09.589922  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.043s	user 0.006s	sys 0.011s
I20260709 13:18:09.597874  4890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:09.603099  3021 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.001s	sys 0.003s
I20260709 13:18:09.604573  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-3-root
uuid: "b81584b21ed144698954548303f1e507"
format_stamp: "Formatted at 2026-07-09 13:18:09 on dist-test-slave-ftjc"
I20260709 13:18:09.605074  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:09.649367  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:09.651795  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:09.657490  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:09.668395  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:09.668797  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:18:09.669163  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:09.669576  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:09.875084  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.68:35693
I20260709 13:18:09.875368  4953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.68:35693 every 8 connection(s)
I20260709 13:18:09.884778  3021 auto_leader_rebalancer-test.cc:384] add a tserver: b81584b21ed144698954548303f1e507
I20260709 13:18:09.909390  4954 heartbeater.cc:344] Connected to a master server at 127.2.243.126:38007
I20260709 13:18:09.909994  4954 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:09.911338  4954 heartbeater.cc:507] Master 127.2.243.126:38007 requested a full tablet report, sending...
I20260709 13:18:09.914124  4043 ts_manager.cc:194] Registered new tserver with Master: b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:09.915894  4043 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41016
I20260709 13:18:10.743240  4215 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:10.754127  4290 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:10.756016  4787 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:10.757326  4142 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:10.759914  4743 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:10.782914  4787 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:10.784296  4290 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:10.791779  4142 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:10.820845  4043 catalog_manager.cc:5697] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:10.844758  4185 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 002295ea4e164178a447d55ccde98422. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:10.859869  4142 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:10.911556  4215 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:10.914727  4290 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:10.916065  4734 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:10.918889  4954 heartbeater.cc:499] Master 127.2.243.126:38007 was elected leader, sending a full tablet report...
I20260709 13:18:10.923094  4530 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.953105  4843 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:10.959527  4215 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:18:10.967087  4110 consensus_peers.cc:597] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6b9a320ff854b5998471937010702d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:10.985443  4142 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:10.986920  4044 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:11.008698  4289 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:18:11.036119  4110 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96704063be1347b0bf621569c72ae1fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:11.040017  4290 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:11.041882  4215 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:11.047580  4975 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:18:11.057485  4530 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:11.098290  4734 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:11.111569  4288 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:11.150154  4216 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:11.194986  4290 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:11.216099  4042 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.392023  4984 ts_tablet_manager.cc:933] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:11.396593  4984 tablet_copy_client.cc:323] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:18:11.430341  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 002295ea4e164178a447d55ccde98422 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:18:11.431041  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 002295ea4e164178a447d55ccde98422 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-002295ea4e164178a447d55ccde98422
W20260709 13:18:11.444268  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 233915us
I20260709 13:18:11.448465  4232 tablet_copy_source_session.cc:215] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:11.455574  4142 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:11.483821  4984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002295ea4e164178a447d55ccde98422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.512786  4214 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:11.524608  4982 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:11.531760  4259 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 537f9faaf59648debe160e6df5d91fcd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:11.542894  4990 ts_tablet_manager.cc:933] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:11.552182  4990 tablet_copy_client.cc:323] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:18:11.567482  4982 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:11.589339  4798 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:11.670292  4996 ts_tablet_manager.cc:933] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:11.671828  4143 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:11.687686  4222 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:11.698999  4984 tablet_copy_client.cc:806] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:11.705416  4984 tablet_copy_client.cc:670] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:11.706374  4157 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet e6b9a320ff854b5998471937010702d5 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:18:11.709013  4157 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet e6b9a320ff854b5998471937010702d5 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-e6b9a320ff854b5998471937010702d5
I20260709 13:18:11.721333  4996 tablet_copy_client.cc:323] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:18:11.723804  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet 96704063be1347b0bf621569c72ae1fd from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:18:11.724480  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet 96704063be1347b0bf621569c72ae1fd from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-96704063be1347b0bf621569c72ae1fd
I20260709 13:18:11.728667  4042 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:11.737327  4984 tablet_copy_client.cc:538] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:11.743021  4157 tablet_copy_source_session.cc:215] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:11.753042  4998 ts_tablet_manager.cc:933] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:11.753592  4156 tablet_copy_source_session.cc:215] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:11.757925  4990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b9a320ff854b5998471937010702d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.758539  4984 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:11.788393  4998 tablet_copy_client.cc:323] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.67:40585
I20260709 13:18:11.791790  4996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96704063be1347b0bf621569c72ae1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.847800  4990 tablet_copy_client.cc:806] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:11.858675  4990 tablet_copy_client.cc:670] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:11.874229  4990 tablet_copy_client.cc:538] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:11.913893  4306 tablet_copy_service.cc:140] P 6f753b799f924bacb0a0f0f6e0068ee9: Received BeginTabletCopySession request for tablet 537f9faaf59648debe160e6df5d91fcd from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:47710)
I20260709 13:18:11.914705  4306 tablet_copy_service.cc:161] P 6f753b799f924bacb0a0f0f6e0068ee9: Beginning new tablet copy session on tablet 537f9faaf59648debe160e6df5d91fcd from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:47710: session id = b81584b21ed144698954548303f1e507-537f9faaf59648debe160e6df5d91fcd
I20260709 13:18:11.960202  4990 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:11.973788  4306 tablet_copy_source_session.cc:215] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:11.982517  4996 tablet_copy_client.cc:806] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:11.983355  4996 tablet_copy_client.cc:670] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:11.999984  4996 tablet_copy_client.cc:538] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:12.015275  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537f9faaf59648debe160e6df5d91fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.117174  4996 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:12.125593  4984 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:12.127127  4984 tablet_bootstrap.cc:492] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:12.162250  4984 ts_tablet_manager.cc:1403] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.412s	user 0.038s	sys 0.043s
I20260709 13:18:12.194026  4984 raft_consensus.cc:359] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:12.203861  4984 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:12.208307  4984 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:12.209923  4998 tablet_copy_client.cc:806] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:12.210631  4998 tablet_copy_client.cc:670] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
W20260709 13:18:12.213181  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 105435us
I20260709 13:18:12.220289  4998 tablet_copy_client.cc:538] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:12.290007  4984 ts_tablet_manager.cc:1434] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.008s
I20260709 13:18:12.295545  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-002295ea4e164178a447d55ccde98422 received from {username='slave'} at 127.0.0.1:54764
I20260709 13:18:12.296183  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-002295ea4e164178a447d55ccde98422 on tablet 002295ea4e164178a447d55ccde98422 with peer b81584b21ed144698954548303f1e507
W20260709 13:18:12.310051  4168 debug-util.cc:398] Leaking SignalData structure 0x7b0800106100 after lost signal to thread 3024
W20260709 13:18:12.311333  4168 debug-util.cc:398] Leaking SignalData structure 0x7b080010bc40 after lost signal to thread 4079
I20260709 13:18:12.311635  4996 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:12.312971  4996 tablet_bootstrap.cc:492] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:12.313768  4996 ts_tablet_manager.cc:1403] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.197s	user 0.016s	sys 0.010s
I20260709 13:18:12.295550  4990 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:18:12.315708  4168 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4d40 after lost signal to thread 4953
I20260709 13:18:12.316704  4990 tablet_bootstrap.cc:492] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:12.317869  4998 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:12.320679  4990 ts_tablet_manager.cc:1403] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.361s	user 0.029s	sys 0.006s
I20260709 13:18:12.326767  4996 raft_consensus.cc:359] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:12.327776  4996 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:12.328531  4996 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:12.331684  4996 ts_tablet_manager.cc:1434] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:18:12.335032  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-96704063be1347b0bf621569c72ae1fd received from {username='slave'} at 127.0.0.1:37124
I20260709 13:18:12.335613  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-96704063be1347b0bf621569c72ae1fd on tablet 96704063be1347b0bf621569c72ae1fd with peer b81584b21ed144698954548303f1e507
I20260709 13:18:12.334230  4990 raft_consensus.cc:359] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:12.340179  4990 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:12.341251  4990 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:12.344175  4990 ts_tablet_manager.cc:1434] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:18:12.347905  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-e6b9a320ff854b5998471937010702d5 received from {username='slave'} at 127.0.0.1:37124
I20260709 13:18:12.348469  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-e6b9a320ff854b5998471937010702d5 on tablet e6b9a320ff854b5998471937010702d5 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:12.423053  4928 raft_consensus.cc:1217] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:12.444700  4998 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:12.445796  4998 tablet_bootstrap.cc:492] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:12.455472  4998 ts_tablet_manager.cc:1403] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.012s
I20260709 13:18:12.475389  4998 raft_consensus.cc:359] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:12.476888  4998 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:12.477728  4998 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:12.486694  4998 ts_tablet_manager.cc:1434] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:18:12.497694  4306 tablet_copy_service.cc:342] P 6f753b799f924bacb0a0f0f6e0068ee9: Request end of tablet copy session b81584b21ed144698954548303f1e507-537f9faaf59648debe160e6df5d91fcd received from {username='slave'} at 127.0.0.1:47710
I20260709 13:18:12.498242  4306 tablet_copy_service.cc:434] P 6f753b799f924bacb0a0f0f6e0068ee9: ending tablet copy session b81584b21ed144698954548303f1e507-537f9faaf59648debe160e6df5d91fcd on tablet 537f9faaf59648debe160e6df5d91fcd with peer b81584b21ed144698954548303f1e507
I20260709 13:18:12.550915  4928 raft_consensus.cc:1217] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:12.743588  4928 raft_consensus.cc:1217] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:12.840720  4928 raft_consensus.cc:1217] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:12.917418  4975 raft_consensus.cc:1064] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:12.927788  4975 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:12.960134  4296 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:12.960631  4216 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:12.961879  5007 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:12.963354  4928 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:12.965461  4976 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:12.966738  5006 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.001243  4530 raft_consensus.cc:1064] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:13.007349  4530 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:13.095286  4975 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.112106  4928 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:13.114041  4222 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:13.114440  4976 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.130476  4976 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.139026  4215 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.159292  4296 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.166356  5007 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.174437  4290 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:18:13.174991  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 107259us
I20260709 13:18:13.180418  4928 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.180385  4222 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.186475  4530 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:13.204767  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47089.3us
I20260709 13:18:13.208531  4042 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.248603  4289 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.255587  4927 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.265345  4982 raft_consensus.cc:1064] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:13.269408  4982 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:13.363492  4928 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:13.365499  5026 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.367245  4222 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:13.368907  4988 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:13.370304  5027 raft_consensus.cc:1064] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:13.373628  4140 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:13.374420  5027 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:13.378307  4988 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.391987  4927 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:13.394089  4958 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.437922  4289 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:13.441360  4146 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:13.450294  4787 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:13.496563  4787 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.503001  4140 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:13.498790  4043 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:13.589069  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 103591us
I20260709 13:18:13.605897  5021 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.615031  4928 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:13.619108  4530 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:13.625787  5027 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.649924  5006 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.654136  4928 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.669663  4140 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.678264  4288 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.692287  4146 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:13.695401  4222 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.706499  4216 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:13.715224  4927 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:13.721920  4295 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:13.726439  4530 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:13.729235  4927 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.736105  4975 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.746726  4530 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:13.760227  4140 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.751883  4295 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.743901  4926 raft_consensus.cc:2955] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.750931  4925 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.769466  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e6b9a320ff854b5998471937010702d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:13.778463  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76721.9us
I20260709 13:18:13.791770  4044 catalog_manager.cc:5697] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.804412  4045 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:13.873517  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61954.5us
I20260709 13:18:13.874549  4222 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:13.875779  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96704063be1347b0bf621569c72ae1fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:13.879276  5046 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:13.887291  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49205.1us
W20260709 13:18:13.954012  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49115.8us
I20260709 13:18:13.967312  4215 raft_consensus.cc:2955] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.972837  4043 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:13.993650  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet e6b9a320ff854b5998471937010702d5 with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46838
I20260709 13:18:13.998852  4290 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:14.012420  4925 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:14.014911  5042 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:14.026356  4295 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:14.026356  5027 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:14.029855  5053 tablet_replica.cc:333] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:18:14.031180  5053 raft_consensus.cc:2243] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:14.031837  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 120402us
W20260709 13:18:14.034067  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 120156us
I20260709 13:18:14.046355  5045 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:14.053735  4925 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:14.080809  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 002295ea4e164178a447d55ccde98422 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:14.088142  5053 raft_consensus.cc:2272] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:14.092646  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44713us
I20260709 13:18:14.095974  4926 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:14.109666  5053 ts_tablet_manager.cc:1916] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:14.060665  4288 raft_consensus.cc:2955] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:14.075562  4045 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:14.145593  4222 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:14.165962  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet 96704063be1347b0bf621569c72ae1fd with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44140
I20260709 13:18:14.164780  4043 catalog_manager.cc:5697] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.181136  4137 tablet_service.cc:1558] Processing DeleteTablet for tablet 002295ea4e164178a447d55ccde98422 with delete_type TABLET_DATA_TOMBSTONED (TS 32ebd3bc4af5446f94d9f3ac7c8cf53c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52128
I20260709 13:18:14.187148  5055 tablet_replica.cc:333] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:18:14.188561  5055 raft_consensus.cc:2243] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.189538  5055 raft_consensus.cc:2272] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.193104  5056 tablet_replica.cc:333] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:18:14.193781  5055 ts_tablet_manager.cc:1916] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:14.194805  5056 raft_consensus.cc:2243] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.197661  4991 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:14.203059  5056 raft_consensus.cc:2272] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.214673  5056 ts_tablet_manager.cc:1916] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:14.224311  5055 ts_tablet_manager.cc:1929] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:14.230334  5055 log.cc:1199] T 96704063be1347b0bf621569c72ae1fd P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/96704063be1347b0bf621569c72ae1fd
I20260709 13:18:14.232811  5026 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:14.241322  5051 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:14.246763  4925 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:14.274451  4043 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:14.279197  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet 96704063be1347b0bf621569c72ae1fd (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:14.293054  4137 tablet_service.cc:1558] Processing DeleteTablet for tablet 537f9faaf59648debe160e6df5d91fcd with delete_type TABLET_DATA_TOMBSTONED (TS 32ebd3bc4af5446f94d9f3ac7c8cf53c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52128
I20260709 13:18:14.309917  4030 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 537f9faaf59648debe160e6df5d91fcd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:14.318384  4214 raft_consensus.cc:2955] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:14.328768  5056 ts_tablet_manager.cc:1929] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:14.329391  5056 log.cc:1199] T 002295ea4e164178a447d55ccde98422 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/wals/002295ea4e164178a447d55ccde98422
I20260709 13:18:14.331549  4031 catalog_manager.cc:5028] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): tablet 002295ea4e164178a447d55ccde98422 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:14.332446  5053 ts_tablet_manager.cc:1929] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:14.332927  5056 tablet_replica.cc:333] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:18:14.333035  5053 log.cc:1199] T e6b9a320ff854b5998471937010702d5 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/e6b9a320ff854b5998471937010702d5
I20260709 13:18:14.345067  5056 raft_consensus.cc:2243] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.346060  5056 raft_consensus.cc:2272] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.346045  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet e6b9a320ff854b5998471937010702d5 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:14.349943  5056 ts_tablet_manager.cc:1916] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:14.369491  5056 ts_tablet_manager.cc:1929] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:14.369959  5056 log.cc:1199] T 537f9faaf59648debe160e6df5d91fcd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/wals/537f9faaf59648debe160e6df5d91fcd
I20260709 13:18:14.371783  4031 catalog_manager.cc:5028] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): tablet 537f9faaf59648debe160e6df5d91fcd (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:15.476521  4214 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:18:15.519325  4185 consensus_peers.cc:597] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 527025007d0641e3a50bfc3a9d2e5b80. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:15.522183  4143 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:15.524816  4288 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:15.529187  5045 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:15.535245  5052 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:15.567772  5052 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:15.588889  4296 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:15.609771  4044 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:18:15.735428  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47174.2us
I20260709 13:18:15.878430  4296 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:18:15.907594  4259 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab416835542d4f11852821a8161b8f7b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:15.913235  4214 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:15.914324  4143 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:15.924902  5057 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:15.926239  4143 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:15.947407  5051 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:16.005297  5057 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.024384  4214 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.039461  4222 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:16.060842  4044 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.093429  4146 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:18:16.112140  4185 consensus_peers.cc:597] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7522b19b153a491c9d822b8ffb2becc5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:16.117221  4296 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.118830  4142 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.121906  5027 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:16.126660  5052 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:16.164523  5074 ts_tablet_manager.cc:933] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:16.151441  5052 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.186240  4295 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.221917  5074 tablet_copy_client.cc:323] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:18:16.226117  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 527025007d0641e3a50bfc3a9d2e5b80 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:18:16.211169  4222 consensus_queue.cc:237] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:16.238435  4044 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.226946  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 527025007d0641e3a50bfc3a9d2e5b80 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-527025007d0641e3a50bfc3a9d2e5b80
I20260709 13:18:16.263708  4142 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.283389  4232 tablet_copy_source_session.cc:215] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:16.290023  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 527025007d0641e3a50bfc3a9d2e5b80. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:16.340590  4185 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1270a058111c4161ba865afa3630bfb7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:16.342391  4295 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.345237  4146 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.345103  5078 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:16.347188  5074 tablet_copy_client.cc:806] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:16.347906  5074 tablet_copy_client.cc:670] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:16.349292  5052 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.359483  5074 tablet_copy_client.cc:538] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:16.376875  5027 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.380637  4146 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.441370  5074 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:16.454815  4296 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:16.474723  4044 catalog_manager.cc:5697] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:18:16.493383  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 86706us
I20260709 13:18:16.637219  5083 ts_tablet_manager.cc:933] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:16.689240  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65121.6us
I20260709 13:18:16.695778  5074 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:16.697036  5074 tablet_bootstrap.cc:492] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:16.697971  5074 ts_tablet_manager.cc:1403] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.257s	user 0.045s	sys 0.065s
W20260709 13:18:16.689986  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 65213.4us
I20260709 13:18:16.725977  5083 tablet_copy_client.cc:323] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
W20260709 13:18:16.857601  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 140176us
W20260709 13:18:16.860723  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 129378us
W20260709 13:18:16.877498  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 172101us
W20260709 13:18:16.893591  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44815.5us
I20260709 13:18:16.899981  5095 ts_tablet_manager.cc:933] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:16.916615  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 7522b19b153a491c9d822b8ffb2becc5 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:18:16.893714  5074 raft_consensus.cc:359] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:16.959407  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 7522b19b153a491c9d822b8ffb2becc5 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-7522b19b153a491c9d822b8ffb2becc5
I20260709 13:18:16.992592  5074 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:16.993754  5074 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:18:16.998360  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 103747us
I20260709 13:18:16.999713  5095 tablet_copy_client.cc:323] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.67:40585
I20260709 13:18:17.018617  4232 tablet_copy_source_session.cc:215] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:17.064147  4306 tablet_copy_service.cc:140] P 6f753b799f924bacb0a0f0f6e0068ee9: Received BeginTabletCopySession request for tablet ab416835542d4f11852821a8161b8f7b from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:47710)
W20260709 13:18:17.078438  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49025.6us
I20260709 13:18:17.085777  5074 ts_tablet_manager.cc:1434] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.387s	user 0.019s	sys 0.006s
I20260709 13:18:17.090917  4928 raft_consensus.cc:1217] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:17.107142  4231 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-527025007d0641e3a50bfc3a9d2e5b80 received from {username='slave'} at 127.0.0.1:54764
I20260709 13:18:17.107798  4231 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-527025007d0641e3a50bfc3a9d2e5b80 on tablet 527025007d0641e3a50bfc3a9d2e5b80 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:17.143131  5074 ts_tablet_manager.cc:933] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:17.143666  5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7522b19b153a491c9d822b8ffb2becc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.199775  4306 tablet_copy_service.cc:161] P 6f753b799f924bacb0a0f0f6e0068ee9: Beginning new tablet copy session on tablet ab416835542d4f11852821a8161b8f7b from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:47710: session id = b81584b21ed144698954548303f1e507-ab416835542d4f11852821a8161b8f7b
I20260709 13:18:17.211648  5074 tablet_copy_client.cc:323] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:18:17.266952  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 1270a058111c4161ba865afa3630bfb7 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:18:17.267585  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 1270a058111c4161ba865afa3630bfb7 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-1270a058111c4161ba865afa3630bfb7
W20260709 13:18:17.283676  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 58584.8us
I20260709 13:18:17.307615  4232 tablet_copy_source_session.cc:215] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:17.313025  4306 tablet_copy_source_session.cc:215] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:17.313889  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1270a058111c4161ba865afa3630bfb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.316771  5095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab416835542d4f11852821a8161b8f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.394891  5074 tablet_copy_client.cc:806] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:17.395743  5074 tablet_copy_client.cc:670] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:17.405462  5083 tablet_copy_client.cc:806] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:17.406445  5083 tablet_copy_client.cc:670] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:17.408896  5074 tablet_copy_client.cc:538] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:17.420846  5083 tablet_copy_client.cc:538] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:17.425061  5074 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:17.446322  5104 raft_consensus.cc:1064] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:17.452047  5104 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:17.472043  5095 tablet_copy_client.cc:806] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:17.472829  5095 tablet_copy_client.cc:670] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:17.488739  5083 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:17.495469  5095 tablet_copy_client.cc:538] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:17.511257  4926 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:17.527293  4294 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:17.528297  5085 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:17.531262  5052 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:17.551471  4142 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:17.554940  5085 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:17.580580  5095 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:17.644420  5103 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.645258  4925 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.660498  5074 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:17.666330  4294 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.679313  5083 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:17.688872  5083 tablet_bootstrap.cc:492] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:17.683712  4044 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.681241  5074 tablet_bootstrap.cc:492] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:17.692871  5074 ts_tablet_manager.cc:1403] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.268s	user 0.026s	sys 0.022s
I20260709 13:18:17.700063  5074 raft_consensus.cc:359] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:17.701208  5083 ts_tablet_manager.cc:1403] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.221s	user 0.028s	sys 0.009s
I20260709 13:18:17.711448  5074 raft_consensus.cc:740] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:17.712395  5074 consensus_queue.cc:260] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:17.715101  5074 ts_tablet_manager.cc:1434] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:18:17.717497  5083 raft_consensus.cc:359] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:17.722275  5095 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:17.746974  4143 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.762470  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-1270a058111c4161ba865afa3630bfb7 received from {username='slave'} at 127.0.0.1:54764
I20260709 13:18:17.759805  5083 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:17.766091  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-1270a058111c4161ba865afa3630bfb7 on tablet 1270a058111c4161ba865afa3630bfb7 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:17.772244  5095 tablet_bootstrap.cc:492] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:17.773284  5095 ts_tablet_manager.cc:1403] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.223s	user 0.025s	sys 0.004s
I20260709 13:18:17.789789  5095 raft_consensus.cc:359] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:17.799120  5095 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:17.800258  5095 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:17.803601  5095 ts_tablet_manager.cc:1434] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:18:17.808904  5083 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:17.812069  5083 ts_tablet_manager.cc:1434] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.000s
I20260709 13:18:17.815333  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-7522b19b153a491c9d822b8ffb2becc5 received from {username='slave'} at 127.0.0.1:54764
I20260709 13:18:17.815851  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-7522b19b153a491c9d822b8ffb2becc5 on tablet 7522b19b153a491c9d822b8ffb2becc5 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:17.825214  4306 tablet_copy_service.cc:342] P 6f753b799f924bacb0a0f0f6e0068ee9: Request end of tablet copy session b81584b21ed144698954548303f1e507-ab416835542d4f11852821a8161b8f7b received from {username='slave'} at 127.0.0.1:47710
I20260709 13:18:17.825757  4306 tablet_copy_service.cc:434] P 6f753b799f924bacb0a0f0f6e0068ee9: ending tablet copy session b81584b21ed144698954548303f1e507-ab416835542d4f11852821a8161b8f7b on tablet ab416835542d4f11852821a8161b8f7b with peer b81584b21ed144698954548303f1e507
I20260709 13:18:17.884583  4213 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:17.904274  4925 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:17.908257  5078 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:17.915915  5085 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.927704  4144 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:17.927107  4925 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.937126  5052 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:17.943917  4143 raft_consensus.cc:2955] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.957417  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 527025007d0641e3a50bfc3a9d2e5b80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:17.966593  4925 raft_consensus.cc:1217] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:17.966076  4041 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:17.995223  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet 527025007d0641e3a50bfc3a9d2e5b80 with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46838
I20260709 13:18:17.997351  5128 tablet_replica.cc:333] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:18:17.998631  5128 raft_consensus.cc:2243] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:17.999651  5128 raft_consensus.cc:2272] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.022749  5128 ts_tablet_manager.cc:1916] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:18.071467  5128 ts_tablet_manager.cc:1929] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:18.072225  5128 log.cc:1199] T 527025007d0641e3a50bfc3a9d2e5b80 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/527025007d0641e3a50bfc3a9d2e5b80
I20260709 13:18:18.075600  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet 527025007d0641e3a50bfc3a9d2e5b80 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:18.274204  4925 raft_consensus.cc:1217] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:18.317984  4925 raft_consensus.cc:1217] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:18.507428  5078 raft_consensus.cc:1064] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:18.512599  5078 consensus_queue.cc:237] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:18.643088  4925 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.647974  5104 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:18.656950  4287 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.661182  5052 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.675114  4144 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.696846  5109 raft_consensus.cc:1064] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:18.699389  5109 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:18.717938  5085 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.739908  5085 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:18.753301  5134 raft_consensus.cc:1064] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:18.753885  4926 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.755129  5109 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.756762  4142 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.758597  5109 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.762002  4213 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.761480  4142 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:18.774991  4294 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:18.776783  5134 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:18.777036  5109 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:18.788573  5096 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:18.790380  4143 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:18.803061  4041 catalog_manager.cc:5697] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:18.817445  4926 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.819614  5134 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:18.829706  4292 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.834403  4143 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.840761  5134 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.841734  4925 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:18.848161  4928 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:18.857219  5142 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:18.896116  4044 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.922786  4214 consensus_queue.cc:237] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:18.987273  5149 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.113s	user 0.000s	sys 0.011s
W20260709 13:18:18.995587  5137 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:18:19.060658  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 51813.4us
I20260709 13:18:19.130052  4218 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.134367  5156 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.148236  4928 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.152033  5159 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:19.155995  4294 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:19.170428  4928 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.172055  5057 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:18:19.180652  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80286.1us
W20260709 13:18:19.184696  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 88802.5us
I20260709 13:18:19.185063  5133 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.186004  5158 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.191605  4294 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.196386  4925 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.208858  4928 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.232275  4030 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab416835542d4f11852821a8161b8f7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:19.239912  4042 catalog_manager.cc:5697] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.245720  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1270a058111c4161ba865afa3630bfb7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:19.245678  4041 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.263502  4928 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.267050  4144 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.268245  4145 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.336597  4147 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.385246  5057 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:19.421743  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47429.3us
I20260709 13:18:19.423358  4041 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.440786  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet 1270a058111c4161ba865afa3630bfb7 with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46838
I20260709 13:18:19.458120  5159 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:19.516691  4140 raft_consensus.cc:2955] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.521133  5166 tablet_replica.cc:333] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:18:19.529834  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet ab416835542d4f11852821a8161b8f7b with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44140
W20260709 13:18:19.545740  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 44599.5us
I20260709 13:18:19.559460  4146 raft_consensus.cc:2955] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.565303  5166 raft_consensus.cc:2243] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.566562  5166 raft_consensus.cc:2272] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.563586  4221 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:19.617048  5168 tablet_replica.cc:333] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:18:19.618626  5168 raft_consensus.cc:2243] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.619546  5168 raft_consensus.cc:2272] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.626792  4925 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.629774  5131 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:19.625213  5166 ts_tablet_manager.cc:1916] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:19.642172  4292 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.655864  5156 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:19.659066  5158 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.660214  4928 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.706605  4041 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.712560  4294 raft_consensus.cc:2955] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:19.723770  5168 ts_tablet_manager.cc:1916] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:19.728051  4137 tablet_service.cc:1558] Processing DeleteTablet for tablet 7522b19b153a491c9d822b8ffb2becc5 with delete_type TABLET_DATA_TOMBSTONED (TS 32ebd3bc4af5446f94d9f3ac7c8cf53c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52128
I20260709 13:18:19.742805  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7522b19b153a491c9d822b8ffb2becc5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:19.749349  5169 tablet_replica.cc:333] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:18:19.751471  5169 raft_consensus.cc:2243] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.752503  5169 raft_consensus.cc:2272] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.756319  5169 ts_tablet_manager.cc:1916] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:19.768991  5168 ts_tablet_manager.cc:1929] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:19.769670  5168 log.cc:1199] T ab416835542d4f11852821a8161b8f7b P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/ab416835542d4f11852821a8161b8f7b
I20260709 13:18:19.772226  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet ab416835542d4f11852821a8161b8f7b (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:19.776413  5166 ts_tablet_manager.cc:1929] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:19.776842  5166 log.cc:1199] T 1270a058111c4161ba865afa3630bfb7 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/1270a058111c4161ba865afa3630bfb7
I20260709 13:18:19.778554  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet 1270a058111c4161ba865afa3630bfb7 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:19.781119  5169 ts_tablet_manager.cc:1929] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:19.781718  5169 log.cc:1199] T 7522b19b153a491c9d822b8ffb2becc5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/wals/7522b19b153a491c9d822b8ffb2becc5
I20260709 13:18:19.783906  4031 catalog_manager.cc:5028] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): tablet 7522b19b153a491c9d822b8ffb2becc5 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:20.860730  4140 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:18:20.874627  4110 consensus_peers.cc:597] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 729a3ec3cbd04254ac398836ae71b77d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.880241  4221 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:20.882331  4294 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:20.883606  5086 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:20.885708  5151 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:20.895970  5171 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:20.898785  4218 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:20.961860  4140 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:20.964375  4044 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:20.978348  4294 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:18:21.007740  4110 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9d67bbe0103433095fb80de46cf624d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.013384  4287 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:21.016299  4218 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:21.019567  5171 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:21.021600  5175 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:21.055994  5086 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.059760  4213 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.088999  4294 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.104177  4287 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.121207  4146 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:21.121622  4213 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:21.121966  4259 consensus_peers.cc:597] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c130eddd78204cee994818f0043bf88c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.123502  5152 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:21.125648  5152 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.125177  4044 catalog_manager.cc:5697] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.160650  5152 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.163951  4146 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.163959  4213 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.190349  4218 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.199983  4044 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:18:21.212742  4185 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0334f31959bc48878664996813e359b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.219915  4146 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:21.222014  5159 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.236928  4287 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:21.242879  5158 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:21.259721  5159 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.293962  4146 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.320892  4044 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.331221  4292 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:21.359488  5191 ts_tablet_manager.cc:933] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:21.369801  5191 tablet_copy_client.cc:323] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:18:21.376627  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet 729a3ec3cbd04254ac398836ae71b77d from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:18:21.377517  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet 729a3ec3cbd04254ac398836ae71b77d from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-729a3ec3cbd04254ac398836ae71b77d
I20260709 13:18:21.409036  4156 tablet_copy_source_session.cc:215] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:21.424957  5191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729a3ec3cbd04254ac398836ae71b77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:21.466671  5195 ts_tablet_manager.cc:933] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:21.469138  5191 tablet_copy_client.cc:806] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:21.473675  5191 tablet_copy_client.cc:670] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
W20260709 13:18:21.471017  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 81768.3us
I20260709 13:18:21.493009  5191 tablet_copy_client.cc:538] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:21.513984  5195 tablet_copy_client.cc:323] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:18:21.517378  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet e9d67bbe0103433095fb80de46cf624d from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:18:21.518149  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet e9d67bbe0103433095fb80de46cf624d from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-e9d67bbe0103433095fb80de46cf624d
I20260709 13:18:21.530753  5191 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:21.537983  4156 tablet_copy_source_session.cc:215] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:21.572822  5195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9d67bbe0103433095fb80de46cf624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:21.631551  5199 ts_tablet_manager.cc:933] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:21.638296  5191 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.639719  5191 tablet_bootstrap.cc:492] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:21.645562  5191 ts_tablet_manager.cc:1403] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.115s	user 0.046s	sys 0.019s
I20260709 13:18:21.651489  5191 raft_consensus.cc:359] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.655179  5191 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:21.656212  5191 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.658437  5199 tablet_copy_client.cc:323] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.67:40585
I20260709 13:18:21.662859  4306 tablet_copy_service.cc:140] P 6f753b799f924bacb0a0f0f6e0068ee9: Received BeginTabletCopySession request for tablet c130eddd78204cee994818f0043bf88c from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:47710)
I20260709 13:18:21.663779  4306 tablet_copy_service.cc:161] P 6f753b799f924bacb0a0f0f6e0068ee9: Beginning new tablet copy session on tablet c130eddd78204cee994818f0043bf88c from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:47710: session id = b81584b21ed144698954548303f1e507-c130eddd78204cee994818f0043bf88c
I20260709 13:18:21.671044  5195 tablet_copy_client.cc:806] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:21.671830  5195 tablet_copy_client.cc:670] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:21.697947  5195 tablet_copy_client.cc:538] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:21.704514  5191 ts_tablet_manager.cc:1434] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.057s	user 0.020s	sys 0.007s
I20260709 13:18:21.705349  4306 tablet_copy_source_session.cc:215] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:21.711591  5195 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:21.711860  5199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c130eddd78204cee994818f0043bf88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:21.723047  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-729a3ec3cbd04254ac398836ae71b77d received from {username='slave'} at 127.0.0.1:37124
I20260709 13:18:21.723738  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-729a3ec3cbd04254ac398836ae71b77d on tablet 729a3ec3cbd04254ac398836ae71b77d with peer b81584b21ed144698954548303f1e507
I20260709 13:18:21.769595  5199 tablet_copy_client.cc:806] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:21.770421  5199 tablet_copy_client.cc:670] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:21.777279  5199 tablet_copy_client.cc:538] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:21.788545  5199 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:21.789094  5195 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.790292  5191 ts_tablet_manager.cc:933] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:21.792953  5195 tablet_bootstrap.cc:492] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:21.794015  5195 ts_tablet_manager.cc:1403] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.083s	user 0.018s	sys 0.018s
I20260709 13:18:21.800298  5195 raft_consensus.cc:359] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.803166  5195 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:21.818866  5191 tablet_copy_client.cc:323] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:18:21.821626  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 0334f31959bc48878664996813e359b4 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:18:21.822297  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 0334f31959bc48878664996813e359b4 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-0334f31959bc48878664996813e359b4
I20260709 13:18:21.825685  5195 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.853916  4925 raft_consensus.cc:1217] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:21.860136  5195 ts_tablet_manager.cc:1434] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:18:21.865082  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-e9d67bbe0103433095fb80de46cf624d received from {username='slave'} at 127.0.0.1:37124
I20260709 13:18:21.865650  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-e9d67bbe0103433095fb80de46cf624d on tablet e9d67bbe0103433095fb80de46cf624d with peer b81584b21ed144698954548303f1e507
I20260709 13:18:21.865859  4232 tablet_copy_source_session.cc:215] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:21.870889  5191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0334f31959bc48878664996813e359b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:21.903903  5191 tablet_copy_client.cc:806] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:21.904774  5191 tablet_copy_client.cc:670] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:21.911242  5199 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.912410  5191 tablet_copy_client.cc:538] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:21.913754  5199 tablet_bootstrap.cc:492] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:21.914815  5199 ts_tablet_manager.cc:1403] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.127s	user 0.036s	sys 0.020s
I20260709 13:18:21.919504  5199 raft_consensus.cc:359] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.920912  5199 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:21.921838  5199 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.925853  5199 ts_tablet_manager.cc:1434] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:18:21.927930  4306 tablet_copy_service.cc:342] P 6f753b799f924bacb0a0f0f6e0068ee9: Request end of tablet copy session b81584b21ed144698954548303f1e507-c130eddd78204cee994818f0043bf88c received from {username='slave'} at 127.0.0.1:47710
I20260709 13:18:21.928604  4306 tablet_copy_service.cc:434] P 6f753b799f924bacb0a0f0f6e0068ee9: ending tablet copy session b81584b21ed144698954548303f1e507-c130eddd78204cee994818f0043bf88c on tablet c130eddd78204cee994818f0043bf88c with peer b81584b21ed144698954548303f1e507
I20260709 13:18:21.928849  5191 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:21.963270  5191 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.965255  5191 tablet_bootstrap.cc:492] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:21.966288  5191 ts_tablet_manager.cc:1403] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.040s	user 0.028s	sys 0.001s
I20260709 13:18:21.971266  5191 raft_consensus.cc:359] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.972362  5191 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:21.973122  5191 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:21.980726  5191 ts_tablet_manager.cc:1434] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:18:21.990234  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-0334f31959bc48878664996813e359b4 received from {username='slave'} at 127.0.0.1:54764
I20260709 13:18:21.990795  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-0334f31959bc48878664996813e359b4 on tablet 0334f31959bc48878664996813e359b4 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:22.126276  4925 raft_consensus.cc:1217] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:22.273753  4925 raft_consensus.cc:1217] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:22.382097  4925 raft_consensus.cc:1217] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:22.402578  5171 raft_consensus.cc:1064] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:22.409812  5171 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:22.431484  4925 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.434983  5193 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.458166  4216 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.460739  4294 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.461382  5086 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.474200  5171 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.492736  5194 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.495159  4925 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.502326  4294 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.528702  4218 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.540409  4042 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.600096  4142 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:22.614282  4294 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.614642  4928 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.615933  5194 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.616986  5171 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.632774  5193 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.643708  4294 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.654350  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 729a3ec3cbd04254ac398836ae71b77d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:22.653687  4928 raft_consensus.cc:2955] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.670698  4041 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.710265  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet 729a3ec3cbd04254ac398836ae71b77d with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44140
I20260709 13:18:22.751298  5109 raft_consensus.cc:1064] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:22.754137  5109 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:22.756819  5171 raft_consensus.cc:1064] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:22.761984  5171 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:22.777069  4925 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.780510  5193 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.785979  5217 tablet_replica.cc:333] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:18:22.796322  4218 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.798097  5194 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.798998  5217 raft_consensus.cc:2243] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.802693  5217 raft_consensus.cc:2272] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.811372  4216 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.807195  4294 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.811805  4928 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.813191  4142 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.813498  5152 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.814947  5212 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.816004  5152 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.817760  5206 raft_consensus.cc:1064] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:22.821898  5206 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:22.827059  5171 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.834182  5217 ts_tablet_manager.cc:1916] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:22.846937  5194 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.849304  4926 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.857486  4287 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.860294  4925 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.860029  5190 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.862627  5207 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.867430  4140 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.871546  5158 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.879145  4214 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:22.891417  4041 catalog_manager.cc:5697] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.934604  5212 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.021917  4214 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:23.023643  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76825.9us
I20260709 13:18:23.020627  4142 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:23.104936  5233 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:23.091710  5207 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:23.111637  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 83735.3us
I20260709 13:18:23.041693  4287 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.101985  4925 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.153880  4041 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.185073  5217 ts_tablet_manager.cc:1929] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:23.185775  5217 log.cc:1199] T 729a3ec3cbd04254ac398836ae71b77d P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/729a3ec3cbd04254ac398836ae71b77d
I20260709 13:18:23.185194  4044 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.188462  4925 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.191942  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet 729a3ec3cbd04254ac398836ae71b77d (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:23.210449  4147 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:23.210513  4287 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.217365  4926 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:23.219358  5230 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:23.229429  5194 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.232652  4146 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.240298  4926 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.277410  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9d67bbe0103433095fb80de46cf624d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:23.279568  4288 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:23.276975  4294 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:23.300335  4045 catalog_manager.cc:5697] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.301669  5231 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:23.309082  4214 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:23.310900  5236 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:23.322643  5198 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.323904  4925 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:23.346115  4030 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c130eddd78204cee994818f0043bf88c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:23.349383  4288 raft_consensus.cc:2955] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.369388  4218 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.368271  5198 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:18:23.379122  4214 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:23.384400  4926 raft_consensus.cc:2955] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.396592  4925 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:23.401604  5238 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:23.401929  4142 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:23.404388  4044 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.405587  5189 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:23.415081  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet e9d67bbe0103433095fb80de46cf624d with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44140
I20260709 13:18:23.416266  5217 tablet_replica.cc:333] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:18:23.417599  5217 raft_consensus.cc:2243] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.418407  5189 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.418416  5217 raft_consensus.cc:2272] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.433548  5217 ts_tablet_manager.cc:1916] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:23.444906  4137 tablet_service.cc:1558] Processing DeleteTablet for tablet c130eddd78204cee994818f0043bf88c with delete_type TABLET_DATA_TOMBSTONED (TS 32ebd3bc4af5446f94d9f3ac7c8cf53c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52128
I20260709 13:18:23.445418  4142 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.465184  4926 raft_consensus.cc:2955] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:23.483250  5217 ts_tablet_manager.cc:1929] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:23.484023  5217 log.cc:1199] T e9d67bbe0103433095fb80de46cf624d P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/e9d67bbe0103433095fb80de46cf624d
I20260709 13:18:23.485724  5239 tablet_replica.cc:333] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:18:23.486713  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet e9d67bbe0103433095fb80de46cf624d (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:23.487068  5239 raft_consensus.cc:2243] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.488075  5239 raft_consensus.cc:2272] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.495407  5239 ts_tablet_manager.cc:1916] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:23.509343  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0334f31959bc48878664996813e359b4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:23.552594  5239 ts_tablet_manager.cc:1929] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:23.553283  5239 log.cc:1199] T c130eddd78204cee994818f0043bf88c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/wals/c130eddd78204cee994818f0043bf88c
I20260709 13:18:23.712718  4031 catalog_manager.cc:5028] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): tablet c130eddd78204cee994818f0043bf88c (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:23.732856  4042 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:24.499442  4110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.012s	sys 0.012s
W20260709 13:18:24.500272  4110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.012s	sys 0.012s
W20260709 13:18:24.523731  4186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.000s	sys 0.024s
W20260709 13:18:24.524636  4186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.025s
I20260709 13:18:24.528729  5194 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.535842  5194 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.538333  5194 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.543905  5193 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.544668  5193 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.546957  5193 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.565147  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.581897  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:24.618865  4187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.018s	sys 0.003s
W20260709 13:18:24.619313  4187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.019s	sys 0.003s
I20260709 13:18:24.635905  5243 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.636626  5194 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.637291  5194 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.639211  5238 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.639698  5194 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.639812  5238 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.636644  5243 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.640861  5194 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:24.641629  5194 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:24.642325  5238 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.642772  5243 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.644886  5194 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:24.646288  5238 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:18:24.646636  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3860 after lost signal to thread 3024
W20260709 13:18:24.647966  4243 debug-util.cc:398] Leaking SignalData structure 0x7b080026f160 after lost signal to thread 4079
I20260709 13:18:24.646950  5238 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:24.649513  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4de0 after lost signal to thread 4171
W20260709 13:18:24.649843  4243 debug-util.cc:398] Leaking SignalData structure 0x7b080019d6e0 after lost signal to thread 4172
W20260709 13:18:24.651077  4243 debug-util.cc:398] Leaking SignalData structure 0x7b0800081180 after lost signal to thread 4246
I20260709 13:18:24.651124  5238 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:24.651499  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad8a0 after lost signal to thread 4247
I20260709 13:18:24.652588  5194 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:24.655438  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.657380  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.671900  5194 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.657801  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.659008  5256 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:24.660244  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.673870  5256 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:24.674471  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08003354a0 after lost signal to thread 4320
I20260709 13:18:24.666074  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.667414  5212 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:24.677591  5212 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:24.678391  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08002f47a0 after lost signal to thread 4953
W20260709 13:18:24.689080  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4300 after lost signal to thread 4954
I20260709 13:18:24.676766  5194 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.679992  5212 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:24.676463  5256 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.690654  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.680573  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.686635  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.688416  5243 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:24.689131  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.662714  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:24.703039  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:24.704612  5256 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.704873  5243 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.709213  5243 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.711212  5256 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:24.715126  5256 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.718755  5256 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.715158  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.711956  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.713786  5194 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.726071  5194 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.728940  5194 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.711491  5212 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:24.728854  5256 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.728377  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.729851  5212 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:24.730000  5256 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.733171  5212 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:24.719894  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.734057  5256 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.737299  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.738184  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.750200  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:24.752378  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:24.753254  4140 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:24.757062  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:24.757779  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.758767  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.765378  5256 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.766193  5256 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:24.767997  4261 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:24.768992  5255 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.770062  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.770975  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:24.773175  5256 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:24.777670  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.781602  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.783557  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.785495  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.786509  4187 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.787424  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.789211  5249 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:24.791208  5249 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.791841  5249 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:24.796257  5256 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:24.798764  5256 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.802207  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:24.813551  5249 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.832610  4042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 149) took 1306 ms. Trace:
I20260709 13:18:24.817191  5256 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.833917  5249 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:24.834102  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:24.834642  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet 0334f31959bc48878664996813e359b4 with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46838
I20260709 13:18:24.837550  4045 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 56) took 1225 ms. Trace:
I20260709 13:18:24.838065  4045 rpcz_store.cc:276] 0709 13:18:23.611842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.619866 (+  8024us) service_pool.cc:224] Handling call
0709 13:18:24.837469 (+1217603us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":974840,"reported_tablets":1}
I20260709 13:18:24.833505  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.842044  5256 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.842635  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.845731  5261 tablet_replica.cc:333] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:18:24.845616  5256 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.847071  5261 raft_consensus.cc:2243] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.847973  5261 raft_consensus.cc:2272] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.852579  5261 ts_tablet_manager.cc:1916] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:24.833189  4042 rpcz_store.cc:276] 0709 13:18:23.526266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.526433 (+   167us) service_pool.cc:224] Handling call
0709 13:18:24.832499 (+1306066us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:24.632025 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:24.739241 (+107216us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:24.739287 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:18:24.739312 (+    25us) tablet.cc:662] Decoding operations
0709 13:18:24.739745 (+   433us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:24.739845 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:24.739881 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:24.740111 (+   230us) tablet.cc:701] Row locks acquired
0709 13:18:24.740133 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:24.740308 (+   175us) write_op.cc:270] Start()
0709 13:18:24.754793 (+ 14485us) write_op.cc:276] Timestamp: P: 1783603104740253 usec, L: 0
0709 13:18:24.754932 (+   139us) op_driver.cc:348] REPLICATION: starting
0709 13:18:24.768467 (+ 13535us) log.cc:844] Serialized 532 byte log entry
0709 13:18:24.805450 (+ 36983us) op_driver.cc:464] REPLICATION: finished
0709 13:18:24.828700 (+ 23250us) write_op.cc:301] APPLY: starting
0709 13:18:24.828788 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:24.828899 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:24.829043 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:24.829272 (+   229us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:24.829440 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:24.829483 (+    43us) write_op.cc:312] APPLY: finished
0709 13:18:24.829733 (+   250us) log.cc:844] Serialized 22 byte log entry
0709 13:18:24.829946 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:24.830037 (+    91us) write_op.cc:454] Released schema lock
0709 13:18:24.830075 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:24.832534 (+  2459us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:24.832579 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":861988,"reported_tablets":1,"spinlock_wait_cycles":24832,"child_traces":[["op",{"apply.queue_time_us":22957,"apply.run_cpu_time_us":1749,"apply.run_wall_time_us":1754,"num_ops":1,"prepare.queue_time_us":33312,"prepare.run_cpu_time_us":4509,"prepare.run_wall_time_us":155281,"raft.queue_time_us":18676,"raft.run_cpu_time_us":11347,"raft.run_wall_time_us":29098,"replication_time_us":50366,"thread_start_us":146881,"threads_started":4,"wal-append.queue_time_us":16085}]]}
I20260709 13:18:24.864796  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.866029  5243 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.867383  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.868217  5243 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.869530  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.870263  5243 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.871593  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.872315  5243 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.873692  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.874454  5243 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.875852  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.877907  5243 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.879349  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.880164  5243 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.881680  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.882447  5243 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.898300  4222 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:24.904352  5212 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:24.905689  5234 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:24.906106  5234 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:24.907119  5234 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:24.908241  5234 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:24.927691  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:24.929001  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.930361  5261 ts_tablet_manager.cc:1929] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:24.931916  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:24.932593  5189 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.942704  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.942952  5261 log.cc:1199] T 0334f31959bc48878664996813e359b4 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/0334f31959bc48878664996813e359b4
I20260709 13:18:24.946861  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet 0334f31959bc48878664996813e359b4 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:24.966729  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:24.968385  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:24.991498  4187 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:24.992777  5189 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.994091  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:24.994944  5256 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.998603  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:25.000020  5256 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:25.000525  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:25.005970  5234 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:25.967193  4294 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:25.977766  4216 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:25.978091  4140 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:25.979521  4259 consensus_peers.cc:597] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcc0e559b40a475ea99ac69d7dbea6c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:25.980749  5212 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:25.984242  5212 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.015009  5212 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.019951  4145 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.027464  4216 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.044493  4216 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.055356  4042 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.059772  4294 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:26.060753  4185 consensus_peers.cc:597] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57a7dac49b784166afd62631b44900c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.062183  4145 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.062151  5189 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.063971  5246 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:26.094987  5189 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.102345  4143 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.099166  4294 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.145084  4143 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.166906  4294 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.157627  4044 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.168329  5256 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.169366  4218 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.169461  5235 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.170644  5235 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:26.171901  5243 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:26.172402  4110 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4661232a8b934fa0b9135bf4650bfd02. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.173205  5235 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:26.174263  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:26.174645  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:26.176506  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:26.177524  5235 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:26.190900  5194 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.197204  4222 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.220676  4222 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.221102  4042 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.234380  4294 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.247803  4292 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.248843  4143 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:26.249828  4185 consensus_peers.cc:597] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 151524a8517e4b8ebc7308777c98105e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.250510  5245 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:26.251852  5189 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:26.287406  5246 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.289505  4145 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.298372  4294 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.308780  4042 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:26.389746  5243 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:26.390527  5243 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:26.395426  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:26.396284  4222 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:26.396433  5243 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:26.396313  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:26.398046  4294 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:26.399201  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:26.399950  5243 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:26.400420  5243 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:26.403924  5243 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:26.416195  5243 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:26.418627  5243 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:26.419488  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:26.420396  4222 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:26.420594  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:26.429069  4287 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:26.431366  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:26.433571  5243 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:26.435045  5243 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:26.436066  5243 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:26.455816  4044 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 2, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 2 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.526260  5280 ts_tablet_manager.cc:933] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:26.531783  5280 tablet_copy_client.cc:323] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:18:26.533777  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 57a7dac49b784166afd62631b44900c8 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:18:26.534401  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 57a7dac49b784166afd62631b44900c8 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-57a7dac49b784166afd62631b44900c8
I20260709 13:18:26.550473  4232 tablet_copy_source_session.cc:215] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:26.554931  5280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a7dac49b784166afd62631b44900c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:26.575750  5282 ts_tablet_manager.cc:933] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:26.585357  5282 tablet_copy_client.cc:323] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.67:40585
I20260709 13:18:26.587559  4306 tablet_copy_service.cc:140] P 6f753b799f924bacb0a0f0f6e0068ee9: Received BeginTabletCopySession request for tablet fcc0e559b40a475ea99ac69d7dbea6c0 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:47710)
I20260709 13:18:26.588177  4306 tablet_copy_service.cc:161] P 6f753b799f924bacb0a0f0f6e0068ee9: Beginning new tablet copy session on tablet fcc0e559b40a475ea99ac69d7dbea6c0 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:47710: session id = b81584b21ed144698954548303f1e507-fcc0e559b40a475ea99ac69d7dbea6c0
I20260709 13:18:26.597087  4306 tablet_copy_source_session.cc:215] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:26.600950  5282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc0e559b40a475ea99ac69d7dbea6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:26.601598  5280 tablet_copy_client.cc:806] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:26.602380  5280 tablet_copy_client.cc:670] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:26.609748  5280 tablet_copy_client.cc:538] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:26.624634  5280 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:26.664080  5282 tablet_copy_client.cc:806] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:26.665077  5282 tablet_copy_client.cc:670] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:26.669803  5282 tablet_copy_client.cc:538] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:26.679049  5280 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.681058  5280 tablet_bootstrap.cc:492] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:26.681988  5280 ts_tablet_manager.cc:1403] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.058s	user 0.037s	sys 0.008s
I20260709 13:18:26.685976  5280 raft_consensus.cc:359] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.686981  5280 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:26.687822  5282 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:26.691725  5286 ts_tablet_manager.cc:933] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:26.687810  5280 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.744554  5280 ts_tablet_manager.cc:1434] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.062s	user 0.021s	sys 0.008s
I20260709 13:18:26.747236  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-57a7dac49b784166afd62631b44900c8 received from {username='slave'} at 127.0.0.1:54764
I20260709 13:18:26.747736  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-57a7dac49b784166afd62631b44900c8 on tablet 57a7dac49b784166afd62631b44900c8 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:26.766271  5280 ts_tablet_manager.cc:933] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:26.766489  5282 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.767602  5282 tablet_bootstrap.cc:492] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:26.768432  5282 ts_tablet_manager.cc:1403] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.081s	user 0.030s	sys 0.024s
I20260709 13:18:26.772823  5282 raft_consensus.cc:359] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.773846  5282 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:26.774561  5282 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.777347  5280 tablet_copy_client.cc:323] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:18:26.777693  5282 ts_tablet_manager.cc:1434] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:26.779531  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 151524a8517e4b8ebc7308777c98105e from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:18:26.779663  4306 tablet_copy_service.cc:342] P 6f753b799f924bacb0a0f0f6e0068ee9: Request end of tablet copy session b81584b21ed144698954548303f1e507-fcc0e559b40a475ea99ac69d7dbea6c0 received from {username='slave'} at 127.0.0.1:47710
I20260709 13:18:26.780151  4306 tablet_copy_service.cc:434] P 6f753b799f924bacb0a0f0f6e0068ee9: ending tablet copy session b81584b21ed144698954548303f1e507-fcc0e559b40a475ea99ac69d7dbea6c0 on tablet fcc0e559b40a475ea99ac69d7dbea6c0 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:26.780171  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 151524a8517e4b8ebc7308777c98105e from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-151524a8517e4b8ebc7308777c98105e
I20260709 13:18:26.796562  4232 tablet_copy_source_session.cc:215] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:26.801021  5280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151524a8517e4b8ebc7308777c98105e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:26.819185  5286 tablet_copy_client.cc:323] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:18:26.831748  5280 tablet_copy_client.cc:806] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:26.832516  5280 tablet_copy_client.cc:670] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:26.837896  5280 tablet_copy_client.cc:538] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:26.853442  5280 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:26.860793  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet 4661232a8b934fa0b9135bf4650bfd02 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:18:26.861631  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet 4661232a8b934fa0b9135bf4650bfd02 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-4661232a8b934fa0b9135bf4650bfd02
I20260709 13:18:26.871428  4156 tablet_copy_source_session.cc:215] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:26.884691  5286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4661232a8b934fa0b9135bf4650bfd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:26.901558  5280 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.902751  5280 tablet_bootstrap.cc:492] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:26.903672  5280 ts_tablet_manager.cc:1403] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.008s
I20260709 13:18:26.908082  5280 raft_consensus.cc:359] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.909060  5280 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:26.909793  5280 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.912269  5286 tablet_copy_client.cc:806] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:26.912940  5286 tablet_copy_client.cc:670] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:26.914314  5280 ts_tablet_manager.cc:1434] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:18:26.918433  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-151524a8517e4b8ebc7308777c98105e received from {username='slave'} at 127.0.0.1:54764
I20260709 13:18:26.918987  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-151524a8517e4b8ebc7308777c98105e on tablet 151524a8517e4b8ebc7308777c98105e with peer b81584b21ed144698954548303f1e507
I20260709 13:18:26.925246  4928 raft_consensus.cc:1217] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:26.925850  5286 tablet_copy_client.cc:538] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:26.940603  5286 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:26.942502  5290 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.943161  5290 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:26.951828  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:26.954073  4287 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:26.955565  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:26.952831  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:26.956923  4222 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:26.959170  5245 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:26.959650  5245 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.961344  5293 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.961859  5290 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:26.960057  5245 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.980670  5286 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.981906  5286 tablet_bootstrap.cc:492] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:26.983183  5286 ts_tablet_manager.cc:1403] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.043s	user 0.028s	sys 0.008s
I20260709 13:18:26.987012  5286 raft_consensus.cc:359] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.988088  5286 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:26.988943  5286 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:26.994614  5286 ts_tablet_manager.cc:1434] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:18:27.002842  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-4661232a8b934fa0b9135bf4650bfd02 received from {username='slave'} at 127.0.0.1:37124
I20260709 13:18:27.003810  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-4661232a8b934fa0b9135bf4650bfd02 on tablet 4661232a8b934fa0b9135bf4650bfd02 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:27.006184  5245 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:27.012208  4222 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:27.017323  5275 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:27.018460  5194 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:27.018872  5194 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:27.019731  5194 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:27.021152  5245 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:27.021371  5194 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:27.024669  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:27.024996  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:27.035197  4294 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:27.046996  4294 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:27.048522  4145 raft_consensus.cc:2410] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:27.049341  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:27.050858  5290 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:27.051426  5290 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:27.052402  5290 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:27.066720  4044 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 2 to 3, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:27.102648  4923 raft_consensus.cc:1217] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:27.180114  4923 raft_consensus.cc:1217] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:27.397758  4923 raft_consensus.cc:1217] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:27.434823  5291 raft_consensus.cc:1064] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:27.437816  4294 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:27.437904  5291 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:27.439742  5245 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.462060  4923 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.466405  5246 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.473814  4287 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.475816  5291 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:18:27.516863  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 51705us
I20260709 13:18:27.517704  5246 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.519106  4147 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.519826  4294 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.526985  4147 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:27.527489  4147 pending_rounds.cc:85] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 1
I20260709 13:18:27.527815  4147 pending_rounds.cc:107] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:27.528126  4147 raft_consensus.cc:2889] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.535310  5307 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.540011  4923 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.549023  5307 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:27.550109  4042 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.598644  4218 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:27.607003  4923 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:27.608847  5307 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:27.619094  4147 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.625938  4291 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:27.627769  5304 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.635627  4928 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.644138  5307 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:27.659528  4291 raft_consensus.cc:2955] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.664861  4042 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 4, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.690158  4137 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a7dac49b784166afd62631b44900c8 with delete_type TABLET_DATA_TOMBSTONED (TS 32ebd3bc4af5446f94d9f3ac7c8cf53c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52128
I20260709 13:18:27.691236  5235 raft_consensus.cc:1064] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:27.694687  5235 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:27.700644  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57a7dac49b784166afd62631b44900c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:27.729743  5293 raft_consensus.cc:1064] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:27.733636  5293 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:27.751466  4923 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.755507  5234 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.788630  4222 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.792701  5312 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.793006  4928 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.805910  4222 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.814473  4294 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.815496  5311 tablet_replica.cc:333] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:18:27.817715  5319 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.825940  5311 raft_consensus.cc:2243] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.803383  5243 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:18:27.826746  5311 raft_consensus.cc:2272] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.829761  5293 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:27.842952  5311 ts_tablet_manager.cc:1916] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:27.864449  4145 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.866321  5235 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.898546  5194 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:27.911641  4222 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:28.436970  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 119300us
W20260709 13:18:28.447259  4923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.003s	sys 0.013s
W20260709 13:18:28.447901  4923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.004s	sys 0.014s
W20260709 13:18:28.486011  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 48143.7us
W20260709 13:18:28.490028  4291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.016s	sys 0.003s
W20260709 13:18:28.491981  4291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.016s	sys 0.003s
I20260709 13:18:28.727411  5311 ts_tablet_manager.cc:1929] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:28.728013  5311 log.cc:1199] T 57a7dac49b784166afd62631b44900c8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/wals/57a7dac49b784166afd62631b44900c8
I20260709 13:18:28.729178  5311 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52128 (request call id 67) took 1039 ms. Trace:
I20260709 13:18:28.729595  5311 rpcz_store.cc:276] 0709 13:18:27.689737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.689982 (+   245us) service_pool.cc:224] Handling call
0709 13:18:27.815144 (+125162us) ts_tablet_manager.cc:1151] Deleting tablet 57a7dac49b784166afd62631b44900c8
0709 13:18:27.815229 (+    85us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:27.899507 (+ 84278us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:28.727227 (+827720us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:28.729101 (+  1874us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":112764,"thread_start_us":39193,"threads_started":1}
I20260709 13:18:28.775743  4923 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:28.791776  4222 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.876s	user 0.012s	sys 0.000s
I20260709 13:18:28.838802  4287 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:28.869741  4143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.006s	sys 0.013s
W20260709 13:18:28.871891  4143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.006s	sys 0.013s
I20260709 13:18:28.871213  5330 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:28.878165  5330 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:28.881314  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1059) took 1011 ms. Trace:
I20260709 13:18:28.885797  4143 rpcz_store.cc:276] 0709 13:18:27.870210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.870348 (+   138us) service_pool.cc:224] Handling call
0709 13:18:27.870875 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.871279 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.871320 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.872327 (+  1007us) log.cc:844] Serialized 556 byte log entry
0709 13:18:28.877572 (+1005245us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:28.877623 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.877700 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.881030 (+  3330us) raft_consensus.cc:1685] finished
0709 13:18:28.881047 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.881219 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1002100,"threads_started":1,"wal-append.queue_time_us":610522}
I20260709 13:18:28.889853  5330 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:28.890133  5319 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:28.891431  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:28.925797  5339 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:28.926626  5339 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:28.929617  5339 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:28.939145  4042 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:28.966647  5339 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:28.968191  4031 catalog_manager.cc:5028] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): tablet 57a7dac49b784166afd62631b44900c8 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:28.967905  5339 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:28.970539  5339 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:28.986586  5330 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:28.989776  5330 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:29.031168  4214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.006s	sys 0.014s
W20260709 13:18:29.031602  4214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.006s	sys 0.014s
I20260709 13:18:29.032403  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1097) took 1160 ms. Trace:
I20260709 13:18:29.032788  4214 rpcz_store.cc:276] 0709 13:18:27.871640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.871758 (+   118us) service_pool.cc:224] Handling call
0709 13:18:27.872383 (+   625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.872747 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.872775 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.873718 (+   943us) log.cc:844] Serialized 556 byte log entry
0709 13:18:29.031981 (+1158263us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:29.032026 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.032098 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.032142 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:29.032154 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.032293 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1157943,"threads_started":1,"wal-append.queue_time_us":597858}
I20260709 13:18:29.038465  5340 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.039295  5340 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.042572  5340 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.034590  5339 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.044549  5339 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.080403  5340 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.081415  5340 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.087347  5330 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.089104  5330 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.163653  5330 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.167191  5330 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.129838  5331 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.280704  5331 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.284228  5331 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.286751  5331 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.287613  5331 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.290592  5331 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.168826  5329 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.291462  5329 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.294580  5329 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.089970  5340 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.155167  5339 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.301506  5330 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.302860  5339 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.303849  5339 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.307927  5351 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.308765  5351 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.369500  5346 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.370615  5346 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.309198  5339 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.377203  5329 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.429212  5329 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.429628  5349 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.428655  5339 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.379431  5351 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.377519  5340 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.427842  5347 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.374729  5346 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.473042  5347 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.459767  5341 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.474617  5341 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.469794  5344 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.473815  5350 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.473996  5328 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.414011  5345 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.472007  5340 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.443236  5349 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.470995  5352 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.426049  5330 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.478588  5344 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.459285  5339 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.480091  5351 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.490837  5338 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.511420  5341 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.485642  5347 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.491592  5346 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.554148  5330 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.555603  5354 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.557788  5346 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.561200  5346 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.562435  5329 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.563473  5340 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.565426  5349 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.480916  5328 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.577453  5344 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.578879  5328 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.497593  5338 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.580837  5363 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.581329  5338 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.482088  5350 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.581571  5363 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.583936  5350 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.482622  5345 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.573695  5360 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.493129  5351 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.556546  5354 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.586953  5345 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.585585  5360 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.583968  5363 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.588310  5354 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.588642  5351 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.589208  5363 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.589949  5363 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.484722  5352 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.593394  5363 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.593956  5363 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.594192  5352 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.593864  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:29.594692  5363 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.596082  5317 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.596706  5317 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.597407  5363 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:29.607326  5319 consensus_meta.cc:287] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.008s
I20260709 13:18:29.598893  5317 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.610406  5360 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.692028  5345 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.694370  5345 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.695713  5354 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.692097  5352 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.696656  5354 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.697760  5352 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.703815  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:29.704854  5319 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.706671  4928 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:29.716163  5332 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.717324  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:29.713318  5354 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.708199  5319 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.738818  5360 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.739492  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:29.741973  5337 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.743729  5363 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.744866  5362 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.745028  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:29.734120  5317 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.734802  5344 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.717769  5332 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.757277  5317 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.748550  4892 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:29.778066  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 297301us
I20260709 13:18:29.781184  5344 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.782790  5338 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.783906  5338 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.786798  5346 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.790225  5341 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.791219  5341 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.778105  4291 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:29.793259  5353 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.808049  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:29.809571  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:29.810693  4287 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:29.793975  5328 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.794215  5351 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:29.797324  5317 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.797550  5349 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.813079  5317 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:18:29.779842  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45762.4us
I20260709 13:18:29.786990  5338 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.787637  5346 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.809638  4294 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:29.821905  5354 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.824003  5354 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.825048  5363 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.827718  5363 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.828632  5344 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.828392  5360 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.828668  5354 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.832537  5335 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.833261  5340 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.840582  5317 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.840930  5340 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.813428  5349 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:29.835084  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:29.835242  5362 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:29.798390  5337 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.847136  4892 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:29.847621  5340 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.845686  5363 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.849368  5360 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.812562  5328 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:29.841003  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:18:29.853360  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 108823us
I20260709 13:18:29.854771  5367 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:29.856564  5368 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.859107  5349 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.806102  5353 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.867446  5363 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.861841  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:29.866133  5351 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:29.870886  5367 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.871095  5351 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.871469  5367 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.871599  5351 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.872269  5353 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.872766  5328 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.860005  5332 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.880007  5364 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.867676  5368 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.864498  5346 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.889684  5353 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:29.889510  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:29.897699  4923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 122) took 1021 ms. Trace:
I20260709 13:18:29.901183  4923 rpcz_store.cc:276] 0709 13:18:28.875749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.875923 (+   174us) service_pool.cc:224] Handling call
0709 13:18:28.876291 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.880697 (+  4406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.880738 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.880794 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:28.880831 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.894855 (+1014024us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5400560ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:29.894942 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.897398 (+  2456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9586560}
I20260709 13:18:29.904250  5339 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.904901  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:29.905258  5353 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.905959  5337 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.900164  5330 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:29.897326  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:29.921439  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:29.922346  4243 debug-util.cc:398] Leaking SignalData structure 0x7b080032d860 after lost signal to thread 3024
I20260709 13:18:29.885962  5317 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:29.877398  5335 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.918893  5330 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.903625  5364 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.925969  5330 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.926883  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.929962  5347 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:29.930474  5347 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:29.930585  5319 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.930909  5347 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.931787  5341 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.922417  4217 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:29.938182  5333 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.936447  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.939131  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.939088  5333 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:29.935223  5353 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.950541  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.953241  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.954758  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:29.947556  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:29.961427  4243 debug-util.cc:398] Leaking SignalData structure 0x7b080032e240 after lost signal to thread 4079
I20260709 13:18:29.962782  5345 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.942958  5354 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:29.977015  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.976966  5352 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:29.981673  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.982142  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:29.982978  4287 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:29.983039  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.985065  5363 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:29.986912  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.988402  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:29.989840  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.991534  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.993245  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.984934  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.996802  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:29.999571  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.000394  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.010008  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.016677  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.009584  5354 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.041703  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.042578  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.044661  4215 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.047894  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.050659  5336 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:30.053369  4243 debug-util.cc:398] Leaking SignalData structure 0x7b0800093ac0 after lost signal to thread 4171
I20260709 13:18:30.057368  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:30.057862  4243 debug-util.cc:398] Leaking SignalData structure 0x7b0800219700 after lost signal to thread 4246
I20260709 13:18:30.058763  4042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 152) took 1194 ms. Trace:
W20260709 13:18:30.059669  4243 debug-util.cc:398] Leaking SignalData structure 0x7b080025c2c0 after lost signal to thread 4320
I20260709 13:18:29.997851  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:30.053224  5343 raft_consensus.cc:1064] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:30.031965  5364 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:30.069845  5333 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.059360  4042 rpcz_store.cc:276] 0709 13:18:28.863962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.864150 (+   188us) service_pool.cc:224] Handling call
0709 13:18:28.922052 (+ 57902us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:30.058462 (+1136410us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:29.028708 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:29.048826 (+ 20118us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:29.048880 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:18:29.048906 (+    26us) tablet.cc:662] Decoding operations
0709 13:18:29.049403 (+   497us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:29.049504 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:29.049552 (+    48us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:29.049823 (+   271us) tablet.cc:701] Row locks acquired
0709 13:18:29.049848 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:18:29.050049 (+   201us) write_op.cc:270] Start()
0709 13:18:29.050210 (+   161us) write_op.cc:276] Timestamp: P: 1783603109049983 usec, L: 0
0709 13:18:29.050239 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:29.051279 (+  1040us) log.cc:844] Serialized 594 byte log entry
0709 13:18:29.608828 (+557549us) op_driver.cc:464] REPLICATION: finished
0709 13:18:29.968441 (+359613us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b18002d50e0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbc32a6 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1
0709 13:18:29.970108 (+  1667us) write_op.cc:301] APPLY: starting
0709 13:18:29.978428 (+  8320us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:29.988801 (+ 10373us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:29.988845 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:29.989207 (+   362us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:29.989582 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:29.989799 (+   217us) write_op.cc:312] APPLY: finished
0709 13:18:29.990268 (+   469us) log.cc:844] Serialized 22 byte log entry
0709 13:18:29.991918 (+  1650us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:29.992073 (+   155us) write_op.cc:454] Released schema lock
0709 13:18:29.992139 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:29.992823 (+   684us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:29.992850 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":12140928,"child_traces":[["op",{"apply.queue_time_us":20778,"apply.run_cpu_time_us":3159,"apply.run_wall_time_us":22796,"num_ops":1,"prepare.queue_time_us":36945,"prepare.run_cpu_time_us":9998,"prepare.run_wall_time_us":417331,"raft.queue_time_us":116870,"raft.run_cpu_time_us":8525,"raft.run_wall_time_us":21329,"replication_time_us":558372,"spinlock_wait_cycles":4590592,"thread_start_us":536649,"threads_started":4,"wal-append.queue_time_us":422995}]]}
I20260709 13:18:30.053622  5336 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.055570  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.073004  5362 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:30.059827  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.075114  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.053153  5335 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.084645  5336 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.097167  4044 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 164) took 1121 ms. Trace:
I20260709 13:18:30.102960  4044 rpcz_store.cc:276] 0709 13:18:28.975909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.976083 (+   174us) service_pool.cc:224] Handling call
0709 13:18:30.096907 (+1120824us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4118,"reported_tablets":1}
I20260709 13:18:30.096225  5368 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:30.060235  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08003277a0 after lost signal to thread 4321
I20260709 13:18:30.101274  5354 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:30.071616  5367 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.104046  5319 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:30.065264  5343 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.113936  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.119022  5319 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.115227  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:30.111773  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2760 after lost signal to thread 4953
I20260709 13:18:30.125705  5319 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:30.137931  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.138041  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.117887  5330 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.138041  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:30.143289  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.148545  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.133131  5367 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:30.150473  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.169859  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.158722  4143 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:30.172648  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.173653  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.173971  5347 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.177091  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:30.175953  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.179028  4294 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.179386  5351 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.164750  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.185593  5367 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:30.185685  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.186321  5367 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.186761  5367 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.187211  4928 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.188649  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.189635  4927 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.191452  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:30.196416  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:30.197072  4294 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.205817  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.207553  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.208782  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.216770  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.216905  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.217918  4291 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.217145  4145 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.218619  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:30.220564  4921 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:30.222646  5328 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:30.226625  5330 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.226877  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:30.227377  5330 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.227561  4291 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.228008  5330 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.231422  4294 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:30.232717  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:30.236287  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:30.236989  4287 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.237571  5371 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.213316  5347 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.251377  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.253168  4287 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:30.254524  4892 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:30.255388  5367 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.258108  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.258915  4292 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.259755  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.259709  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.260130  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.260664  4293 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.260962  4296 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.262722  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.241968  5351 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.238278  5371 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.291456  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.292030  4927 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:30.265718  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.255467  5372 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:30.259152  5347 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:30.267920  5368 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:30.269434  5354 consensus_queue.cc:1059] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:30.273389  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.273593  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.275324  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:30.275424  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.299387  4142 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:30.276679  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.299860  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.298182  5347 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:30.300069  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.277951  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.279464  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.280511  4291 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:30.281291  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.280452  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.302492  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.285334  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:30.304370  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:30.304972  4294 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:30.286330  5330 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.286517  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.288679  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.306635  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.306859  4288 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.292419  4292 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.294840  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.296742  5354 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:30.308995  4289 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.309113  5354 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:30.296845  5368 raft_consensus.cc:3055] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:30.277135  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:30.309969  5368 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:30.310237  5354 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.311096  5368 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.312031  5354 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.312996  5368 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.315096  5328 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.316032  5349 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.316713  5349 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.317154  5371 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.318854  5331 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.319084  5349 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.319784  5349 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.319590  5331 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.327539  5331 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.315886  5328 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.321089  5329 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.328771  5329 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.328363  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.331161  5329 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:30.323609  5243 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.331971  5243 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.334383  5243 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.322926  5350 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:30.327394  5362 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:30.323182  5367 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.329129  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.322419  5349 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.338148  4292 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.335214  5362 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.339617  5349 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.339677  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:30.301249  5347 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.346948  4924 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:30.347113  4927 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:30.353652  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.355739  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.348898  5351 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:30.360016  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.363883  4143 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:30.355468  4185 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:30.351886  5362 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:30.385927  5372 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:30.388996  4110 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:30.378268  5364 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:30.395756  5364 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.398306  5364 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:30.381269  5336 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:30.379151  5351 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:30.403499  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.387279  5372 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:30.379484  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 75250.2us
I20260709 13:18:30.410785  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.402987  5367 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:30.411289  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.411737  4145 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:30.395746  5328 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.405687  5336 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.419198  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.423812  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.415899  5376 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.425145  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.424871  5376 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.427449  5351 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.423873  4924 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:30.414409  5367 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.445004  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:30.445875  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:30.421679  5336 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.445160  5349 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.448519  5377 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.449133  5377 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.450806  5376 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.451503  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.443722  5367 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.452208  4214 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:30.453831  5349 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.455098  5333 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:30.443321  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:30.457437  5243 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.458930  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:30.459718  5243 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.462371  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.466308  4214 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:30.471933  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:30.475466  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.476716  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:30.456094  5349 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.485859  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.486809  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.451438  5377 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.489075  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.491382  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.491730  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.492172  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.491618  4219 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:30.493645  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.523277  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.527644  4928 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.513492  5377 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.534072  5329 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:30.522547  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46007.6us
I20260709 13:18:30.536665  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:30.537137  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.538301  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:30.539779  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:30.539896  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:30.514703  5336 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.540793  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.541841  5353 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.542604  5336 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:30.541953  5376 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.517149  5349 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.545634  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:18:30.547029  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.529130  5339 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.567606  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:30.557631  5371 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.570135  5371 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.572650  5349 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.575435  5362 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:30.576491  4289 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.551503  5347 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.575366  5349 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.585651  4296 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.576097  5362 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.576167  5337 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.593216  5362 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:30.598304  5368 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:30.601603  5336 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:30.602195  5336 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:30.582129  5339 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.603451  5336 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.604808  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.605826  5336 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.605991  5339 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.608503  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:30.609274  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69687us
I20260709 13:18:30.612533  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.610242  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.613265  4290 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:30.614220  5347 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.622761  5243 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.624531  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.630878  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.631033  5243 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.632612  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.633576  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.637194  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:30.584254  5367 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.665130  4139 raft_consensus.cc:2393] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:30.666230  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.668401  5367 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:30.668968  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.669278  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.669727  4921 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.672521  5337 consensus_queue.cc:1059] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:30.673573  5337 consensus_queue.cc:1243] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer b81584b21ed144698954548303f1e507 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:30.674212  5337 raft_consensus.cc:3055] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:30.676816  5337 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:30.677433  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.668224  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.678753  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:30.683090  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 162609us
I20260709 13:18:30.680791  4187 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:30.687582  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.702255  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.704276  5243 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.709134  4044 catalog_manager.cc:5697] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 2, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.715831  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.720144  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.722867  4289 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.724555  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4661232a8b934fa0b9135bf4650bfd02 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:30.724725  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:18:30.732766  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.733174  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.705320  5336 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:30.732064  4218 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:30.705736  5340 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.755684  5243 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:18:30.756450  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.751943  5339 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.784771  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.784991  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.788887  5243 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.798436  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.800055  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.747347  5336 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.804129  5336 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.782168  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.811331  5243 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:30.816442  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 90669.2us
I20260709 13:18:30.752391  4141 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:30.817394  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.819223  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.823729  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.824457  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.825665  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.790529  5339 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.826936  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.827811  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.828095  5339 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.828117  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.812229  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.831840  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.770746  5337 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.847661  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.847764  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.848227  4893 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:30.845335  4042 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.851768  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.851814  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.852547  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.788089  5340 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.863127  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.855419  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.858480  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.857256  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.851116  5330 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.868878  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.872550  4294 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:30.876655  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:30.878762  5339 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.881377  4259 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:30.880923  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.868731  4138 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.886747  4921 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:30.889933  5351 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:30.879496  5339 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.892761  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:30.893407  5339 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.871731  4293 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:30.896028  4185 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:30.905931  4259 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:30.907087  5364 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.908411  5343 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:30.908576  4921 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:30.909034  5343 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:30.910197  5343 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:30.918577  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.928758  4220 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:30.929440  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.930631  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:30.932044  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:30.932068  5367 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:30.928716  5330 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.933121  5333 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.932915  5367 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.933813  5333 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.935163  5367 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.936833  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.937229  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.938867  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.939069  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.924091  5336 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:30.940704  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:30.941001  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:30.942585  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.943382  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.944495  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.946097  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.947801  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.948274  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.950186  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:30.950342  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.950843  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.951666  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.951565  5330 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:30.952988  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.953101  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.953390  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:30.959506  5336 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.963476  5340 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:30.964540  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:30.968725  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:30.968312  5336 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:30.972514  5368 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:30.972505  5336 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:30.973206  5336 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.976706  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:30.987308  4213 raft_consensus.cc:2955] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:30.960541  5363 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:18:31.007040  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:31.010569  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.014205  4222 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:31.012660  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.006127  5368 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.020547  5330 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:31.022193  5368 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.024878  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:31.033196  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 182137us
I20260709 13:18:31.035327  5390 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.051831  5336 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.045606  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.052520  5329 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.060652  4186 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:31.062068  5329 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.062506  5329 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.063192  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.061574  5354 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.065980  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:31.071298  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 62946.1us
I20260709 13:18:31.024508  5345 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.072257  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.079418  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.080969  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.069180  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.056499  5335 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.069772  5343 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.073132  5353 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.082504  5341 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.082377  5368 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:31.082278  5333 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.110039  4921 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:31.113215  5336 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.114876  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.116230  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.117234  5340 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.117654  5350 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.117733  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.118328  5350 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.118774  5350 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.119226  5328 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.119726  5328 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.120098  5328 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.121456  4222 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.119143  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.096797  5345 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:31.141263  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 72250.2us
I20260709 13:18:31.155676  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.117668  5340 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.130832  5329 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.161891  5340 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.162230  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.158034  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.132006  5394 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.153937  5381 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.182924  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.166270  5388 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.187064  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.194201  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.196434  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.206058  4287 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:31.193796  5363 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.193081  5391 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.212150  5397 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.220643  5329 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.222684  5329 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.223166  5329 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.223589  5329 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.193796  5364 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.199724  5380 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.184389  5381 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.226660  5381 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.227123  5337 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.207998  4293 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:31.228751  5350 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.285072  5350 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.302074  4922 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.305014  5394 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:31.310127  5340 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.321410  5328 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.330021  5381 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.332378  5330 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:31.333104  5340 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.330256  4287 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:31.332463  5351 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:18:31.336787  5387 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:31.337282  5387 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:31.338902  5387 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:31.345041  5329 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.348218  5387 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.351456  4217 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:31.355389  5351 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:31.355861  5329 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.356423  5328 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.357847  5381 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:31.381609  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 300726us
W20260709 13:18:31.385672  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 223538us
I20260709 13:18:31.387418  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.389634  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.390642  5339 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:31.391075  5339 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.391498  5339 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.391762  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:18:31.392767  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 196451us
I20260709 13:18:31.393805  4261 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.400712  4222 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.401142  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.404012  5368 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.406669  5410 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.412408  4186 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.413883  5368 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.420558  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.422051  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.413889  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.430470  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:31.436913  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.442306  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.443233  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.437990  5328 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.440092  5368 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.439286  5381 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.449877  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.470057  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.471467  4221 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.459460  5329 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:31.475565  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45231us
I20260709 13:18:31.459455  5381 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.487486  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.450428  5328 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.490804  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.474064  5345 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.473964  5337 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.501219  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.509143  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.486832  4045 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 2, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:31.505599  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.473781  5407 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.517495  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.517678  4111 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.501520  5381 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.521252  5243 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.476354  5353 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:18:31.500591  5328 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.521811  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.536038  4222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0334f31959bc48878664996813e359b4"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:18:31.540989  4222 raft_consensus.cc:606] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:31.541419  4222 raft_consensus.cc:614] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:31.537842  5405 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.538308  5339 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.501709  5397 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:18:31.541834  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.559659  5243 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.543833  5331 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.564675  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.544723  5408 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:31.572917  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.573864  5243 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:31.574570  5416 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:18:31.575021  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.576027  5367 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.576683  5329 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.577653  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.558251  4921 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:31.579563  5340 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.580458  5408 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.580988  5408 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.581449  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.582283  5340 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.584103  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:31.565548  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.600s (SENT) [suppressed 4 similar messages]
I20260709 13:18:31.585624  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:31.586614  5340 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.587289  5340 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.588608  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.589439  5340 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.590761  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.552733  5405 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:31.594597  5340 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.600723  5339 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.601403  5364 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:31.601899  5364 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:31.602861  5364 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.604384  5405 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.604993  5364 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:31.618165  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57552us
I20260709 13:18:31.620018  5410 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:31.611618  5381 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.623303  5410 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.592123  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.625775  5329 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.626199  5410 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:31.627918  5381 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.628542  5410 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:31.628856  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:31.630549  5362 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:31.631095  5362 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.632527  5387 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:31.633503  5387 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.636201  5387 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:31.638377  5362 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:31.640106  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.642668  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.645423  4289 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:31.645526  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.649049  5341 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:18:31.656050  4143 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.656611  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:31.657255  5339 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:31.671257  5328 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.675720  4145 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.676587  4143 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.648486  5329 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.683068  4140 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.648097  5340 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.671020  4139 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:31.679092  4147 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.690012  4142 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.693766  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:31.699985  4145 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.701748  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.702252  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:31.704838  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:31.650007  5331 consensus_queue.cc:1059] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:18:31.709074  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.712158  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.713491  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.714079  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.715059  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.715914  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.716163  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:31.694479  4042 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.721460  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.730100  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.759660  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.760906  4925 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:31.760913  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.728858  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:31.765321  4138 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.770138  5341 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:31.723714  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:31.771716  5341 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:31.772710  5337 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:31.773155  5353 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.773787  5337 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:31.775354  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.764041  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:31.758383  5388 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.785615  5418 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:31.774180  5337 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:31.721982  5351 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.741309  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.725780  5363 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.726307  4921 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:31.804996  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 63871.3us
I20260709 13:18:31.806142  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:31.818209  5410 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.818900  5336 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:31.819517  5336 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:31.800746  5353 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:18:31.819763  5408 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.804291  5319 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:31.820915  5319 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:31.822055  5408 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.822930  4146 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.823047  5319 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:31.772022  5343 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:31.818218  4141 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:31.832267  5388 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.789855  5418 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:31.845973  5337 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.847918  5343 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:31.848502  5343 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:18:31.852425  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.859058  5319 consensus_queue.cc:1059] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:31.859303  5343 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.860442  5319 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:31.860909  5319 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:31.861070  5343 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.862166  5319 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:31.863754  5319 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:31.865396  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:31.846055  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.860478  5349 raft_consensus.cc:3055] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:31.810925  5362 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:31.848644  5418 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.847971  5337 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:31.889024  5407 consensus_queue.cc:1175] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:18:31.868841  5349 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:18:31.899864  5423 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:18:31.904269  4045 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 2, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:31.911078  5328 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:31.914247  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:31.912707  4045 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 2, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:31.915736  5380 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:31.894762  5362 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.882659  5336 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:31.965023  4928 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:31.983732  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.997427  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:32.000790  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.001830  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.002691  4144 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:32.003685  4142 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:32.006973  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.012132  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:32.018280  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.010128  4143 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:31.945490  5380 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.026126  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet 4661232a8b934fa0b9135bf4650bfd02 with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46838
I20260709 13:18:32.038774  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:31.949980  5349 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.041764  5339 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.043882  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.045344  5388 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:32.049274  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.017146  5353 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:18:32.008994  5368 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:32.050206  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.055145  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.046396  5387 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:32.057130  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.049291  5349 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.049347  5339 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.038789  5405 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.024240  5407 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:18:32.055094  5329 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:32.086066  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 173033us
I20260709 13:18:32.049346  5388 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:32.065425  5387 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.127410  5362 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:32.072548  5425 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.991551  5409 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:32.060828  5408 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.143378  4147 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:32.146755  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59017.9us
I20260709 13:18:32.149880  5243 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:32.151319  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 94306us
I20260709 13:18:32.154738  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.143440  5353 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:32.145727  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 230176us
I20260709 13:18:32.167711  5353 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:18:32.200014  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 198036us
I20260709 13:18:32.201347  4187 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.191670  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.175349  5329 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.202785  5431 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:32.203248  5329 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.203725  5431 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:32.206835  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.207396  5431 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:32.175618  5380 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:32.210444  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.211427  5243 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:32.212749  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.208021  5329 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.229528  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:32.217576  5339 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.215476  5380 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:32.246647  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.234817  5343 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.252432  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.253569  5243 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.251271  5380 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.251120  5329 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.252564  5405 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:32.280005  5380 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:32.299299  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 98079.2us
I20260709 13:18:32.298357  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:32.257066  5343 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:32.301623  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 352095us
I20260709 13:18:32.311825  5437 tablet_replica.cc:333] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:18:32.312757  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.314702  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.315681  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.254559  5353 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.294126  5387 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:32.323277  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.325512  5362 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:32.326874  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.330675  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.331995  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.315984  5446 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.329290  5435 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.334095  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.330188  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.335525  4146 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:32.337602  5436 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:32.338104  5436 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:32.343318  5243 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.326203  5387 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 13:18:32.334141  5428 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:32.343979  5243 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:32.342413  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.361734  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:32.352458  5388 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:32.339221  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 83329.8us
I20260709 13:18:32.361289  5243 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:32.342952  5397 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.334565  5446 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:32.337862  4187 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.374548  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.367004  5418 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:32.386969  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49070.4us
I20260709 13:18:32.391871  5435 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.384173  5368 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:32.377683  5362 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.384985  5441 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.339257  5436 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.417008  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.417712  5436 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.394415  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:32.380486  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.399256  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:32.404744  5333 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:32.407405  5343 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:32.410151  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:32.377291  5409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46838 (request call id 66) took 1041 ms. Trace:
I20260709 13:18:32.398097  5368 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:18:32.434325  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53969.9us
I20260709 13:18:32.435487  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:32.419657  4214 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:32.431315  5446 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:32.446058  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:32.433282  5442 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.447371  4215 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:32.453589  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:32.454294  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:18:32.454814  5441 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.454890  4146 raft_consensus.cc:606] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Received request to transfer leadership to TS b81584b21ed144698954548303f1e507
I20260709 13:18:32.445240  4921 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:32.459736  5368 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:32.461259  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48185.5us
I20260709 13:18:32.460640  5345 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:32.466362  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:32.466025  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:32.467478  5440 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:32.468389  5336 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.476744  5440 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:32.447551  5354 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:32.469285  5331 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:32.465567  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:32.491708  5331 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.492331  5331 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.474462  5387 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.448861  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.480684  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.488508  5354 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:32.499698  5337 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:32.494249  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.513371  4145 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:32.498077  5439 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:32.500555  5354 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.515980  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:32.518579  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.519280  5439 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.519779  5439 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.494971  5343 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:32.523267  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.528409  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:32.528694  5343 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:32.529072  5343 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:32.530000  5343 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.531311  5343 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.532115  4143 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:32.532691  5410 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.533876  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:18:32.534724  4142 raft_consensus.cc:606] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Received request to transfer leadership to TS b81584b21ed144698954548303f1e507
I20260709 13:18:32.522501  5388 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.541476  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.554138  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:32.478295  5440 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.565994  5437 raft_consensus.cc:2243] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:32.566908  5437 raft_consensus.cc:2272] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:32.431787  5409 rpcz_store.cc:276] 0709 13:18:31.326537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.327828 (+  1291us) service_pool.cc:224] Handling call
0709 13:18:31.343895 (+ 16067us) log.cc:844] Serialized 494 byte log entry
0709 13:18:31.570785 (+226890us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:32.367940 (+797155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2471,"raft.queue_time_us":2837,"raft.run_cpu_time_us":1105,"raft.run_wall_time_us":1105,"spinlock_wait_cycles":3647744,"thread_start_us":158071,"threads_started":1,"wal-append.queue_time_us":160738}
I20260709 13:18:32.556331  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:32.574676  4030 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fcc0e559b40a475ea99ac69d7dbea6c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:32.587033  4261 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:18:32.590046  4261 raft_consensus.cc:2686] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:32.599443  5372 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.602324  5372 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:32.604676  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:32.606993  5435 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:32.607417  5435 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:32.608278  5435 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.605573  4143 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:32.610836  5435 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.613237  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:32.603626  4145 raft_consensus.cc:2955] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:32.619840  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.621081  5336 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:32.629962  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.622092  5431 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.632562  5445 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:18:32.626801  5345 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:32.640743  5345 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:32.641163  5345 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:32.642015  5345 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:32.643047  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.644533  5349 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.643746  5437 ts_tablet_manager.cc:1916] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:32.637231  5410 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:32.647917  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.636201  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.643276  5345 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.649380  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:32.654773  5410 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.659844  5372 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:32.659699  4922 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:32.669591  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.670257  4143 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:32.671515  4893 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:32.671561  5368 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.675180  5372 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:32.675697  5372 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.676049  5372 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:32.731055  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45365.6us
I20260709 13:18:32.661906  5390 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.684175  4295 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:32.737407  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.744566  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59570.4us
I20260709 13:18:32.745877  5354 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.755451  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:32.756217  4288 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:32.762614  5440 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.810519  4044 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:32.837833  5331 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:32.839381  4138 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:32.849510  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:18:32.851502  4144 raft_consensus.cc:606] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Received request to transfer leadership to TS b81584b21ed144698954548303f1e507
I20260709 13:18:32.854578  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:32.855263  4217 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.856004  5243 raft_consensus.cc:993] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:32.856508  5243 raft_consensus.cc:1081] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Signalling peer b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:32.856770  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:32.852113  5331 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:32.885586  4925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d"
dest_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:42922
I20260709 13:18:32.893500  4925 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:32.893963  4925 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.902817  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:18:32.910871  5328 raft_consensus.cc:993] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:32.969874  4144 raft_consensus.cc:606] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:32.971306  5328 raft_consensus.cc:1081] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Signalling peer b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:32.972543  5439 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:32.973959  4928 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:18:32.991320  4928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02"
dest_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:42922
I20260709 13:18:32.992441  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:32.993381  4147 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:32.993824  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:32.940699  5445 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:32.994174  4928 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:33.000175  4928 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:32.962826  5362 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.545s	user 0.015s	sys 0.001s
I20260709 13:18:33.001062  5362 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:33.001768  4138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6b9a320ff854b5998471937010702d5"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:18:32.995182  5387 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.005440  5387 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.007730  5387 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.007253  5331 raft_consensus.cc:993] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:33.008852  5331 raft_consensus.cc:1081] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Signalling peer b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:32.996207  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:33.010035  5429 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:32.996767  5439 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.012382  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:32.959939  5353 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.004539  4289 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.017832  4921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd"
dest_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:42922
I20260709 13:18:33.018575  4921 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:33.019024  4921 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.022151  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:32.963388  5388 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:33.023082  4145 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:32.949486  5372 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.007473  4925 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.046213  5372 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.047838  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:33.048064  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:33.048767  4293 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.049816  4925 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.050055  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:33.050693  4289 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.043545  4921 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.047824  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:33.054432  4145 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.048789  4147 raft_consensus.cc:3055] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:33.044128  4138 raft_consensus.cc:606] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Received request to transfer leadership to TS b81584b21ed144698954548303f1e507
I20260709 13:18:33.056758  4928 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.059090  4928 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.060452  5445 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.061141  5437 ts_tablet_manager.cc:1929] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:33.061736  5437 log.cc:1199] T 4661232a8b934fa0b9135bf4650bfd02 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/4661232a8b934fa0b9135bf4650bfd02
I20260709 13:18:33.065240  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:33.069319  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:33.069967  4144 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:33.069890  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:33.070892  4213 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.072916  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:33.076207  4289 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:33.056689  4147 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:33.070552  4144 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:33.082477  4185 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:33.087642  4145 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:18:33.089504  4893 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:33.063216  5437 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46838 (request call id 67) took 1097 ms. Trace:
I20260709 13:18:33.090728  4144 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.028151  4042 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 4, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 1 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:33.094411  4144 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.090581  5354 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:33.062899  5387 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.099041  5387 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.095171  5372 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:33.100499  5372 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 3 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:33.101295  5387 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.101948  4892 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:33.103953  5439 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:33.105254  5439 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:33.106312  5439 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.093766  5437 rpcz_store.cc:276] 0709 13:18:32.000646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.023295 (+ 22649us) service_pool.cc:224] Handling call
0709 13:18:32.311023 (+287728us) ts_tablet_manager.cc:1151] Deleting tablet 4661232a8b934fa0b9135bf4650bfd02
0709 13:18:32.311187 (+   164us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:32.979464 (+668277us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:33.060956 (+ 81492us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:33.063118 (+  2162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239451,"tablet-delete.queue_time_us":274130,"thread_start_us":263094,"threads_started":1}
I20260709 13:18:33.109499  4219 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:33.110477  5328 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.111290  4217 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:33.111953  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet 4661232a8b934fa0b9135bf4650bfd02 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:33.111050  5328 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.114602  5328 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.115665  5425 raft_consensus.cc:993] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:18:33.101495  5372 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.116308  5425 raft_consensus.cc:1081] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:18:33.122820  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:18:33.122862  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:33.087329  5445 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:33.123916  4215 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:33.125378  5328 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:33.129045  4921 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.121590  4213 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:33.119674  4144 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:33.092530  4147 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.130927  5328 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:33.136679  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:33.134457  4293 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:18:33.144914  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:33.148007  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:33.148888  4145 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:33.149298  4145 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:33.151916  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:33.152709  4215 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:33.150110  4145 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.152074  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:33.154314  4145 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.155803  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:33.151708  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:33.151932  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:33.160389  4147 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.161691  5429 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:33.162272  5429 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:33.163285  5429 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.169876  4289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:18:33.172139  4289 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:33.174821  4289 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.161305  5362 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.186717  4295 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.187008  4147 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:33.173408  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:33.189319  5388 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.189911  5388 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.190438  5388 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.193152  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:33.151106  5425 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.207799  4145 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
W20260709 13:18:33.206573  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47200.2us
I20260709 13:18:33.209342  4893 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:33.192814  5362 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.212529  5362 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.206705  5397 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.215634  5397 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.215126  4219 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.219987  5446 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:33.233049  5446 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:33.226450  4295 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:33.234478  5446 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.204774  5425 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.216106  5397 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.215219  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet fcc0e559b40a475ea99ac69d7dbea6c0 with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44140
I20260709 13:18:33.208657  5328 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.240590  5425 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.250645  4289 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.242329  5387 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.261981  5387 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.269388  4289 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.269120  5440 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.281119  5440 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.289290  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:33.290311  4145 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:33.292790  4187 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:33.271879  4044 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 3 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.310077  4044 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.316975  4044 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.320158  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:33.321132  4145 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:33.307515  5445 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.331467  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:33.332208  4145 raft_consensus.cc:3055] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:33.332549  4145 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:33.335068  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:33.335829  4289 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:33.339066  4921 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:33.343447  4145 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.352844  5442 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.323940  5445 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.328588  5440 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.358510  5445 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.358364  5442 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.359704  5462 tablet_replica.cc:333] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:18:33.342517  5388 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.367183  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:33.371971  4145 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.360131  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:33.354343  5345 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:18:33.383607  5367 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.393339  5354 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.395341  4219 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.409765  5387 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:33.416622  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66120.7us
I20260709 13:18:33.455248  5466 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.456112  5466 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.458618  5466 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.463634  5388 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.408878  5367 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.478579  5367 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.479238  5367 raft_consensus.cc:993] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:33.479772  5448 raft_consensus.cc:1081] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Signalling peer b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:33.482463  4922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6b9a320ff854b5998471937010702d5"
dest_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:42922
I20260709 13:18:33.483209  4922 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:33.483722  4922 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.413887  5354 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.470867  5442 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.484616  4145 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
W20260709 13:18:33.488477  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 88641.5us
I20260709 13:18:33.493144  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:33.488655  5425 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:33.496001  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50481.8us
I20260709 13:18:33.507642  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:33.508455  4293 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:33.516258  5469 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:33.516902  5469 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.518229  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:33.518957  4222 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:33.519133  5469 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.522439  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:33.523253  4215 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:33.523998  5462 raft_consensus.cc:2243] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.524875  5462 raft_consensus.cc:2272] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.524773  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:33.525802  5328 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.527434  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:33.527566  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:33.528697  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:33.529500  4147 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:33.530304  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:33.533324  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:33.534034  4145 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:33.533983  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:33.534833  4144 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:33.530771  4215 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:33.505195  4217 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:33.545428  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:33.546449  5462 ts_tablet_manager.cc:1916] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:33.548573  5397 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.550288  4295 raft_consensus.cc:2368] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
I20260709 13:18:33.558108  4138 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:33.535567  5328 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.561632  5328 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.563715  5354 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.566058  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:33.576727  5387 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:33.579428  5387 raft_consensus.cc:697] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:33.580009  5425 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.580672  5387 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.604601  4045 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 3, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:33.606336  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 96031.5us
I20260709 13:18:33.620168  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:33.623634  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:33.624588  4222 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.621863  4214 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:33.637861  4295 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:33.638017  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 100506us
I20260709 13:18:33.639647  4213 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:33.640262  5429 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:33.655902  5471 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:33.656683  5471 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.656762  4295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:33.658242  4295 raft_consensus.cc:606] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:18:33.652727  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 117379us
I20260709 13:18:33.664143  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:33.665151  4293 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.673509  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:33.677251  4215 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:33.681387  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:33.687697  4293 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:33.710400  5397 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.707172  5469 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.716934  5469 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.723034  4045 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.726748  4925 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:33.656195  5445 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.729617  5367 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:33.695748  5364 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.730813  5364 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.731353  5364 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.744897  4295 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:33.748755  5439 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:33.749222  5362 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.749773  5362 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.750185  5362 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.754580  5445 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.756237  5471 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.759397  5469 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.763607  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:33.763833  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 82580us
I20260709 13:18:33.768491  4214 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:33.766861  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:33.772512  5439 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:33.776046  5471 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.778492  5471 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.778985  5471 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.783284  4141 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:33.776010  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:33.789484  4141 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:33.790108  5467 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.790570  5467 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.790936  5467 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:33.788515  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 277054us
I20260709 13:18:33.793659  5445 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:33.795531  4141 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:33.802878  5364 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.807516  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:33.807583  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:33.808493  4293 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:33.811034  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:33.811589  4222 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:33.805346  4111 leader_election.cc:400] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
I20260709 13:18:33.811756  4293 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.812311  4111 leader_election.cc:403] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.814050  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:33.815691  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:33.816028  4138 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:33.816689  5473 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:33.817242  5473 raft_consensus.cc:697] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:33.818789  5473 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.819232  5362 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.816370  4921 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:33.823800  5328 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.826321  5328 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:33.826992  4922 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:33.829342  4922 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:33.829833  4219 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:33.832645  4928 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.837450  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:33.843289  4293 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:33.844578  4289 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:33.859419  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:33.868688  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:33.868106  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:33.871448  4219 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.871896  5472 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:33.855772  5328 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.834147  5469 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.862807  5345 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.863126  5388 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:33.847494  5387 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.872527  5472 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:33.890280  4219 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:33.885813  5387 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:33.895305  5387 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.878118  5350 consensus_queue.cc:1059] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:18:33.882184  5345 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.903622  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:33.905516  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:33.909754  4289 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.878814  5439 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:18:33.941232  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52455.8us
I20260709 13:18:33.889124  5388 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:33.880774  5328 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.877177  5467 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.947512  4289 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:33.893863  5372 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:18:33.949394  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46170.4us
I20260709 13:18:33.942998  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:33.913615  5345 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.925096  5440 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.942097  5331 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.903780  5429 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:33.968521  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:18:33.979507  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:33.954465  5446 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:33.986114  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:34.029088  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:33.972977  5482 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:18:34.025245  5475 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.055673  5475 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:34.057363  5476 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:18:34.058038  5475 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.007144  5425 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.059027  5467 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.059211  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.060106  4222 raft_consensus.cc:2368] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:34.001982  5472 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.061672  5469 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
I20260709 13:18:34.058764  5425 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.064774  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:34.072850  4143 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.073354  4147 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:34.065462  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:34.014358  5448 raft_consensus.cc:3055] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:33.977146  5440 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:33.980290  5331 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.007994  5362 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:34.089524  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 146608us
I20260709 13:18:34.018646  5429 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:34.017807  5487 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:34.026369  5364 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:34.098851  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.103870  4219 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:34.080705  5448 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:34.101047  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:34.053639  4141 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:34.023937  5471 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.106201  4214 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.106984  4296 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:34.054867  5328 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.023403  5354 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:34.085569  5427 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.108135  4220 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:34.086102  4217 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.085371  5474 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.018126  5388 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.121049  4143 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:34.132669  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.155573  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:34.159333  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:34.166332  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:34.134660  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:34.185664  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 71359.2us
I20260709 13:18:34.105635  5487 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.186657  5429 raft_consensus.cc:697] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:34.201948  4220 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.203318  4140 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:34.116951  5354 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:34.246035  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59243.9us
I20260709 13:18:34.187625  5485 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.187453  5362 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:18:34.300719  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 104902us
I20260709 13:18:34.301142  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:18:34.311915  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 97342.8us
I20260709 13:18:34.118830  5427 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.124289  5474 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.213084  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:34.312641  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:18:34.332893  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 198696us
I20260709 13:18:34.301991  5473 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.302192  5498 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.317466  5453 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:18:34.305544  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 198306us
I20260709 13:18:34.214831  5448 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:34.315707  5362 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.346837  5409 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:34.360957  5408 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.360735  5471 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:34.361131  5504 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.371992  4921 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.001s
I20260709 13:18:34.362255  5496 raft_consensus.cc:993] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
W20260709 13:18:34.379719  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66065.6us
I20260709 13:18:34.343209  5473 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.362010  5440 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.369635  5469 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:34.308665  5485 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:34.384081  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 63601.7us
I20260709 13:18:34.374243  5425 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.380128  5408 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.345863  5498 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.379396  5331 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.375723  5367 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:18:34.411532  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.412182  4219 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:34.414014  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.375018  5409 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.396199  5448 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.417757  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:34.395728  5442 raft_consensus.cc:1081] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:18:34.404578  5408 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.402536  5469 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:34.369494  5429 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:34.449781  4261 leader_election.cc:400] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:34.452735  4261 leader_election.cc:403] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.454265  4214 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:34.384673  5504 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.439591  5487 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:34.463979  4219 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:34.455991  5462 ts_tablet_manager.cc:1929] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:34.461519  5427 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.446810  5354 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.448350  5508 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.463083  5504 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.457073  5471 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:34.479873  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:34.469208  5462 log.cc:1199] T fcc0e559b40a475ea99ac69d7dbea6c0 P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/fcc0e559b40a475ea99ac69d7dbea6c0
I20260709 13:18:34.501928  4222 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:34.482800  4216 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:34.482760  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.505101  4218 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:34.485208  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:34.490237  5508 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.482156  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:34.489135  5354 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.518082  5387 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:18:34.491010  5472 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:18:34.518870  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 217795us
I20260709 13:18:34.523568  4214 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:34.524117  4215 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:34.501224  5474 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:34.569057  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44001.6us
I20260709 13:18:34.572723  5498 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.576469  5462 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44140 (request call id 69) took 1389 ms. Trace:
I20260709 13:18:34.576969  5462 rpcz_store.cc:276] 0709 13:18:33.194361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.207829 (+ 13468us) service_pool.cc:224] Handling call
0709 13:18:33.352459 (+144630us) ts_tablet_manager.cc:1151] Deleting tablet fcc0e559b40a475ea99ac69d7dbea6c0
0709 13:18:33.355108 (+  2649us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:33.768545 (+413437us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:34.448618 (+680073us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:34.571038 (+122420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61034,"tablet-delete.queue_time_us":91409,"thread_start_us":18073,"threads_started":1}
I20260709 13:18:34.581446  5485 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:34.582988  5495 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:18:34.583719  4141 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:34.517176  5508 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.634186  5362 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:34.525537  5354 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.638731  5354 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.526034  5387 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.640833  5387 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:34.642767  5409 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:34.581918  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet fcc0e559b40a475ea99ac69d7dbea6c0 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
W20260709 13:18:34.647737  4031 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 65851.7us
I20260709 13:18:34.664911  5409 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:34.665618  5409 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:34.569898  5473 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.669480  5408 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.671535  5408 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.647573  4045 catalog_manager.cc:5697] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:34.681440  4044 catalog_manager.cc:5697] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:34.525758  5345 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.001s
I20260709 13:18:34.558913  5472 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:34.709681  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 138133us
I20260709 13:18:34.724058  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.724926  4218 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:34.725400  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.725993  4222 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:34.726900  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.727466  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.727666  4215 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:34.728080  4219 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
W20260709 13:18:34.730610  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59322.1us
I20260709 13:18:34.731508  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:34.732924  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:34.749953  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:34.751305  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:34.752666  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:34.757093  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:34.758646  4112 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:34.759397  4261 leader_election.cc:400] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:34.708330  5409 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:34.761667  4261 leader_election.cc:403] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.750358  5328 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:34.757781  4217 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.003s
I20260709 13:18:34.509609  5469 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.758302  5481 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:34.785826  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.786087  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.786468  4218 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:34.787503  4145 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:34.779570  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:34.760419  5387 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.762827  5408 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:34.762225  5471 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.762200  5474 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.764079  5364 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:34.757916  5470 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:34.767351  5509 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.858916  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:18:34.834388  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 54936us
I20260709 13:18:34.860708  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:34.812083  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.862315  4213 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:34.735869  5345 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.870210  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.872958  4143 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:34.782719  4217 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:34.797235  5328 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:34.793745  5448 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.871095  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.811684  5474 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.877767  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.885303  4146 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:34.865568  5480 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:34.794787  5387 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:34.858084  5481 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:34.889573  4220 raft_consensus.cc:2368] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:34.807350  5408 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.876111  5485 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.883697  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.782588  5490 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:18:34.855487  5471 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.898180  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:34.885694  5507 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.901952  5507 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.903091  4144 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:34.885296  5474 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.901243  5472 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.873099  5364 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:34.895519  5468 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.894042  5387 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.894681  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.889945  5448 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.912431  5481 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:34.914535  5471 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:34.896415  5408 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.898033  5485 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.918398  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:34.927889  5485 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.926177  4218 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:34.929402  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.915795  5468 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.933542  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.922504  4141 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:34.921468  5448 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.918287  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:34.919701  5507 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:34.919224  4213 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:34.935678  5468 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.943357  4217 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:34.952355  5445 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.036s	sys 0.106s
I20260709 13:18:34.960007  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:34.965699  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:18:34.969498  4259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.008s	sys 0.051s
I20260709 13:18:34.972615  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:18:34.967489  5445 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.037s	sys 0.106s
W20260709 13:18:34.988890  4259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.010s	sys 0.051s
I20260709 13:18:34.990595  4187 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:34.935386  5328 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.000378  5354 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:35.005045  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:35.010473  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.010694  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.011241  4296 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:35.012705  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.013185  4296 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:35.014676  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49080.9us
I20260709 13:18:35.017328  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.017941  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.017943  4287 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:35.019773  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:35.020494  4287 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.021574  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.022663  5488 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:35.004808  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:34.989548  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44140 (request call id 70) took 1783 ms. Trace:
I20260709 13:18:34.992887  5345 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.027323  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.029440  4296 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:35.005126  5472 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:35.022995  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:34.964986  5364 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.037374  5509 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:35.040351  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.041944  4290 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:35.023200  5488 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.032294  5472 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.061717  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:35.025286  4110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.023s	sys 0.042s
W20260709 13:18:35.062623  4110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.023s	sys 0.042s
I20260709 13:18:35.084803  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:35.047566  4141 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:35.030793  5507 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:35.042578  5488 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.100651  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.104982  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.108326  4290 raft_consensus.cc:2368] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:35.111527  4287 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:35.108413  4296 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:35.064745  5472 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.117894  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.118160  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:35.118746  4287 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.110704  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.120756  5350 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:35.121088  4291 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:35.121325  5350 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.122401  4290 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:35.123328  5350 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.124691  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:35.125296  4139 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:35.126398  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:35.132229  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:35.127172  5350 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:35.136394  5490 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:35.136441  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:35.136808  5350 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.136989  5490 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.137997  5490 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.143455  5485 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.148427  4139 raft_consensus.cc:2368] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:35.124245  5387 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.141147  5468 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.158351  4142 raft_consensus.cc:2368] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:35.161146  4294 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:35.028213  5445 rpcz_store.cc:276] 0709 13:18:33.206515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.207906 (+  1391us) service_pool.cc:224] Handling call
0709 13:18:33.315583 (+107677us) log.cc:844] Serialized 494 byte log entry
0709 13:18:33.554294 (+238711us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b540043ae20. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec62b26 00007fee3ec5c49a 00007fee3ec5b714 00007fee3ec3beaa 00007fee3ec42d53 00007fee3ec42cd9 00007fee3ec42c69 00007fee3ec42c31 00007fee3ec41dfd 000000000038f354
0709 13:18:34.989469 (+1435175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12236,"raft.queue_time_us":12686,"raft.run_cpu_time_us":6640,"raft.run_wall_time_us":218557,"spinlock_wait_cycles":134290304}
W20260709 13:18:35.165361  5429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.017s	sys 0.012s
W20260709 13:18:35.172484  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 388582us
I20260709 13:18:35.174072  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:35.176836  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 151524a8517e4b8ebc7308777c98105e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:35.179275  4287 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:35.171489  5350 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:35.174247  5429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.017s	sys 0.012s
I20260709 13:18:35.183068  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:35.179879  4186 leader_election.cc:400] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
W20260709 13:18:35.180171  5491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.044s	sys 0.099s
I20260709 13:18:35.200245  4186 leader_election.cc:403] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.194957  4259 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:35.201237  5388 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:35.178975  5482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.024s
I20260709 13:18:35.203675  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:35.204599  5521 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:35.168462  5508 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.209399  5350 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:35.211855  5484 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:35.216307  5350 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.216538  5484 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.217291  4261 leader_election.cc:400] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:35.217592  4261 leader_election.cc:403] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.218160  5506 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:35.218643  5484 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.220568  5508 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.212282  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:35.222219  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:35.222715  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:35.212558  5471 raft_consensus.cc:2764] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:18:35.214425  5491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.044s	sys 0.100s
I20260709 13:18:35.224892  5468 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.214480  5354 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.211174  5466 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.222791  4220 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:35.218595  5350 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.237059  5445 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:35.210799  5388 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:35.238546  5388 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.228518  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:35.240157  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:35.237231  5435 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:35.241168  4144 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:35.204727  4217 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:35.247381  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:35.252671  5521 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:35.253412  5485 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.253564  4142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52146
I20260709 13:18:35.254225  4142 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.254566  4142 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.224922  5353 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:35.211072  5482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.000s	sys 0.025s
I20260709 13:18:35.248412  5440 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.264317  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:35.250515  5345 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.258941  5353 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.259069  5470 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:35.284072  4044 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.027s
W20260709 13:18:35.286165  4044 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.006s	sys 0.027s
I20260709 13:18:35.253624  5521 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.262921  5519 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:35.250839  5408 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.304080  4041 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.305382  5519 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:35.296015  5489 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:35.283046  5353 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.282951  5470 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:35.308151  5526 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:18:35.314000  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:35.321331  4147 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:35.334671  5490 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.335191  5482 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:35.335793  5482 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:35.337054  5490 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.337661  5490 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:35.338119  5490 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.338061  5482 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:35.335191  5354 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:35.339820  4042 catalog_manager.cc:5697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.341495  4042 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 1 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.314014  5470 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.338029  5435 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.313711  5387 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:35.353227  4142 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.347771  5448 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.357698  5448 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.358170  4138 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:35.340199  5490 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.363209  4142 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:35.366284  4262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.048s
W20260709 13:18:35.366681  4262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.009s	sys 0.048s
I20260709 13:18:35.312537  5489 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.339522  5353 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.414834  5408 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.424459  5519 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.435019  5353 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.446575  5387 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:35.447208  5387 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.449587  5387 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:35.452270  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:35.456542  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 216428us
I20260709 13:18:35.367388  5435 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.467592  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.468899  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:35.469596  4289 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.486012  4289 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
W20260709 13:18:35.495075  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 243922us
I20260709 13:18:35.487852  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:35.645835  4218 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:35.646337  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 158573us
I20260709 13:18:35.642226  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:35.489791  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:18:35.707681  4111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.013s	sys 0.045s
W20260709 13:18:36.036978  4111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.021s	sys 0.060s
W20260709 13:18:36.040279  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 385707us
W20260709 13:18:35.508073  5531 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:18:35.708066  5471 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.337s
I20260709 13:18:36.045856  5471 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.046577  5492 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:35.683779  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:36.047191  5492 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:35.517023  5489 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.048455  5489 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.048918  5489 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.051450  5489 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:35.655906  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 166217us
I20260709 13:18:36.054677  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 35) took 1182 ms. Trace:
I20260709 13:18:36.055102  4140 rpcz_store.cc:276] 0709 13:18:34.872098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.894559 (+ 22461us) service_pool.cc:224] Handling call
0709 13:18:34.906521 (+ 11962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.911217 (+  4696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.911251 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:34.911680 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.195903 (+284223us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:35.195969 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.196029 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.054458 (+858429us) raft_consensus.cc:1685] finished
0709 13:18:36.054478 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.054596 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4293,"raft.queue_time_us":5249,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":5135,"thread_start_us":283891,"threads_started":1,"wal-append.queue_time_us":420718}
I20260709 13:18:36.047591  4217 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:35.484772  5353 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.057881  5508 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.058552  5508 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.046371  5471 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.060901  5508 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.062654  5508 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.063146  5508 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.063671  5471 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.065688  5508 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.066838  5491 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.067390  5491 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:35.848628  5541 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.071486  5541 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.075609  5354 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:36.075613  5519 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.076727  5354 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:36.076474  5519 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.077791  5354 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.834643  5543 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.078824  5519 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:35.855338  5472 consensus_meta.cc:287] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.721s	user 0.004s	sys 0.007s
I20260709 13:18:36.079492  5508 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:36.080251  5473 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.080664  5484 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.080713  5475 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.082571  5491 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.083050  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.082122  5542 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:35.799197  5490 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.084712  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.057952  5353 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:35.632197  5445 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:35.749450  5528 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:18:35.910971  5488 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.000s
I20260709 13:18:35.907199  5435 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:36.086635  5474 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.172s	user 0.014s	sys 0.000s
I20260709 13:18:36.118920  5475 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.124675  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:36.124565  5474 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.125662  5557 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.125994  5353 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.120029  5484 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.126127  5557 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.126555  5474 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:35.652649  5448 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:36.127290  5448 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:36.128043  5484 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.106355  4138 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.648496  5535 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.107461  5496 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.108193  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:36.109252  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:36.109936  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:35.655494  5387 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.008576  5364 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:36.117969  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:36.119603  4143 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:36.116146  5543 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.119616  5519 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.122048  4261 leader_election.cc:400] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
W20260709 13:18:36.223071  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 101148us
I20260709 13:18:36.223618  4261 leader_election.cc:400] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:36.122179  4218 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:36.116672  5470 consensus_meta.cc:287] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.000s
W20260709 13:18:35.774833  5388 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:18:36.118813  5541 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.114061  5534 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:18:36.232609  5538 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.233158  5538 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.233675  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.234238  5388 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.235402  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:36.235766  5538 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.236528  5388 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.128226  5557 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.236720  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:36.237025  5470 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.119233  5473 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.140940  4219 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.120622  4142 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:36.129837  4146 raft_consensus.cc:2368] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:36.238591  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:36.217723  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 86529.5us
W20260709 13:18:36.214938  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65039.2us
I20260709 13:18:36.218928  4293 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:36.239063  4296 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.219475  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.241150  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.241449  5470 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.241154  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.118440  5472 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:36.213768  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 84097.8us
I20260709 13:18:36.222376  4140 raft_consensus.cc:2368] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
W20260709 13:18:36.219129  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 88874.7us
I20260709 13:18:36.125994  5475 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.251231  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:36.215696  5353 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.240440  4138 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:36.226050  5440 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.129045  5445 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.232645  5541 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.304944  5435 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.216210  5490 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.128165  5448 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.152521  5508 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:36.309660  4215 raft_consensus.cc:2368] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:36.309139  4296 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:36.231607  5519 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.221920  5496 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.226691  5387 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:36.226522  5364 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:36.330916  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1249) took 1105 ms. Trace:
I20260709 13:18:36.231360  5471 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:36.335348  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:36.336758  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80432.2us
I20260709 13:18:36.313455  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:36.427937  4214 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:36.123137  5542 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.218633  5535 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.343438  5543 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.345232  5553 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.129889  5488 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.344430  5435 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.425264  4213 rpcz_store.cc:276] 0709 13:18:35.225827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.232474 (+  6647us) service_pool.cc:224] Handling call
0709 13:18:35.232775 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.689776 (+457001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.689822 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.736311 (+ 46489us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.221505 (+485194us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:36.221543 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.221611 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.330674 (+109063us) raft_consensus.cc:1685] finished
0709 13:18:36.330696 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.330834 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8084,"raft.queue_time_us":54347,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":10273,"thread_start_us":826652,"threads_started":2,"wal-append.queue_time_us":549544}
I20260709 13:18:36.427305  4218 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:36.294566  5440 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.313163  5541 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:36.705086  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 446227us
W20260709 13:18:36.705173  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 275675us
I20260709 13:18:36.627715  5354 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.722246  5354 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.658576  5470 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.725660  5470 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.728611  5470 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.626075  5489 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:36.626698  5526 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:18:36.658563  5362 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:36.653574  5473 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.487460  5364 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:36.593544  5534 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:36.735481  5541 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.344643  5492 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.736545  5435 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.598382  5530 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.739799  5488 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.740562  5553 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.823642  5530 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.825804  5553 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.538744  5471 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.826392  5530 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.826637  5471 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:36.828799  5567 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:18:36.829281  5471 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.537906  4294 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:36.283998  5353 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.834510  5353 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.748236  4142 raft_consensus.cc:2955] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:36.809409  5475 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.838611  5475 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:36.749074  4141 raft_consensus.cc:2368] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:36.749145  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:36.840683  5492 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:36.753679  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:36.841257  5492 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:36.687906  5508 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:36.690857  5548 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.602s	user 0.002s	sys 0.001s
I20260709 13:18:36.405006  5445 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.686004  5387 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:36.773149  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:36.843400  5492 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:36.479632  5345 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:36.778594  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:36.782241  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.796824  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:36.809391  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:36.823004  5542 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.841784  4218 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:18:36.843684  4216 raft_consensus.cc:2368] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
W20260709 13:18:36.774933  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 436628us
I20260709 13:18:36.846863  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.849174  5435 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:36.849519  4188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.009s	sys 0.023s
I20260709 13:18:36.852722  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.857673  4213 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:36.782810  5484 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:36.815006  5362 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:36.861109  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:36.863401  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:36.871039  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:36.873037  4293 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.872387  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:36.869678  5547 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.784s	user 0.029s	sys 0.051s
I20260709 13:18:36.872558  5484 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:36.871366  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:36.807025  5489 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.869573  5474 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.892601  4188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.245s	user 0.009s	sys 0.025s
I20260709 13:18:36.903064  4293 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:36.878991  5529 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.887823  4143 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:36.869884  5473 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.852407  5534 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:36.871312  5508 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.871577  5488 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:36.863093  5345 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.113113  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1203) took 1022 ms. Trace:
W20260709 13:18:36.975033  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 200347us
I20260709 13:18:36.909461  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.072199  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:37.309490  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1266) took 1052 ms. Trace:
I20260709 13:18:36.977864  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.311192  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.313570  4219 rpcz_store.cc:276] 0709 13:18:36.256599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.256755 (+   156us) service_pool.cc:224] Handling call
0709 13:18:36.257197 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.704226 (+447029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.704252 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.750578 (+ 46326us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.868788 (+118210us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:36.868838 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.868940 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.232985 (+364045us) raft_consensus.cc:1685] finished
0709 13:18:37.233005 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.309421 (+ 76416us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":27223,"thread_start_us":75329,"threads_started":1,"wal-append.queue_time_us":307064}
W20260709 13:18:37.311973  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 239924us
I20260709 13:18:37.313048  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:36.907469  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:37.017592  4112 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.542s (SENT) [suppressed 3 similar messages]
I20260709 13:18:37.313854  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.310472  4147 rpcz_store.cc:276] 0709 13:18:36.090816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.090945 (+   129us) service_pool.cc:224] Handling call
0709 13:18:36.106937 (+ 15992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.128818 (+ 21881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.128863 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.128917 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:36.128947 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.112737 (+983790us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b540038ed54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:37.112813 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.113029 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49869568}
I20260709 13:18:36.879866  5471 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.323899  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.324638  4218 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:37.324537  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 446752us
I20260709 13:18:37.325906  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:37.325938  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.326038  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.329303  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:37.071913  5569 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:18:37.336711  5489 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:36.907516  5561 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.847s	user 0.012s	sys 0.020s
I20260709 13:18:37.266808  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.323623  5529 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.323602  5488 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.331087  5491 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.335098  5521 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:37.301196  5362 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.415944  5491 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:37.420406  5362 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:37.405011  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1261) took 1314 ms. Trace:
I20260709 13:18:37.421296  5362 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.421820  4217 rpcz_store.cc:276] 0709 13:18:36.090740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.092062 (+  1322us) service_pool.cc:224] Handling call
0709 13:18:36.107266 (+ 15204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.127338 (+ 20072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.127383 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.127431 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:36.127464 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.404694 (+1277230us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54003e4754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:37.404756 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.404937 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45705088}
I20260709 13:18:37.323493  5574 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.403234  5472 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.412997  5542 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:37.424194  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.425499  5542 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.428503  4292 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.429250  5521 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.429844  5521 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.095021  5466 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:37.338255  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:36.894899  5564 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.074147  5475 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.140323  5484 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:36.985939  5519 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.408761  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.409176  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.405817  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1263) took 1312 ms. Trace:
I20260709 13:18:37.430739  5466 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.448313  4220 rpcz_store.cc:276] 0709 13:18:36.092972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.097131 (+  4159us) service_pool.cc:224] Handling call
0709 13:18:36.109124 (+ 11993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.595199 (+486075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.595229 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.595265 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:36.595295 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.405552 (+810257us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54002ee854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:37.405609 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.405752 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117409024}
I20260709 13:18:37.346832  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.404909  5570 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.411392  4218 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:37.341279  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.408681  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.453864  4143 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:37.454026  4291 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:37.453955  5580 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:37.454520  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 126715us
I20260709 13:18:37.454862  5580 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:37.454981  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.455320  5580 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.456080  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.456794  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.457162  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:37.458269  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:37.458735  5484 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:37.459002  4143 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:37.459306  5484 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.459774  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:37.404630  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.268518  5541 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.460851  5541 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.462409  4147 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:37.463061  5541 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:36.891944  5530 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.435s
I20260709 13:18:37.462598  5484 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.344110  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.463896  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:18:36.900902  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 324191us
I20260709 13:18:37.464730  4293 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:37.465047  4293 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:37.465418  4892 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:37.420038  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.420280  5491 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.465853  4293 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.467231  4293 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.467317  5565 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.467746  5565 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:37.468099  5565 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:37.137635  5555 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.901s	user 0.013s	sys 0.011s
I20260709 13:18:37.475188  4293 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:37.476048  4143 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:37.419350  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:37.478096  4143 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.327309  5471 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:37.327582  5473 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.443837  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:37.449229  5536 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.166s	user 0.015s	sys 0.018s
W20260709 13:18:37.404040  4215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1254) took 2090 ms (client timeout 1849 ms). Trace:
I20260709 13:18:37.480901  5471 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:37.481369  4215 rpcz_store.cc:269] 0709 13:18:35.313590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.313752 (+   162us) service_pool.cc:224] Handling call
0709 13:18:37.403743 (+2089991us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54003c3cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:37.403922 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270012288}
W20260709 13:18:37.448081  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 430512us
I20260709 13:18:37.424010  5362 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.448141  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.445643  5564 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:37.438442  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 100135us
I20260709 13:18:37.343863  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.484619  5564 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:37.410694  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65549.4us
I20260709 13:18:37.486033  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.486171  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.414690  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.482079  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 34) took 2610 ms. Trace:
I20260709 13:18:37.466259  4147 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:37.401603  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.484596  5473 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.488759  4290 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:37.475458  5565 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.488030  4145 rpcz_store.cc:276] 0709 13:18:34.871810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.877204 (+  5394us) service_pool.cc:224] Handling call
0709 13:18:34.891989 (+ 14785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.897154 (+  5165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.897194 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.152029 (+254835us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b2c00000c88. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:18:35.160841 (+  8812us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.476223 (+315382us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:35.476277 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.476384 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.407551 (+1931167us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:37.481881 (+ 74330us) raft_consensus.cc:1685] finished
0709 13:18:37.481907 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.482028 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3727,"raft.queue_time_us":5409,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":1435,"spinlock_wait_cycles":47240192,"thread_start_us":302380,"threads_started":1,"wal-append.queue_time_us":1049611}
I20260709 13:18:36.912699  5474 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.409760  5529 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.412555  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 36) took 2469 ms. Trace:
I20260709 13:18:37.436635  5542 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.325593  5508 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.502792  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.509341  4218 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:37.452493  5496 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.497627  5570 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.498641  5475 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.495756  5565 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.539695  4289 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.522006  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.541788  5488 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.503753  4139 rpcz_store.cc:276] 0709 13:18:34.872412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.169455 (+297043us) service_pool.cc:224] Handling call
0709 13:18:35.214956 (+ 45501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.254205 (+ 39249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.254238 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.312912 (+ 58674us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.747088 (+434176us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:35.747139 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.747224 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.821939 (+1074715us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:37.073739 (+251800us) raft_consensus.cc:1685] finished
0709 13:18:37.094845 (+ 21106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.341797 (+246952us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":924,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3785,"spinlock_wait_cycles":2600320,"thread_start_us":371575,"threads_started":1,"wal-append.queue_time_us":757840}
I20260709 13:18:37.543473  5508 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.545612  5474 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.547528  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.549202  4215 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.549877  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.549269  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.550616  5466 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.551855  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.541812  5570 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.553210  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.554385  5534 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.556017  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.557838  5521 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.560633  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.564945  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.565069  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.566403  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:37.572129  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 242780us
I20260709 13:18:37.576627  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.610245  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.592957  5508 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:37.611702  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.622099  5345 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.622614  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:37.623225  5566 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.751s	user 0.004s	sys 0.005s
I20260709 13:18:37.623332  4291 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:37.615821  5354 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.618752  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.558424  5580 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.574826  5475 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.626157  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1270) took 1326 ms. Trace:
I20260709 13:18:37.626211  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.626941  5580 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.579614  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.613559  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.627592  4928 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:37.611748  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.613049  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:37.613869  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.629026  4110 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:37.626708  4222 rpcz_store.cc:276] 0709 13:18:36.300068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.302410 (+  2342us) service_pool.cc:224] Handling call
0709 13:18:36.302806 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.840590 (+537784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.840631 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.840683 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:36.840726 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.625871 (+785145us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54002f4754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:37.625932 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.626091 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236277632}
I20260709 13:18:37.576192  5581 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:37.554407  5529 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.589208  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.637887  4219 raft_consensus.cc:2410] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:37.637569  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:37.591701  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 104182us
I20260709 13:18:37.571593  5496 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:37.639457  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:37.599038  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 105760us
I20260709 13:18:37.578898  4217 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.606968  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.644207  4215 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
W20260709 13:18:37.624922  4141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1191) took 2688 ms (client timeout 2133 ms). Trace:
I20260709 13:18:37.628141  5508 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.558476  5491 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.577472  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.631633  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.649525  4289 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:37.650364  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.650933  4186 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:37.651046  4222 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.624224  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.608222  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:37.621083  5576 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:37.616483  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.641690  5559 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.616894  5565 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.643007  5509 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.645187  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.645524  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.667963  4219 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:37.669256  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.671649  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.644104  5471 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.652446  4288 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:37.654520  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:37.664253  5505 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.660545  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0819831200001317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
I20260709 13:18:37.666682  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.666882  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.644308  5350 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.698249  4289 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:37.646992  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.672940  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.648216  5397 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:37.659334  5472 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.696898  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.704948  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.653179  5345 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:37.698427  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.663451  5529 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:37.707361  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.708163  4219 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:37.702272  4213 raft_consensus.cc:2376] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3. Re-sending same reply.
W20260709 13:18:37.644492  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 179162us
W20260709 13:18:37.703955  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49486.4us
I20260709 13:18:37.703471  4288 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.636833  5581 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.711625  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:37.696496  5546 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.554s	user 0.017s	sys 0.025s
I20260709 13:18:37.713277  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.650367  5496 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.718171  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.698985  5553 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.727962  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50784.3us
W20260709 13:18:37.670990  5555 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:37.724378  4215 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.700084  5350 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.725690  5574 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:37.726236  5551 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.589s	user 0.017s	sys 0.016s
I20260709 13:18:37.700088  4921 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.721127  4213 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:37.732071  5472 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.738524  4222 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:18:37.671659  5565 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.741055  5435 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.742520  5488 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:37.742983  5471 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.744949  5472 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:37.757808  5472 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.758114  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1097) took 2751 ms. Trace:
I20260709 13:18:37.732726  5350 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.763381  5508 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:37.766757  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.767216  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.770125  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1122) took 2303 ms. Trace:
I20260709 13:18:37.768446  5472 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.770514  4287 rpcz_store.cc:276] 0709 13:18:35.466670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.467106 (+   436us) service_pool.cc:224] Handling call
0709 13:18:35.467557 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.467865 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.467889 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.477130 (+  9241us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.962443 (+485313us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:35.962499 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.962594 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.429440 (+1466846us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b1800392d40. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf5522 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:18:37.628070 (+198630us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:37.769914 (+141844us) raft_consensus.cc:1685] finished
0709 13:18:37.769935 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.770048 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7033,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":32299,"spinlock_wait_cycles":120084224,"thread_start_us":317911,"threads_started":1,"wal-append.queue_time_us":530805}
I20260709 13:18:37.773016  5491 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.715413  5529 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.775296  5529 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.709770  5397 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.777895  5397 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.779311  5496 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.756857  5574 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.649020  4141 rpcz_store.cc:269] 0709 13:18:34.936072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.134254 (+198182us) service_pool.cc:224] Handling call
0709 13:18:37.624611 (+2490357us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400285854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:37.624826 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3701276416}
I20260709 13:18:37.780997  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.781582  5362 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:37.782160  5581 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.753023  5475 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.782785  5475 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.783241  5475 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.733615  5553 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.755932  5435 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.785300  5475 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.785413  5553 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.716740  5505 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.677644  5509 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.744199  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:37.723223  5490 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.775296  5472 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.747190  4295 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:37.671859  5559 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:37.739845  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:18:37.798221  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 86648.3us
W20260709 13:18:37.798699  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 58930.7us
I20260709 13:18:37.799566  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:18:37.800042  4217 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:37.717090  5345 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.805456  5491 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:37.806109  5491 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:37.790660  4215 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:37.758538  4144 rpcz_store.cc:276] 0709 13:18:35.009144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.270313 (+261169us) service_pool.cc:224] Handling call
0709 13:18:35.270600 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.281580 (+ 10980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.281609 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.298056 (+ 16447us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.625884 (+327828us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:35.625929 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.626026 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.643121 (+2017095us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:37.757800 (+114679us) raft_consensus.cc:1685] finished
0709 13:18:37.757822 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.758047 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10556,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13358,"spinlock_wait_cycles":39739136,"thread_start_us":303712,"threads_started":1,"wal-append.queue_time_us":777992}
I20260709 13:18:37.806725  5565 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.801750  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:37.807192  5491 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.782200  5362 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.786834  5435 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.809623  5362 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.810349  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.810220  5350 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.812711  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:37.813696  5509 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.788861  4219 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.802863  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:37.803942  5559 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.804469  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.825150  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:37.827661  4146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1182) took 2946 ms (client timeout 1639 ms). Trace:
W20260709 13:18:37.829480  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 85373.3us
I20260709 13:18:37.832787  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:37.828074  4146 rpcz_store.cc:269] 0709 13:18:34.881171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.887574 (+  6403us) service_pool.cc:224] Handling call
0709 13:18:37.827455 (+2939881us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540044a554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:37.827598 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826406272}
I20260709 13:18:37.853559  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:37.847599  5435 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.866751  5435 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:37.806396  5345 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.781023  5574 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.872532  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:37.881263  5505 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:37.881776  5429 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.841871  5472 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.850862  5534 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.882953  5472 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:37.870924  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.845548  5508 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.883863  5542 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.854027  5490 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:37.883854  5472 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.845799  5328 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:18:37.938256  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 140194us
I20260709 13:18:37.937808  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:37.940780  4261 leader_election.cc:400] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:37.941195  4261 leader_election.cc:403] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:18:37.941458  4296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 1126) took 2470 ms (client timeout 1810 ms). Trace:
I20260709 13:18:37.884478  5508 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.942819  4292 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.846242  5488 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.945823  5574 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.948813  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.950265  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:37.941943  4296 rpcz_store.cc:269] 0709 13:18:35.467832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.468419 (+   587us) service_pool.cc:224] Handling call
0709 13:18:37.938071 (+2469652us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54003539d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:37.938203 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353140480}
I20260709 13:18:37.951432  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.951391  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:37.942911  4112 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:37.954445  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.870572  5350 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:37.870245  5435 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.960675  4215 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:37.960922  4214 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:37.957221  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.957351  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.941027  5345 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:37.958492  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.965251  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:37.958771  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.958853  5506 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.912971  5440 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:37.973016  4112 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:37.959851  5599 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:37.939357  5328 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:37.974226  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.974869  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:37.976663  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.909063  4141 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:37.977531  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.978258  4139 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.978755  4138 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:37.980643  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.009881  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.010380  4217 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:37.985643  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:37.973600  5473 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.986059  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:38.015587  4928 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.891980  5542 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:37.997697  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.008682  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.009117  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.964197  5488 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.017921  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.987030  5572 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:38.009547  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.027060  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:38.021281  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.022720  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:38.021203  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.033751  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.034809  4142 raft_consensus.cc:1813] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Handling vote request from an unknown peer 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.037181  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:37.970532  5345 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.037982  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:38.039613  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.051651  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.043744  4142 raft_consensus.cc:2410] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:18:38.037865  4145 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:38.015352  5473 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:38.023917  5570 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.059180  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:38.059954  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 94831.7us
I20260709 13:18:38.037411  5484 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.063556  4140 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:38.026094  5572 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:38.066087  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.066149  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.054119  5534 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.068948  4927 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:38.056396  5474 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.069247  4217 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:38.044220  5600 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.061484  5473 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.072454  4261 leader_election.cc:400] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:38.074541  4261 leader_election.cc:403] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:38.079486  5508 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:38.079399  5488 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:38.064437  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.087741  4928 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:38.071218  5572 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.090757  4110 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:38.092767  4044 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 170) took 3894 ms. Trace:
I20260709 13:18:38.072419  5570 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.093040  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.094275  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.095155  4927 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:38.084595  5600 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:18:38.088901  5602 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:18:38.083004  5387 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:38.104266  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.104681  5328 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:38.105607  5542 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:38.086967  5559 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.114814  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.115798  4217 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:38.132927  5559 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:38.099752  5484 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.092435  5508 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:38.132632  5600 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.106177  5345 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:38.093163  4044 rpcz_store.cc:276] 0709 13:18:34.193519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.193685 (+   166us) service_pool.cc:224] Handling call
0709 13:18:38.087704 (+3894019us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:35.520708 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:35.521283 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:35.521314 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:18:35.521330 (+    16us) tablet.cc:662] Decoding operations
0709 13:18:35.521666 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:35.521736 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:35.521760 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:35.521946 (+   186us) tablet.cc:701] Row locks acquired
0709 13:18:35.521960 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:18:35.522086 (+   126us) write_op.cc:270] Start()
0709 13:18:35.522186 (+   100us) write_op.cc:276] Timestamp: P: 1783603115522046 usec, L: 0
0709 13:18:35.522206 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:35.818189 (+295983us) log.cc:844] Serialized 537 byte log entry
0709 13:18:36.867359 (+1049170us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:37.641666 (+774307us) op_driver.cc:464] REPLICATION: finished
0709 13:18:37.664852 (+ 23186us) write_op.cc:301] APPLY: starting
0709 13:18:37.664936 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:37.665037 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:37.665059 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:37.665388 (+   329us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:37.675407 (+ 10019us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:37.699298 (+ 23891us) write_op.cc:312] APPLY: finished
0709 13:18:37.737420 (+ 38122us) log.cc:844] Serialized 22 byte log entry
0709 13:18:37.754914 (+ 17494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:37.757142 (+  2228us) write_op.cc:454] Released schema lock
0709 13:18:37.787005 (+ 29863us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:37.865522 (+ 78517us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:37.865550 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":346649,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":22925,"apply.run_cpu_time_us":2395,"apply.run_wall_time_us":183969,"num_ops":1,"prepare.queue_time_us":753735,"prepare.run_cpu_time_us":16930,"prepare.run_wall_time_us":740844,"raft.queue_time_us":136002,"raft.run_cpu_time_us":6696,"raft.run_wall_time_us":36985,"replication_time_us":2119190,"spinlock_wait_cycles":123983872,"thread_start_us":965460,"threads_started":4,"wal-append.queue_time_us":407332}]]}
I20260709 13:18:38.132777  5521 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:38.142993  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:38.142158  5484 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:38.143496  5508 consensus_queue.cc:1243] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer b81584b21ed144698954548303f1e507 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:38.138566  5570 consensus_queue.cc:1059] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:38.158473  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:38.155635  5489 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:38.154335  5521 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:18:38.179733  5599 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:38.179690  5598 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:18:38.182983  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 126130us
I20260709 13:18:38.182533  5599 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.187060  5599 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.186474  5598 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:38.191890  5484 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:38.182731  5489 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:38.173695  5435 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:38.196612  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145088us
I20260709 13:18:38.198145  4112 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:38.197837  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:38.206674  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:38.207125  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:38.208088  4213 raft_consensus.cc:2368] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:38.209260  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:38.209988  4219 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.215977  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.193826  5598 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:38.252583  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:18:38.266669  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 58720.7us
I20260709 13:18:38.195137  5489 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:38.202476  5570 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:38.275748  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:38.254186  5509 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.253830  5364 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:38.255460  5488 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.259989  5564 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:38.270193  5607 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:18:38.301784  5560 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:38.302217  5560 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:38.302971  5560 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.272644  5535 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:38.304054  5560 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.282721  5570 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.307103  4219 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:38.285952  5364 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:38.294860  5571 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:38.318609  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 60658.9us
I20260709 13:18:38.318596  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:38.331105  4261 leader_election.cc:400] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:38.309209  5488 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:38.337649  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:38.315925  5570 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.291311  5509 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.328123  5364 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.353828  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:38.382453  4291 raft_consensus.cc:2376] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3. Re-sending same reply.
I20260709 13:18:38.368954  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.369385  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.369779  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.365083  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:38.391166  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.392429  4289 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:38.344970  5559 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:38.336726  5571 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:38.347790  5521 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:38.403132  5559 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.391283  5572 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.312476  5598 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:38.408224  5488 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.409811  4146 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:38.426362  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 158817us
W20260709 13:18:38.411612  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 149376us
I20260709 13:18:38.433331  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.434934  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.334786  5489 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.437745  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.408835  5559 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.441365  4216 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:38.446127  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.438876  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.450198  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:38.428210  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.446635  4215 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:38.454480  4215 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:38.457886  4215 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:38.412494  5598 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.478009  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.479314  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.480741  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.481863  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.411195  5572 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:38.420859  5597 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:38.430006  5521 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:38.422298  5509 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:38.484120  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:38.488046  4213 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:38.494196  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.485541  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:38.409369  5540 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.174s
I20260709 13:18:38.439757  5520 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:38.512519  5610 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.508669  5489 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.490170  5474 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.503213  5597 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:38.483126  5609 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.499778  5564 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:38.448665  5599 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:38.576669  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 82271.7us
I20260709 13:18:38.421386  5571 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:38.583376  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.585422  5474 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:38.510856  5435 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:38.526197  5472 consensus_meta.cc:287] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:18:38.586382  5474 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.586792  5472 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:38.589525  4220 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:38.580538  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.581418  4292 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:38.577858  5600 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.585456  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:38.589535  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:18:38.598142  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.592818  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.581868  5599 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:38.598466  4288 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.599475  4259 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:38.601336  4259 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:38.605428  4259 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:38.508095  5473 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.606020  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:38.609637  4259 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:38.609935  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.589210  5472 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:38.616000  5440 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.630607  5440 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:38.616418  5599 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.609194  5387 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.620908  5509 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.619817  5490 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.600660  5475 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:18:38.627417  5535 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.645188  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:38.602967  5564 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:38.742746  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:38.739042  4112 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.745033  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:38.628157  5610 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:38.621793  5521 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:38.753321  5618 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.120s	user 0.001s	sys 0.001s
I20260709 13:18:38.658059  5468 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:18:38.632120  5597 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:38.744738  5599 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.845121  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:38.845395  5615 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.310s	user 0.010s	sys 0.009s
I20260709 13:18:38.846043  4927 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:38.849167  5621 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:18:38.849516  4921 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:38.856693  5625 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:38.856818  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 95347.1us
I20260709 13:18:38.865876  5564 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:38.871277  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:38.817121  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.903831  4143 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:38.878430  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 238126us
I20260709 13:18:38.882129  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.884953  4288 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:38.906634  4214 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:38.758064  5440 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:38.893872  5619 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:18:38.893409  5560 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.009s
I20260709 13:18:38.895207  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:38.890517  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.901587  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.891108  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.906663  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:38.908254  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 172861us
I20260709 13:18:38.908874  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:38.909010  5571 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:38.936740  5448 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:38.898996  5597 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.882819  5508 raft_consensus.cc:3055] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:38.923082  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.944728  5508 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:38.945779  5508 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:38.947410  5508 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:38.949602  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.953053  5530 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:38.954244  5387 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:38.954614  5387 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:38.955394  5387 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.926385  5617 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:38.927798  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:38.928810  5473 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:38.931748  4922 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:38.953090  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:38.958570  4143 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:38.971969  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:38.959141  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:38.963559  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:38.966060  4893 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:38.969534  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.960915  5387 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.981271  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.990907  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.991876  5506 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:38.992555  5506 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.989917  5542 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.994181  5542 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:38.994797  5556 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.995559  5571 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:38.995183  5542 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.996183  5571 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:38.996707  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.997495  4138 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:38.998541  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.999032  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:38.995323  5473 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:39.001024  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:38.970896  5435 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.986164  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.020115  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.991757  4143 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:39.003319  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:39.022102  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:18:38.995096  5560 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:39.008919  5622 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.973707  5628 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.009452  5623 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.995431  5573 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:18:38.999925  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:39.011767  5598 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 13:18:39.000607  5530 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:39.014482  5559 consensus_meta.cc:287] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 13:18:39.016690  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.025274  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.102895  4140 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:39.103679  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:39.026857  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:38.956907  4139 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:39.029465  5599 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:39.018931  5570 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.000s
I20260709 13:18:39.118744  5570 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.036826  5468 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:18:39.119895  5468 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:39.047372  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:39.120309  5468 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:18:39.121074  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 73821.3us
I20260709 13:18:39.121207  5468 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.121910  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.122228  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.034200  5560 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:38.994845  5506 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:38.998615  5571 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:39.097082  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61897.6us
I20260709 13:18:39.123556  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.124295  5350 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.121920  5570 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.125213  5570 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.125375  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.100721  4294 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.126143  4145 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:39.035313  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:39.127113  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:39.127714  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 92507.3us
I20260709 13:18:39.116961  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.135943  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:39.122855  4140 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:39.000708  5473 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:39.115656  5559 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.099040  4215 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
W20260709 13:18:39.141111  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 119116us
I20260709 13:18:39.142071  4218 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:39.127825  4145 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:39.097980  5622 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.106050  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:39.127110  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.146711  4294 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:39.131668  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.133323  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:39.144063  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:39.147902  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.149178  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.149544  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.150189  4295 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:39.150337  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.151078  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.153252  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:39.152510  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.154902  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:39.158867  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:39.159065  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.124801  5560 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:39.114198  5564 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.168030  4289 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:39.169322  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:39.162123  4294 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.140599  5473 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:39.165205  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.136267  5468 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:39.151808  5364 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.001s
I20260709 13:18:39.171046  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:39.140187  5586 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:39.138200  5570 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:39.162940  4145 raft_consensus.cc:2368] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:39.174189  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:18:39.209149  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 80148.5us
I20260709 13:18:39.145983  5622 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:39.115098  5628 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:18:39.152516  4138 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:39.160976  5484 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.210903  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.161581  5506 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.168167  5609 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.167630  5530 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:39.234108  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59983.6us
I20260709 13:18:39.173496  4295 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.223843  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:39.236696  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:39.226536  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 196852us
I20260709 13:18:39.231042  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.208319  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:39.239653  4296 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:39.207674  5617 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.242352  4296 pending_rounds.cc:85] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 1
I20260709 13:18:39.252179  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:39.254066  4295 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:39.255795  4145 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:39.256878  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:39.260599  5634 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:18:39.263690  5639 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.264431  5639 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:39.264945  5639 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.269662  4187 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.270808  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.328940  4145 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.385341  4145 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:39.270262  4045 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 156) took 5282 ms. Trace:
I20260709 13:18:39.404809  4186 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:18:39.406494  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 135738us
I20260709 13:18:39.224829  5586 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:39.198820  5508 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:18:39.227700  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:39.243773  4296 pending_rounds.cc:107] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:39.446529  4296 raft_consensus.cc:2889] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:39.213096  5570 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.226197  5622 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:39.263770  5624 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.503s	user 0.004s	sys 0.004s
I20260709 13:18:39.410645  4146 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.212145  5364 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.453318  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:18:39.403833  5475 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.457862  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:39.460834  4221 raft_consensus.cc:606] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:39.413031  5541 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.433554  5435 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.404704  4045 rpcz_store.cc:276] 0709 13:18:33.968669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.969027 (+   358us) service_pool.cc:224] Handling call
0709 13:18:39.251370 (+5282343us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.235974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.236549 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.236579 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:18:36.236599 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:36.236917 (+   318us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.236965 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.236997 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:36.237219 (+   222us) tablet.cc:701] Row locks acquired
0709 13:18:36.237232 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:18:36.237369 (+   137us) write_op.cc:270] Start()
0709 13:18:36.237475 (+   106us) write_op.cc:276] Timestamp: P: 1783603116237319 usec, L: 0
0709 13:18:36.237493 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:18:36.238088 (+   595us) log.cc:844] Serialized 537 byte log entry
0709 13:18:38.156613 (+1918525us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.165235 (+  8622us) write_op.cc:301] APPLY: starting
0709 13:18:38.165333 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.165451 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.165562 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.165822 (+   260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.165993 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:38.166042 (+    49us) write_op.cc:312] APPLY: finished
0709 13:18:38.166270 (+   228us) log.cc:844] Serialized 22 byte log entry
0709 13:18:38.166472 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.166559 (+    87us) write_op.cc:454] Released schema lock
0709 13:18:38.166603 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.166977 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.167007 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7016,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":708,"apply.run_cpu_time_us":1746,"apply.run_wall_time_us":5066,"num_ops":1,"prepare.queue_time_us":1526911,"prepare.run_cpu_time_us":2349,"prepare.run_wall_time_us":2349,"replication_time_us":1918969}]]}
W20260709 13:18:39.470402  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 213571us
W20260709 13:18:39.464195  5597 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.004s
I20260709 13:18:39.454171  5599 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.483882  4291 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.454952  5505 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:39.490576  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.491909  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.494073  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:39.477526  5435 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:39.494865  5623 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:39.495505  5435 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.502750  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:39.510749  4287 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:39.505508  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 306233us
W20260709 13:18:39.511477  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 103410us
W20260709 13:18:39.508945  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.505318  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 83) took 1100 ms. Trace:
I20260709 13:18:39.513254  4220 rpcz_store.cc:276] 0709 13:18:38.404879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.405023 (+   144us) service_pool.cc:224] Handling call
0709 13:18:38.405327 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.589948 (+184621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.504943 (+914995us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540041aad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:39.505232 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423154944}
I20260709 13:18:39.514714  4142 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:18:39.515115  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 1163) took 1030 ms. Trace:
I20260709 13:18:39.515690  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.519235  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.517428  4289 rpcz_store.cc:276] 0709 13:18:38.479867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.481636 (+  1769us) service_pool.cc:224] Handling call
0709 13:18:39.510018 (+1028382us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400288f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:39.510161 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561478912}
I20260709 13:18:39.409852  5473 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.484413  5506 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:39.534086  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.521772  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:39.548303  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 309141us
I20260709 13:18:39.548588  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:39.552325  4290 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:39.496212  5641 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:39.539048  5559 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:39.580258  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 82895.5us
I20260709 13:18:39.498194  5505 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.569949  5473 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.616782  5650 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.617960  5650 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:39.559191  5572 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:18:39.568827  5475 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:39.547047  5586 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:39.639526  4146 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:39.621330  5649 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.624770  5440 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.627041  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:39.633988  5387 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.003s
W20260709 13:18:39.634145  5632 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.419s	user 0.000s	sys 0.002s
I20260709 13:18:39.648504  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:39.576881  5641 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:39.649730  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 130585us
I20260709 13:18:39.651537  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.652524  4261 leader_election.cc:400] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:39.652933  5629 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.653474  5629 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.653856  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:39.658499  4187 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.660465  4187 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.666522  4187 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:39.669605  5636 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.213s	user 0.001s	sys 0.001s
I20260709 13:18:39.670101  5474 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:39.670559  5387 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.671135  5654 consensus_queue.cc:1059] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:39.671927  5387 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:39.672407  5387 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:39.672654  5654 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:39.673172  5654 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:39.674170  5654 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.668926  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.664425  5649 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.678848  5649 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.670626  5474 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:39.679359  5649 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.658586  5560 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:39.656196  5623 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.680823  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.675624  5654 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.664001  5440 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:39.689391  5647 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:18:39.681883  5645 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:18:39.682032  5474 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.678875  5637 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:39.689419  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.668392  5559 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:39.668197  5364 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:39.695142  5638 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.241s	user 0.000s	sys 0.003s
I20260709 13:18:39.695611  4290 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.697605  4925 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.701469  5658 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.701574  5650 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:39.687084  5648 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:18:39.673542  5387 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.714433  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:39.717437  5505 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:39.721482  5506 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:18:39.718022  4296 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.726722  5641 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:39.718767  5646 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:18:39.727631  5489 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.208s	user 0.012s	sys 0.000s
I20260709 13:18:39.727742  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.728699  4296 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:39.722208  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:39.703445  5642 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:18:39.725384  5659 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.731841  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.732770  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.733656  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.704424  5559 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:39.742697  5542 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.724906  5435 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.743240  5542 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.743819  5542 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.745878  5659 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.746521  5659 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.748106  4290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:39.703953  5655 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.748792  4290 raft_consensus.cc:606] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:18:39.754416  5649 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.756619  5560 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:39.757227  5560 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.757586  5649 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.758373  4187 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.758638  4041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 79) took 4524 ms. Trace:
I20260709 13:18:39.759807  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.761999  5649 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.762616  5649 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.763041  5649 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.763197  4288 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:39.759219  4041 rpcz_store.cc:276] 0709 13:18:35.234720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.234954 (+   234us) service_pool.cc:224] Handling call
0709 13:18:39.758546 (+4523592us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.238465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.286059 (+ 47594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.286087 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:18:36.286103 (+    16us) tablet.cc:662] Decoding operations
0709 13:18:36.286541 (+   438us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.286586 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.286616 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:36.286786 (+   170us) tablet.cc:701] Row locks acquired
0709 13:18:36.286804 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:36.286949 (+   145us) write_op.cc:270] Start()
0709 13:18:36.287069 (+   120us) write_op.cc:276] Timestamp: P: 1783603116286903 usec, L: 0
0709 13:18:36.287085 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:18:36.287652 (+   567us) log.cc:844] Serialized 532 byte log entry
0709 13:18:38.157095 (+1869443us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.167358 (+ 10263us) write_op.cc:301] APPLY: starting
0709 13:18:38.173141 (+  5783us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.180070 (+  6929us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.185474 (+  5404us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.195388 (+  9914us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.256784 (+ 61396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:38.263257 (+  6473us) write_op.cc:312] APPLY: finished
0709 13:18:38.268760 (+  5503us) log.cc:844] Serialized 22 byte log entry
0709 13:18:38.287286 (+ 18526us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.293376 (+  6090us) write_op.cc:454] Released schema lock
0709 13:18:38.297139 (+  3763us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.312186 (+ 15047us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.312219 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1445137,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":10084,"apply.run_cpu_time_us":2523,"apply.run_wall_time_us":144777,"mutex_wait_us":4373,"num_ops":1,"prepare.queue_time_us":926766,"prepare.run_cpu_time_us":2501,"prepare.run_wall_time_us":49421,"replication_time_us":1869902,"thread_start_us":104106,"threads_started":1}]]}
I20260709 13:18:39.763615  4288 pending_rounds.cc:85] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 1
I20260709 13:18:39.764772  4288 pending_rounds.cc:107] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:39.765193  4288 raft_consensus.cc:2889] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:39.764463  5521 raft_consensus.cc:3055] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:39.768281  5521 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:39.769405  5521 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:39.770664  5570 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.770916  5521 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.761713  4187 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.777483  5649 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.780032  5649 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.787209  5345 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.748769  5559 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.788467  5474 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.793216  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.797019  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:39.797992  4145 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:18:39.800395  5639 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 13:18:39.801797  5435 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.801110  5639 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.698087  5622 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:39.807065  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.808820  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.734483  5475 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:39.816919  5653 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:18:39.747562  5658 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.818454  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.819033  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:39.811859  5656 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:18:39.732775  5623 consensus_queue.cc:1175] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34e6205f3c1d434193126fef20d73800" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 3 index: 2 } }
I20260709 13:18:39.821053  5571 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:39.829896  5468 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.007s
I20260709 13:18:39.831048  4143 raft_consensus.cc:2410] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:39.832548  5622 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:39.834401  5658 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.834925  5658 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.836431  4288 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:39.837502  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:18:39.839565  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 117973us
I20260709 13:18:39.834131  5542 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.791136  5649 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.840764  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:39.846175  4215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1232) took 1365 ms (client timeout 1588 ms). Trace:
W20260709 13:18:39.849452  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 87822.3us
W20260709 13:18:39.852913  4215 rpcz_store.cc:269] 0709 13:18:38.480915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.483905 (+  2990us) service_pool.cc:224] Handling call
0709 13:18:39.845865 (+1361960us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400181854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:39.846078 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366870400}
I20260709 13:18:39.812546  5448 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.811049  5570 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.853564  4187 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.867959  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.869546  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:39.870267  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:39.869637  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:39.851054  5628 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.844404  5484 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.877302  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:39.878486  5635 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.522s	user 0.003s	sys 0.000s
I20260709 13:18:39.880388  4187 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:39.879978  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 46) took 1037 ms. Trace:
I20260709 13:18:39.883020  4147 rpcz_store.cc:276] 0709 13:18:38.842264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.842560 (+   296us) service_pool.cc:224] Handling call
0709 13:18:38.843040 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.843371 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.843407 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.880778 (+ 37371us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.111993 (+231215us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:39.112070 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.112198 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.789319 (+677121us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:39.879633 (+ 90314us) raft_consensus.cc:1685] finished
0709 13:18:39.879657 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.879907 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4813568,"thread_start_us":195695,"threads_started":1,"wal-append.queue_time_us":323234}
I20260709 13:18:39.873433  5639 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:39.885604  5345 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.886261  5571 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.874285  5475 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.859028  5435 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:18:39.875313  5649 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:39.900306  5660 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:18:39.910035  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.910455  5649 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.911110  5649 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.913251  5649 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.917860  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:39.918768  4293 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:39.874073  5448 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:39.920944  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:39.878037  5663 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.932297  4218 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:39.904032  5655 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.925758  4215 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.884972  5628 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.893965  5564 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:18:39.937188  4222 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.926844  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1214) took 1013 ms. Trace:
I20260709 13:18:39.953251  5639 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.953802  5639 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.955511  5639 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:39.951196  4292 rpcz_store.cc:276] 0709 13:18:38.913039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.907382 (+994343us) service_pool.cc:224] Handling call
0709 13:18:39.926763 (+ 19381us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:39.964228  5472 raft_consensus.cc:993] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:18:39.965042  5472 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.965483  5472 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:39.965935  5472 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.966508  5440 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:39.949797  5655 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.968703  5663 raft_consensus.cc:1081] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:18:39.970480  5655 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.971197  5580 consensus_queue.cc:1059] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:39.972434  5580 raft_consensus.cc:3055] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:39.972923  5580 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:39.948714  5560 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.973920  5580 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:39.972512  5665 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.977065  5659 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.978315  5448 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:39.979188  5448 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:39.981851  5659 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.983076  5560 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:39.984848  5542 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.986574  5475 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:39.991725  5472 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:39.995199  5560 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.996665  5629 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:39.999866  5560 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.004482  5560 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:40.007318  5472 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.012579  4213 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:40.014487  4287 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:39.999914  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1219) took 1084 ms. Trace:
I20260709 13:18:40.036973  5484 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.037706  5484 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:40.038863  5484 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.055759  5387 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.056610  5599 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.019387  4291 rpcz_store.cc:276] 0709 13:18:38.915211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.958433 (+ 43222us) service_pool.cc:224] Handling call
0709 13:18:38.958808 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.488945 (+530137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.999264 (+510319us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54002788d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:39.999802 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207096192}
I20260709 13:18:39.989104  5345 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:39.975235  5580 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.085994  5484 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.069535  5448 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:40.082084  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.071368  5599 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.098835  5628 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:40.103449  5559 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.095624  5448 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.104635  5599 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:40.110720  5559 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:39.909788  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:40.163499  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 253549us
I20260709 13:18:40.167783  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:18:40.174383  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.174352  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 253332us
W20260709 13:18:40.175788  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 270100us
I20260709 13:18:40.191901  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.196094  4216 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:40.202266  4218 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:40.205402  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 249467us
I20260709 13:18:40.209601  4216 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:40.210767  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.211493  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.215086  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:40.216642  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:40.219038  4218 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:40.220757  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:40.220534  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.224164  4290 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:40.224367  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:40.225293  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:40.229269  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:40.231840  5475 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.234856  5475 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.236958  5364 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.238215  5364 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.239125  5475 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.239498  5435 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.172226  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:40.252475  5597 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.253041  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:40.254643  4293 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:40.259742  5448 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.274503  5364 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:40.281386  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:40.265480  5448 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.288228  5597 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.305994  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:40.317271  4142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 45) took 1501 ms (client timeout 1670 ms). Trace:
W20260709 13:18:40.318004  4142 rpcz_store.cc:269] 0709 13:18:38.815747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.818006 (+  2259us) service_pool.cc:224] Handling call
0709 13:18:40.316708 (+1498702us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400395dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:40.316976 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403451648}
I20260709 13:18:40.303896  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1241) took 1295 ms. Trace:
I20260709 13:18:40.321049  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:40.321422  4141 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:40.329741  5573 consensus_queue.cc:1059] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:40.328649  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 49) took 1440 ms. Trace:
I20260709 13:18:40.332800  5586 raft_consensus.cc:3055] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.333454  5586 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:40.321099  4143 rpcz_store.cc:276] 0709 13:18:39.030471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.105663 (+ 75192us) service_pool.cc:224] Handling call
0709 13:18:40.303080 (+1197417us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400286254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:40.303476 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573947264}
I20260709 13:18:40.298913  5448 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:40.342969  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1130) took 1355 ms. Trace:
I20260709 13:18:40.342726  5586 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:40.344930  5541 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.345745  5541 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.346300  5541 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.355031  5586 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.333179  4141 rpcz_store.cc:276] 0709 13:18:38.888617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.895688 (+  7071us) service_pool.cc:224] Handling call
0709 13:18:40.320609 (+1424921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.323788 (+  3179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.328171 (+  4383us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400395dd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:40.328509 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3211572608}
I20260709 13:18:40.361346  5564 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:40.362448  5564 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:40.374610  4290 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:40.365948  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:18:40.379977  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 208167us
I20260709 13:18:40.343677  4138 rpcz_store.cc:276] 0709 13:18:38.986897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.258905 (+272008us) service_pool.cc:224] Handling call
0709 13:18:39.259531 (+   626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.434145 (+174614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.447197 (+ 13052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.449761 (+  2564us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:39.456873 (+  7112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.342150 (+885277us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540022e7d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:40.342293 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.342740 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23417216}
W20260709 13:18:40.404515  5637 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.695s	user 0.004s	sys 0.019s
I20260709 13:18:40.405364  5637 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.406908  4220 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:40.408010  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.379248  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:40.362437  5570 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.421180  4296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:40.421523  5570 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.372635  5649 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:18:40.424012  5649 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:40.424602  5649 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:40.425951  5570 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.377945  5564 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:40.366714  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:40.367884  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:40.364058  5448 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:40.372532  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet 151524a8517e4b8ebc7308777c98105e with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46838
I20260709 13:18:40.422793  4296 raft_consensus.cc:606] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:40.428263  4296 raft_consensus.cc:614] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:40.428285  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 60954us
I20260709 13:18:40.416493  4925 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:40.428292  5637 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.433940  4110 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:40.435211  5448 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.435693  5448 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.436156  5448 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.438095  4220 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:40.445425  4288 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:40.444840  5573 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:18:40.452481  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:18:40.457510  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 80588.1us
I20260709 13:18:40.462436  4042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 173) took 5200 ms. Trace:
I20260709 13:18:40.462477  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:40.471343  5659 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.471894  5505 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:40.467826  5637 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:18:40.472137  5659 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:40.472855  5505 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:40.473960  5659 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.479965  5345 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:40.480708  5345 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:40.483364  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:40.482827  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:40.481920  4139 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.010s
I20260709 13:18:40.480856  5505 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:40.483611  5658 consensus_meta.cc:287] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.634s	user 0.016s	sys 0.007s
I20260709 13:18:40.487205  5484 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.490088  5468 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:40.489930  5597 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:40.463071  4042 rpcz_store.cc:276] 0709 13:18:35.261377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.262385 (+  1008us) service_pool.cc:224] Handling call
0709 13:18:40.462149 (+5199764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.288128 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.288847 (+   719us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.288894 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:18:36.288920 (+    26us) tablet.cc:662] Decoding operations
0709 13:18:36.289398 (+   478us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.289449 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.289487 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:36.289859 (+   372us) tablet.cc:701] Row locks acquired
0709 13:18:36.289894 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:18:36.290050 (+   156us) write_op.cc:270] Start()
0709 13:18:36.290163 (+   113us) write_op.cc:276] Timestamp: P: 1783603116290010 usec, L: 0
0709 13:18:36.290192 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:36.290882 (+   690us) log.cc:844] Serialized 917 byte log entry
0709 13:18:38.296845 (+2005963us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.317325 (+ 20480us) write_op.cc:301] APPLY: starting
0709 13:18:38.317420 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.317544 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.330084 (+ 12540us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.453532 (+123448us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b5c0024ff0c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44ed4331 00007fee44ed4221 00007fee44ecef6c 00007fee4262f30b 00007fee4262efd3 00007fee4272de34 00007fee4271997c 00007fee4271dd61 00007fee4271dd19 00007fee4271dca9 00007fee4271dc71
0709 13:18:38.453890 (+   358us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.454053 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:38.454097 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:38.454290 (+   193us) log.cc:844] Serialized 28 byte log entry
0709 13:18:38.454465 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.454549 (+    84us) write_op.cc:454] Released schema lock
0709 13:18:38.454586 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.454913 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.454938 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":795893,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":8739,"apply.run_cpu_time_us":4558,"apply.run_wall_time_us":137594,"num_ops":2,"prepare.queue_time_us":935998,"prepare.run_cpu_time_us":3030,"prepare.run_wall_time_us":3208,"replication_time_us":1996445,"spinlock_wait_cycles":7147392}]]}
I20260709 13:18:40.498577  5468 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:40.501842  5468 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:40.504485  4139 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:40.482676  5345 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.510130  5345 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.512296  5541 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.514719  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1131) took 1527 ms. Trace:
I20260709 13:18:40.526427  5597 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.487982  5649 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.496929  5658 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.536805  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:40.544657  4221 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:40.533545  5564 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:40.548295  5609 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:18:40.555846  5658 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.549207  5600 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:18:40.558445  5364 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.557509  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:40.549289  5681 tablet_replica.cc:333] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:18:40.520859  4139 rpcz_store.cc:276] 0709 13:18:38.987116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.157721 (+170605us) service_pool.cc:224] Handling call
0709 13:18:40.514170 (+1356449us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b540044aa54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:40.514536 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935696768}
I20260709 13:18:40.560320  5364 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.567066  5364 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:40.571931  5541 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.574695  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:40.575927  4288 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.577093  5448 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:40.520733  5468 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.572121  5364 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.588163  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.588855  5364 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.589313  4213 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:40.590085  5649 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.564021  5597 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.592294  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:40.592834  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 72124.1us
I20260709 13:18:40.599004  4219 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:40.593374  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:40.599291  4288 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:40.592651  5597 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:40.593080  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.604908  5597 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.593076  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.592762  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:40.594280  4221 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:40.607486  4218 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:40.614101  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:18:40.615514  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67506.4us
I20260709 13:18:40.620391  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:40.614902  5448 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:40.626820  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.618708  5387 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:18:40.626901  4290 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:40.632591  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.634569  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:40.635401  4925 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.631747  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.625931  5597 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.633242  5541 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.645012  5541 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:40.646556  5541 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:40.648989  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.649626  5559 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.658154  5650 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.659550  5650 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.659981  5650 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:40.668458  4220 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:40.668932  5387 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:40.652029  5628 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.684506  5628 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:40.685868  5628 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.675827  5468 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.687583  5484 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.677768  5599 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:40.672832  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49467.2us
I20260709 13:18:40.687904  5628 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.681280  5650 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.683112  5387 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:40.698287  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 76337.4us
I20260709 13:18:40.703159  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.705804  4925 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:40.709156  5684 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:40.710716  4110 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:40.691056  5599 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:40.712393  5599 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.713325  5448 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.714215  5599 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.714908  5564 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.715382  5564 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:40.716467  5564 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.720656  5650 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.724941  5448 raft_consensus.cc:697] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:40.725485  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.729799  5448 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:40.731014  5387 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:40.725814  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:40.731969  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.734921  4215 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:40.726187  5564 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.744814  5690 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:40.746419  5690 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:40.751255  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.757128  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:40.755014  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:40.763473  5684 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.763856  4216 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:40.766881  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:40.769658  5570 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:40.774914  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 126852us
I20260709 13:18:40.778152  4287 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:40.798205  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.798208  5387 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.800009  5364 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:40.803514  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 63509.8us
I20260709 13:18:40.803562  4290 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:40.796547  4042 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 2, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.800575  5364 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:40.825102  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:40.834028  4042 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 3 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.841485  5609 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:18:40.856755  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44018.8us
I20260709 13:18:40.851320  4042 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 2, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 2 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:40.868502  5573 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:40.867463  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.870601  4187 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:40.875066  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.853823  5387 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.848090  5570 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:18:40.886725  5689 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.887593  4187 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:40.888888  5649 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.889312  5570 consensus_queue.cc:1243] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:40.890084  5570 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.898444  5690 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.896329  5609 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:40.902609  5691 consensus_queue.cc:1059] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.873554  5364 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.904836  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:40.887709  5689 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.924803  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:40.907573  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.927862  5448 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:40.928731  5448 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:40.926230  5693 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:18:40.932781  5681 raft_consensus.cc:2243] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.932981  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.934299  5689 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.937898  5684 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:40.938237  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:40.938689  5684 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.939388  4139 raft_consensus.cc:2410] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:40.939910  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.941236  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:40.941706  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:40.942147  4138 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:40.942040  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:40.942435  4296 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:40.940683  4219 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:40.903916  5609 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:40.944406  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:40.945060  5609 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:40.945343  5468 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:40.945585  5484 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.945938  5468 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.945706  5609 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.946480  5468 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.946496  5484 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.949782  4296 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:40.948724  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:40.950469  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:40.952091  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.896991  5570 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:40.954356  4291 raft_consensus.cc:2410] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:40.905980  5649 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:40.954276  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49591.2us
I20260709 13:18:40.956724  4219 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:40.903929  5691 raft_consensus.cc:3055] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.942062  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:40.957706  5691 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:40.959221  5364 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.951177  5448 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:40.959437  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:40.960045  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:40.949407  5609 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.961565  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:40.965142  4290 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:18:40.968817  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81357.7us
I20260709 13:18:40.968297  5448 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.971861  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:40.972193  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:40.973126  4139 raft_consensus.cc:2368] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:40.973588  5448 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.973963  5484 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.976715  5681 raft_consensus.cc:2272] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.984021  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.984859  5484 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:40.985507  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.985528  5484 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:40.987013  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:40.988097  4141 raft_consensus.cc:2410] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:40.989511  5684 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:40.990777  5681 ts_tablet_manager.cc:1916] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:40.991052  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:40.993705  4220 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:40.993680  4293 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:40.996569  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:40.998582  5650 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:18:41.008672  5448 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:41.009362  5448 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.010214  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:41.011538  5448 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:41.012506  5570 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.012908  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:41.013870  4920 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:41.014123  5484 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.014268  5570 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.015518  4110 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:18:41.018689  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.020799  5484 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.021497  5484 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:41.021968  5484 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.000706  5691 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.030752  5691 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.051906  4290 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
W20260709 13:18:41.058178  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 64744.5us
I20260709 13:18:41.054327  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.062472  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.046346  5650 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.049630  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.049279  5559 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.064965  5599 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.040237  5468 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.108199  5484 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.114969  5559 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:41.115602  5559 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.117187  5484 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:41.117415  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.118410  4146 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:41.118196  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.108320  5628 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:41.120219  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.127132  4140 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.119786  5628 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.131596  5689 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:41.132433  5689 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.120873  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.135330  5448 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:41.123184  4143 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:41.136010  5448 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.137538  4147 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:41.135190  4138 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.138267  4147 pending_rounds.cc:85] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 1
I20260709 13:18:41.138579  4147 pending_rounds.cc:107] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:41.138888  4147 raft_consensus.cc:2889] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.140187  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:41.102914  5650 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.142887  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.147729  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:41.150290  5387 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.151063  5387 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.151811  5689 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:41.155133  5387 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.158030  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.162787  5542 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:41.168949  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.168851  5542 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.169745  4142 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.172529  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.173229  5542 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.173293  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.174067  4146 raft_consensus.cc:2376] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 4. Re-sending same reply.
I20260709 13:18:41.174422  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.175016  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.164386  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:41.165390  5628 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.166755  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:41.176662  4221 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:41.107844  5599 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.178755  5599 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.161192  5448 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.167560  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.167229  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.176466  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.175094  4144 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:41.181536  5650 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:41.181903  4288 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:41.182334  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.181555  4147 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:41.185906  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:41.186501  4144 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.186693  4920 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
W20260709 13:18:41.188489  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.189014  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:41.189258  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 119060us
I20260709 13:18:41.191133  5650 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.191619  5650 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.192044  5650 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.193789  4261 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:41.086544  5364 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:18:41.206712  4145 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:41.201195  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:41.216997  4140 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:41.222291  4146 raft_consensus.cc:1813] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Handling vote request from an unknown peer 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:41.221975  4261 raft_consensus.cc:2686] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:41.223340  4146 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:18:41.228664  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.224854  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:41.219265  5448 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.235491  4143 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:41.238004  5468 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.238612  4141 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:41.238061  4920 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:41.242651  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:41.243325  4221 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.244959  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:41.244832  5387 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:41.260166  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.261025  5628 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.261673  5628 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.263057  4142 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:41.263314  5691 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:41.263857  5691 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:41.272126  4143 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:41.250258  5559 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.248800  5468 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:41.271497  5691 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.277367  5559 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.283948  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:41.288682  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.291319  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50331.5us
I20260709 13:18:41.299140  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:41.307796  4922 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:41.264231  5628 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.312449  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:41.314004  4219 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:41.311172  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.321681  4141 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:41.323340  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:41.335378  4110 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:18:41.336906  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.337721  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.339610  4293 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:41.340919  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:41.346333  4219 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:41.349566  4221 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:18:41.351058  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:41.351872  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:41.323993  5599 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.354737  5345 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:41.334510  5387 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:41.344544  4138 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
W20260709 13:18:41.369854  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.370021  5364 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.345409  5570 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.374644  5559 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.379580  5599 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.379194  5559 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.372275  5448 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:41.389251  4142 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:41.381906  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.391312  5387 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:41.398604  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.406867  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.409571  4893 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.670s (SENT)
I20260709 13:18:41.387398  5364 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.427824  5559 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:41.429842  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:41.386874  5570 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:41.382095  5650 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.440486  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.412024  5448 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:41.444829  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.445147  5570 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.446305  5650 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:41.450142  5541 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:41.450215  5345 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:41.451175  5650 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:41.451092  5541 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.451195  5345 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.452703  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:41.454419  5345 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.451797  5650 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.463824  5448 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.463762  5650 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.467527  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:41.468297  4925 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:41.461820  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.762s (SENT)
I20260709 13:18:41.471115  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:41.460896  5681 ts_tablet_manager.cc:1929] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:41.485796  5705 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:41.477114  5364 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.486821  5705 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.487738  4143 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:41.489569  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.489764  4138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:18:41.490491  4142 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:41.490955  4141 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:41.492120  4144 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:41.494441  5705 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:41.495214  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:41.497547  5541 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.498072  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.491937  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.501524  4145 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:41.490394  4138 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:41.502888  4138 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:41.504022  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.478904  5588 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.507203  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.507344  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.508855  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:41.509009  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.513715  5681 log.cc:1199] T 151524a8517e4b8ebc7308777c98105e P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/151524a8517e4b8ebc7308777c98105e
I20260709 13:18:41.515376  5681 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46838 (request call id 68) took 1143 ms. Trace:
I20260709 13:18:41.517953  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.519078  4144 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:41.515976  5681 rpcz_store.cc:276] 0709 13:18:40.371804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.372106 (+   302us) service_pool.cc:224] Handling call
0709 13:18:40.517358 (+145252us) ts_tablet_manager.cc:1151] Deleting tablet 151524a8517e4b8ebc7308777c98105e
0709 13:18:40.542768 (+ 25410us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:41.322138 (+779370us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:41.460152 (+138014us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:41.515285 (+ 55133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":388602,"tablet-delete.queue_time_us":87132,"thread_start_us":24903,"threads_started":1}
I20260709 13:18:41.521235  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet 151524a8517e4b8ebc7308777c98105e (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:18:41.522370  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.523865  4146 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:41.524286  4140 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:41.525672  4143 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:41.529909  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.541666  4142 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:41.542541  4142 pending_rounds.cc:85] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 1
I20260709 13:18:41.543035  4142 pending_rounds.cc:107] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:41.543450  4142 raft_consensus.cc:2889] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.545893  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.547973  4147 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:41.559762  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.500172  4139 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:41.572781  5387 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.573145  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.574102  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.574610  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.574817  4290 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:41.574693  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.575523  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.576261  4293 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:41.573657  5387 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.578948  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:41.584410  5387 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.601570  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.602483  4288 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:41.607149  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.608348  4288 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:41.608893  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.613174  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:41.614009  4290 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:41.614897  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.615633  4291 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:41.616371  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.619127  5649 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.619366  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:41.620174  4291 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:41.629480  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.629647  5588 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:41.562476  4925 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:41.562099  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:41.637933  4146 raft_consensus.cc:2376] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2. Re-sending same reply.
I20260709 13:18:41.563500  4145 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:41.639010  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:41.640084  5542 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:41.640661  5542 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:41.641047  4288 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:41.641716  5542 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:41.637199  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 186946us
I20260709 13:18:41.646194  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:41.647011  4110 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a35e1cee8a15436dbfaf75dd67824aad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.647532  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.648408  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.647663  5649 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.650677  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.651255  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.656772  4218 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:41.599211  4138 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.657509  5649 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:41.657588  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 285821us
I20260709 13:18:41.664096  4144 raft_consensus.cc:1240] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:41.665100  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.665504  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:41.666523  5691 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.666561  5448 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.667008  5691 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.667454  5691 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.665674  4291 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:18:41.668565  5448 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:41.670792  5570 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.674161  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:41.675760  5705 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.676232  5705 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.676797  5705 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.681265  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.682276  5570 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:41.683019  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.688479  4138 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:41.659047  4187 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.688934  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:41.689769  4920 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.690568  5719 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.691582  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:41.693331  5448 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.693780  5448 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:41.694202  5448 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.696024  5649 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:41.696714  5649 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.698655  5690 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:41.699494  5649 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.702661  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:41.703341  4219 raft_consensus.cc:3055] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:41.703656  4219 raft_consensus.cc:740] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:41.704627  4219 consensus_queue.cc:260] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.705914  4219 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.709117  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.709403  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:41.713230  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.707792  5448 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.718757  5468 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.718647  5719 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:41.723276  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.722587  5649 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:18:41.729215  5600 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.731757  5705 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.737502  5448 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:41.740186  5705 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.687917  5691 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:41.748190  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:41.746021  5719 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.753520  4220 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:41.754981  5691 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:41.750356  4219 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:41.763916  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:41.765588  5684 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:41.767486  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 44304.1us
W20260709 13:18:41.767501  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54370.1us
I20260709 13:18:41.769448  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:41.769719  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.771699  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.766346  5684 raft_consensus.cc:697] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:41.775967  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:41.780833  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66368.1us
I20260709 13:18:41.772159  5689 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.779392  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:41.777969  5570 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.780208  5719 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.793030  5684 consensus_queue.cc:237] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:41.794260  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:41.796015  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.783952  5542 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:41.799059  4920 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:41.787928  5689 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:41.924444  5541 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:41.913395  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.803514  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.955226  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.955811  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.924518  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 130340us
I20260709 13:18:41.928864  5345 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.930456  5600 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:18:41.801726  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.936203  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 140235us
I20260709 13:18:41.958568  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.800102  5468 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:41.791931  5729 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.799595  5705 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.950016  5689 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.982035  4187 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:41.992942  4261 leader_election.cc:400] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:18:41.996420  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:41.997658  5691 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.004595  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:41.993790  5649 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.972790  5729 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:41.963096  5542 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:42.021462  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:41.965345  5345 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.006507  5541 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.006256  5649 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:41.973943  5600 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:42.018358  5705 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:42.044569  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 253721us
I20260709 13:18:42.053270  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:42.054167  4141 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:42.054411  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:42.056589  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:42.042692  5387 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:42.045230  5649 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:42.062235  4293 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:42.057855  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:42.060735  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:42.017445  5729 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:42.067253  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:42.068267  4145 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:42.070861  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:42.071767  4147 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:42.091050  5570 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.078271  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:42.057442  5541 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.094321  5541 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:42.075305  5730 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:42.081216  4296 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:42.074411  5600 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:42.081943  5691 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:42.083323  5542 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.078531  5705 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:18:42.076756  5364 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.086818  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:42.074179  5345 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:42.067935  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 104942us
I20260709 13:18:42.103091  4293 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:18:42.046710  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 64784.8us
I20260709 13:18:42.091761  5570 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.131443  5737 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:42.133028  5570 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.127359  4925 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:42.085469  5690 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.135499  5690 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.138250  5690 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.072698  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:42.139103  4139 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:42.144068  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.145216  4220 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:42.134447  4187 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:42.147550  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.148664  4219 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:42.152786  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:42.193449  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 55943.7us
W20260709 13:18:42.200726  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66336.1us
I20260709 13:18:42.202126  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:42.205224  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.209612  5739 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:42.210445  5541 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.194242  5738 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.221328  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 142777us
I20260709 13:18:42.197049  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:42.230439  4042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 80) took 1528 ms. Trace:
I20260709 13:18:42.233990  4292 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
W20260709 13:18:42.255798  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53887.4us
I20260709 13:18:42.258101  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:42.262887  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:42.265733  5599 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:42.266295  5599 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:42.207437  5690 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:42.231118  4042 rpcz_store.cc:276] 0709 13:18:40.690408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.691378 (+   970us) service_pool.cc:224] Handling call
0709 13:18:42.218553 (+1527175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:41.264899 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:41.265772 (+   873us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:41.265850 (+    78us) write_op.cc:435] Acquired schema lock
0709 13:18:41.265880 (+    30us) tablet.cc:662] Decoding operations
0709 13:18:41.266704 (+   824us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:41.266832 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:41.266869 (+    37us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:41.267433 (+   564us) tablet.cc:701] Row locks acquired
0709 13:18:41.267496 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:18:41.267719 (+   223us) write_op.cc:270] Start()
0709 13:18:41.267901 (+   182us) write_op.cc:276] Timestamp: P: 1783603121267639 usec, L: 0
0709 13:18:41.267945 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:18:41.336321 (+ 68376us) log.cc:844] Serialized 1292 byte log entry
0709 13:18:41.661738 (+325417us) op_driver.cc:464] REPLICATION: finished
0709 13:18:41.823101 (+161363us) write_op.cc:301] APPLY: starting
0709 13:18:41.955824 (+132723us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:41.993877 (+ 38053us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:42.037480 (+ 43603us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:42.096013 (+ 58533us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:42.096302 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:42.096386 (+    84us) write_op.cc:312] APPLY: finished
0709 13:18:42.096757 (+   371us) log.cc:844] Serialized 34 byte log entry
0709 13:18:42.097020 (+   263us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.097145 (+   125us) write_op.cc:454] Released schema lock
0709 13:18:42.097217 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:42.097688 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.097726 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":126883,"apply.run_cpu_time_us":10235,"apply.run_wall_time_us":300677,"num_ops":3,"prepare.queue_time_us":158414,"prepare.run_cpu_time_us":31252,"prepare.run_wall_time_us":168544,"raft.queue_time_us":44699,"raft.run_cpu_time_us":6479,"raft.run_wall_time_us":101024,"replication_time_us":393594,"thread_start_us":317448,"threads_started":4,"wal-append.queue_time_us":120870}]]}
I20260709 13:18:42.277179  5743 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.267622  5599 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.278137  5743 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.243844  5541 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:42.278851  5599 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:42.283929  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.293406  5740 log.cc:927] Time spent T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.146s	user 0.002s	sys 0.001s
I20260709 13:18:42.305855  4925 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:42.275593  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:42.303022  5649 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.312253  4112 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:42.295634  5689 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.310829  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:42.313962  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:42.316876  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.323704  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.271571  5739 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:42.325716  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48971.2us
I20260709 13:18:42.327826  4292 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:42.317625  5600 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.333256  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 71311.8us
I20260709 13:18:42.334441  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.318634  5736 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.342551  4219 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:42.325398  4288 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:42.325932  5737 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:42.345304  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:42.328696  5387 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.224607  5738 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.332621  5690 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.365800  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.366623  4293 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
W20260709 13:18:42.373570  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 50279.1us
I20260709 13:18:42.337149  5345 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:42.388924  5743 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:42.389633  4296 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:18:42.394637  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49577.2us
W20260709 13:18:42.395133  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 67363.3us
I20260709 13:18:42.396966  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:42.397873  4218 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:42.356103  5736 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.363023  5690 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.361907  5689 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.367164  5448 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.414199  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:42.402276  5736 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.401391  5743 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:42.407655  5690 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.355585  5600 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.415067  4296 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:42.402050  5719 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:42.422854  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:42.415925  5684 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:42.427799  5737 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:18:42.432920  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 90569.4us
I20260709 13:18:42.400127  5650 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:18:42.514482  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 108859us
I20260709 13:18:42.516616  5691 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:42.501713  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 132049us
I20260709 13:18:42.420471  5743 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:18:42.508276  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 85515.1us
W20260709 13:18:42.510483  5742 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:18:42.510952  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.415302  5448 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.490523  5649 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.567862  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:18:42.572752  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 56299.3us
I20260709 13:18:42.576261  5448 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.577023  5448 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:42.577374  5738 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.569959  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.579787  5752 ts_tablet_manager.cc:933] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:42.559350  5387 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:42.580886  5387 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:42.569875  4294 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:42.582074  5387 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.567145  5719 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.587628  5719 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.590111  5718 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:42.590803  5718 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:42.589982  5570 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:42.593744  5718 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.593909  5737 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.563252  5743 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.607856  5755 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:42.608925  5755 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.611783  5755 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.604887  4045 catalog_manager.cc:5697] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.616565  5755 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:42.617478  5755 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:42.624325  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 114919us
I20260709 13:18:42.602002  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:42.587491  5541 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:42.620021  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 290564us
I20260709 13:18:42.517603  5600 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.630482  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:42.632897  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:42.634697  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:42.635401  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 114853us
I20260709 13:18:42.635491  4219 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:42.639112  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.615477  4045 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:42.642788  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:18:42.643900  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 125657us
I20260709 13:18:42.646313  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:42.647106  4292 raft_consensus.cc:2368] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:42.647207  5755 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.644097  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:42.652213  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.652565  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.652977  4293 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:42.654628  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:42.655217  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:42.658253  5468 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.635104  5649 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.673377  5705 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.674206  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:42.675446  5705 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:42.676029  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:42.648531  5691 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.644770  5364 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.677098  5705 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:42.665273  5599 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.665489  5744 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:42.690543  5599 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.702035  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.727636  4220 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:42.710374  4218 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:42.728734  4219 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:42.714587  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:42.729614  4221 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.715994  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:42.685804  5691 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.738533  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.739354  4219 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:42.740886  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.746069  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:42.741833  4216 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:42.682443  5649 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.761529  4220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:18:42.745021  5691 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.759635  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.730168  5599 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.756518  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:42.766098  4215 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:42.753724  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:42.762203  4220 raft_consensus.cc:606] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:42.767465  4220 raft_consensus.cc:614] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:42.733809  5684 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:42.634964  5735 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:18:42.773411  4186 leader_election.cc:400] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:42.773874  4186 leader_election.cc:403] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:42.758042  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:42.665707  5754 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:18:42.778020  4221 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
W20260709 13:18:42.776211  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 121062us
W20260709 13:18:42.756549  5729 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.002s
I20260709 13:18:42.775794  5738 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.813267  4186 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:42.752038  5757 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:42.814651  5737 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:42.777523  5684 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:42.856542  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 70973.3us
I20260709 13:18:42.833799  5738 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.836131  5705 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.841955  5448 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.840049  5345 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.831379  5729 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.868906  5755 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:42.830482  5752 tablet_copy_client.cc:323] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:18:42.899844  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:42.903995  5649 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.905931  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.906742  4294 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:42.907809  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.908535  4296 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:42.908871  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:42.912885  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.915041  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 74891.5us
I20260709 13:18:42.861474  5738 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.872172  5345 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.850095  5468 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:18:42.917377  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.898805  5541 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.865578  5448 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.921942  4287 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:42.852206  5735 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:18:42.926286  4291 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.929870  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.871433  5705 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.924921  5345 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.921025  5750 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:42.934149  5748 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.317s	user 0.000s	sys 0.002s
I20260709 13:18:42.844561  5757 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.931172  5448 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.980285  5771 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:42.981120  5771 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.981753  5757 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.930967  5541 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:42.983568  5771 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:42.984176  5541 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:42.984587  5746 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:42.988494  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:42.963709  5750 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.998215  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:43.002341  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:43.003746  5750 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:43.016886  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 95125.2us
I20260709 13:18:43.021520  5778 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:43.022428  5778 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.021682  4217 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:43.026268  5778 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.033444  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.038353  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.046247  4291 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:43.056016  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 150646us
I20260709 13:18:43.006078  5771 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:43.057379  5542 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:42.993180  5744 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:43.059876  4288 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:43.105670  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.106397  4293 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:43.106736  4219 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:43.109478  5759 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:43.110028  5759 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:43.111289  5759 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.114102  5541 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:43.116279  5760 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:43.116890  5760 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:43.118305  5760 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.123621  5760 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.125742  5387 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:43.126401  5387 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:43.131163  5387 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:43.133574  5775 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:43.134325  5345 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.135412  5744 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.137279  5766 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.137876  5766 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.085034  5364 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:43.149407  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 147113us
I20260709 13:18:43.150900  4293 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:43.029251  5746 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.158102  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.176271  4221 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:43.158542  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:43.182106  4219 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:43.151501  5600 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:43.186101  5600 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:43.187496  5600 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.189824  5600 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:43.193625  5387 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.194356  5387 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.140293  5766 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:43.184571  5570 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.592s	user 0.015s	sys 0.001s
I20260709 13:18:43.223501  4112 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:43.170023  5684 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.223811  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:43.242741  5387 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:43.205164  4920 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:43.247159  5387 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:43.247738  5387 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.248936  5387 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.222963  5757 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:43.230974  5729 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.230722  5650 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.245715  5345 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.266211  5761 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:43.257745  5736 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.005s
I20260709 13:18:43.238716  5750 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.277551  5650 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.280303  5387 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.260159  5705 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:43.299467  4293 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:43.301970  5387 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:43.323812  5780 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:18:43.326432  5690 consensus_meta.cc:287] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.001s
I20260709 13:18:43.327081  5690 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.329933  5774 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:43.330524  5774 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.330897  5774 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.331149  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:43.332146  4221 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:43.335037  5690 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.286402  5736 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.268975  5757 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.339946  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:43.349710  4221 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:43.346907  5599 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.005s
I20260709 13:18:43.357074  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.358021  4220 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:43.359571  5760 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.360229  5760 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.284803  5761 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.367836  5760 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.337934  5650 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.344131  5649 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:43.338447  5736 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.338249  5750 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.308578  5744 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:18:43.336319  5448 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:43.390553  5743 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.793s	user 0.015s	sys 0.000s
I20260709 13:18:43.391067  5743 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.341434  5738 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.393699  4296 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:43.402060  5738 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.402179  5746 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:43.402871  5691 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.001s
I20260709 13:18:43.403340  5691 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.405649  5691 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:43.405730  5789 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:18:43.407721  5757 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.357486  5599 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.415484  5599 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:43.373056  5761 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.421383  5468 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.422170  5468 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.422938  5732 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:43.423518  5732 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.424120  5795 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:43.424718  5795 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.426033  5448 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:43.426762  5790 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:18:43.427038  5795 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.430110  5782 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:43.430451  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:43.430691  5782 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:43.431128  4141 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.431674  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.432389  4138 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:43.432731  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:43.433328  4144 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.433555  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.434860  5781 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.435369  5781 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.431854  5743 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:43.446095  4138 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:43.447325  5759 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:43.447525  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:43.448213  4293 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.379575  5570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37114 (request call id 5) took 1883 ms. Trace:
I20260709 13:18:43.455250  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.457816  4221 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:43.461885  5468 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.463310  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.463591  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:43.464372  4219 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:43.468726  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.471217  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.472007  4143 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:43.472894  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.473016  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:43.473664  4143 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:18:43.474103  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 250357us
I20260709 13:18:43.473688  4291 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.476187  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:43.481437  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.481841  4141 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:43.482259  4143 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:43.484239  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.485157  4288 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:43.490258  4215 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:43.494300  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.497427  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.499328  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.499946  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.500049  4288 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:43.500700  4214 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:43.503736  4291 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:43.498639  4112 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:43.498392  4215 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:43.497670  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.502660  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:43.506002  4219 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.506604  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:43.507824  4215 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:43.509586  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.510673  4291 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:43.511368  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:43.521802  4147 raft_consensus.cc:2368] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:43.522145  4217 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:43.523757  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:43.524935  4216 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:43.489655  5599 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:43.526651  5733 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.527662  5781 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.537931  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:43.531587  4144 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:43.532538  5755 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:43.545339  4219 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:43.503010  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.549057  4292 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:43.552055  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.552948  4144 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:43.487273  5743 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:18:43.551367  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:43.556751  5771 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:43.557287  4138 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:43.505101  5776 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:18:43.558492  5732 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.562101  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:43.562312  4215 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:43.563395  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:43.565378  4291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:43.565953  4291 raft_consensus.cc:606] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:18:43.566263  4291 raft_consensus.cc:614] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:43.562572  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:43.572929  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.582758  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.573967  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.595261  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:43.595777  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.596439  4143 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:43.571674  4293 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:43.603123  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:43.557281  5771 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.601287  5755 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:43.561108  5599 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:43.612715  4147 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:43.620743  5387 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:43.614789  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.615379  4187 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:43.593211  5761 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:43.621840  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 59882.9us
I20260709 13:18:43.618427  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.623742  5797 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:43.624764  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.624830  5808 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:43.624737  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:43.631712  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.632882  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:43.634008  5755 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.635987  5773 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:43.603267  5650 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:43.560638  5364 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
W20260709 13:18:43.636991  5788 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:43.608379  5705 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:43.552186  5733 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:43.612929  5776 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:43.647640  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.681767  4145 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:43.612540  5771 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.648555  4187 leader_election.cc:400] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
W20260709 13:18:43.695626  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49420.1us
I20260709 13:18:43.636650  5760 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.654587  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.637097  5345 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:43.651316  5650 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.637109  5599 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:43.672848  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48240.7us
I20260709 13:18:43.674820  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:43.671183  5779 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:43.630079  5761 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:18:43.690160  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.679682  5743 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:43.713096  4291 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:43.676101  5705 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.714771  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:43.714910  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:43.678434  5757 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.672358  5746 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:43.654779  5782 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:43.722592  4292 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:43.722522  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.738078  4145 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:43.729094  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.739419  4140 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:43.701092  5345 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:43.714155  5650 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.710649  5776 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:43.742832  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:43.746573  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.749434  4295 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:43.716506  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:43.728915  5705 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.755519  4141 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:43.756834  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:43.771243  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.777194  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.777638  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:43.660607  5773 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:43.778270  4145 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:43.778503  4140 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:43.708117  5760 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.749933  5345 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:43.789835  4144 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:43.728984  5774 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.721179  5779 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:43.737612  5757 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.485811  5570 rpcz_store.cc:276] 0709 13:18:41.472902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.473241 (+   339us) service_pool.cc:224] Handling call
0709 13:18:41.550694 (+ 77453us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b4c001984c0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3cfaea20 00007fee3cfbfa29 00007fee3cf85644 00007fee3cfacf2d 00007fee3cfacb93 00007fee3ec3b1af 00007fee3ec3af3e 00007fee3ecc0888 00007fee3ecdd75c 00007fee3ecde76a 00007fee3ecdd91b
0709 13:18:41.565817 (+ 15123us) log.cc:844] Serialized 499 byte log entry
0709 13:18:43.354183 (+1788366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2568,"raft.queue_time_us":5735,"raft.run_cpu_time_us":1997,"raft.run_wall_time_us":3188,"spinlock_wait_cycles":121982720,"thread_start_us":71506,"threads_started":1,"wal-append.queue_time_us":72315,"wal-append.run_cpu_time_us":2035,"wal-append.run_wall_time_us":1006319}
I20260709 13:18:43.754905  5809 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:43.801677  5776 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:43.805912  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49174.8us
I20260709 13:18:43.782420  5691 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:43.806088  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:43.855286  4291 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:43.820638  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.824865  4214 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:43.745090  5746 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:43.861675  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:43.869801  4141 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.874863  4147 raft_consensus.cc:2368] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:43.817768  5808 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:43.872180  5803 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.173s	user 0.000s	sys 0.002s
I20260709 13:18:43.915452  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:43.915755  4290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:43.918691  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.912621  5773 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:43.916366  4290 raft_consensus.cc:606] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:43.866402  5733 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:43.930641  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:43.913146  5760 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.924791  4141 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:18:43.934897  5806 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:18:43.893747  5782 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:43.926543  5785 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:43.927788  4216 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:43.929395  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.934952  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:43.925226  5766 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:43.946369  5387 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:43.810509  5761 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.957473  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:43.959283  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.914978  5691 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:43.959532  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:18:43.971800  5810 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.230s	user 0.005s	sys 0.000s
I20260709 13:18:43.973279  4110 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:43.976861  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet a35e1cee8a15436dbfaf75dd67824aad from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:18:43.977064  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:43.979066  5762 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:43.979202  5796 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:43.979867  5796 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.980329  5796 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.980579  5762 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:43.983935  5774 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:43.988688  5448 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:44.001691  4295 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:43.989853  5746 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:43.988794  4186 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:44.004776  5541 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:43.991706  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:43.946799  5782 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:43.978827  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:44.007817  5782 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:43.949625  5785 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:43.968750  5761 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.017573  5796 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.024268  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:44.025187  4294 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:44.026741  5779 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:44.028928  5757 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:44.030246  5796 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:44.032943  5822 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 13:18:44.034710  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:43.947417  5387 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.039830  5448 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:44.066712  5448 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:43.977696  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet a35e1cee8a15436dbfaf75dd67824aad from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-a35e1cee8a15436dbfaf75dd67824aad
I20260709 13:18:44.043490  5541 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:44.012166  5785 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:44.044631  5816 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
W20260709 13:18:44.046401  5821 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:18:44.039724  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 61020us
I20260709 13:18:44.047406  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:44.073941  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.052461  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:18:44.054121  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.058450  4139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:18:44.065459  5345 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.081490  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:44.083738  5570 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:44.087487  5820 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:18:44.088524  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:44.077973  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.067754  5448 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.095650  5541 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.096736  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:44.098222  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:44.099601  5650 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.131412  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:44.126924  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:44.130692  4295 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:44.132771  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.129949  5785 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.135622  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:44.144385  4218 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:44.144145  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:44.149199  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:44.150444  5760 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:44.150943  5760 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.151377  5760 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.174788  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:44.115026  4139 raft_consensus.cc:606] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:18:44.177376  4221 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.180084  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:44.166139  5732 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.144555  5808 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:44.195044  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.180657  5755 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.207108  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.189412  5785 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.215680  4156 tablet_copy_source_session.cc:215] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:44.222962  5345 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:44.223775  5782 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.234628  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:44.238834  4221 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:44.212378  5570 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.183213  5771 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.254781  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:44.262614  5650 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:44.266680  5705 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.271674  4112 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:44.280473  4287 raft_consensus.cc:2368] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
I20260709 13:18:44.274276  5570 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.275765  5750 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:44.222807  5808 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.326220  4289 raft_consensus.cc:2368] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
W20260709 13:18:44.310979  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 63070us
I20260709 13:18:44.313117  5796 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:44.332053  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.366467  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.373047  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.320225  5760 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:44.380425  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 209660us
I20260709 13:18:44.382802  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:44.384330  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:44.385129  4140 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:44.386022  5795 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.386147  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:44.386891  4145 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:44.387130  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:44.389765  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:44.390445  4147 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.398104  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:44.399791  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:44.401149  4145 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:44.402519  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:44.408061  5750 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:44.408715  5750 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.410306  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:44.412668  4142 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:44.417735  4093 auto_rebalancer.cc:629] Failed to schedule move for tablet 78c7d9fa8715457fb7cd31f0ea47ae92: Illegal state: Replica 6f753b799f924bacb0a0f0f6e0068ee9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:44.366430  5796 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:44.427330  5796 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.427075  4139 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:44.379174  5732 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.371702  5570 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:44.382797  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:44.433449  4146 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
W20260709 13:18:44.436172  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.437692  4218 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.441493  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:44.442348  4146 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.444537  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.470949  4147 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:44.470263  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:44.484390  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:44.472086  4292 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.474162  4045 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 157) took 3173 ms. Trace:
I20260709 13:18:44.487222  4294 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.447427  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.480906  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:44.482504  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:44.447327  5599 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:44.557868  5599 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.560240  5599 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:44.465745  5776 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:44.560981  5776 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:44.561443  5776 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.561533  5345 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.485529  4045 rpcz_store.cc:276] 0709 13:18:41.297498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.297749 (+   251us) service_pool.cc:224] Handling call
0709 13:18:41.428067 (+130318us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:44.470612 (+3042545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:42.841095 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:42.989643 (+148548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:42.996104 (+  6461us) write_op.cc:435] Acquired schema lock
0709 13:18:43.002346 (+  6242us) tablet.cc:662] Decoding operations
0709 13:18:43.066892 (+ 64546us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:43.066962 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:43.066991 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:43.067373 (+   382us) tablet.cc:701] Row locks acquired
0709 13:18:43.067392 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:43.067547 (+   155us) write_op.cc:270] Start()
0709 13:18:43.067678 (+   131us) write_op.cc:276] Timestamp: P: 1783603123067504 usec, L: 0
0709 13:18:43.067700 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:43.140615 (+ 72915us) log.cc:844] Serialized 922 byte log entry
0709 13:18:43.637662 (+497047us) op_driver.cc:464] REPLICATION: finished
0709 13:18:43.959706 (+322044us) write_op.cc:301] APPLY: starting
0709 13:18:43.969099 (+  9393us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:43.994568 (+ 25469us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:44.000129 (+  5561us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:44.000656 (+   527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:44.000877 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:44.000930 (+    53us) write_op.cc:312] APPLY: finished
0709 13:18:44.001220 (+   290us) log.cc:844] Serialized 28 byte log entry
0709 13:18:44.001430 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:44.001541 (+   111us) write_op.cc:454] Released schema lock
0709 13:18:44.001589 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:44.002022 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:44.002055 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":260722048,"child_traces":[["op",{"apply.queue_time_us":299232,"apply.run_cpu_time_us":2651,"apply.run_wall_time_us":49224,"num_ops":2,"prepare.queue_time_us":172562,"prepare.run_cpu_time_us":19248,"prepare.run_wall_time_us":394191,"raft.queue_time_us":211478,"raft.run_cpu_time_us":66686,"raft.run_wall_time_us":289062,"replication_time_us":569786,"thread_start_us":549211,"threads_started":4,"wal-append.queue_time_us":138709}]]}
W20260709 13:18:44.563696  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 116388us
I20260709 13:18:44.565613  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.565876  5792 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.566514  5705 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:44.566715  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 73876.2us
W20260709 13:18:44.567098  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 96973.5us
I20260709 13:18:44.567812  5738 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.568290  5738 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:44.568758  5738 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.569695  4187 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.485111  4291 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.488336  4138 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:44.470842  5541 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:44.596495  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:44.604415  4143 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.599243  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:44.601121  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.608594  4111 leader_election.cc:400] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
I20260709 13:18:44.608964  4111 leader_election.cc:403] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.477546  5759 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:18:44.613173  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:44.613947  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:44.621368  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 51331.2us
I20260709 13:18:44.590355  5771 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:44.610162  5774 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.622869  4187 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.634608  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:44.634295  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:44.638926  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:44.639358  4291 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:44.617918  5755 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.605662  5761 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:44.649231  4187 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:44.643687  5833 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:18:44.649631  4041 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.654793  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:44.641969  5649 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:44.638145  5783 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.657948  4041 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:44.661931  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:44.664811  4041 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.712137  4143 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:44.737143  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:44.739351  4291 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:44.657622  5836 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.085s	user 0.000s	sys 0.005s
I20260709 13:18:44.740079  4041 catalog_manager.cc:5697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:18:44.742045  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81767.5us
W20260709 13:18:44.738281  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 89144us
W20260709 13:18:44.735774  5841 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:18:44.712236  5752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35e1cee8a15436dbfaf75dd67824aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:44.657279  5649 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:18:44.710664  5831 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:18:44.712080  5782 raft_consensus.cc:993] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:44.689062  5760 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:44.745684  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:44.652654  5835 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.783286  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:44.667806  5783 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.660828  5826 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.787015  5705 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.773075  5649 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:44.790640  5829 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.367s	user 0.001s	sys 0.001s
I20260709 13:18:44.790527  5750 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.746320  5815 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.656680  5364 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
W20260709 13:18:44.749281  5824 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.524s	user 0.007s	sys 0.002s
W20260709 13:18:44.751703  5838 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:18:44.752967  5840 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:18:44.740640  5797 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.756242  5834 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.276s	user 0.000s	sys 0.002s
I20260709 13:18:44.757441  5755 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
I20260709 13:18:44.665572  5541 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:44.748536  4041 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:44.741694  5839 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
I20260709 13:18:44.787384  5691 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:44.746285  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.786286  5387 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:18:44.797282  4295 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:44.798815  5773 raft_consensus.cc:1081] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:44.809082  4222 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:44.814483  4041 catalog_manager.cc:5697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:44.779524  4291 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
W20260709 13:18:44.822798  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 76605.9us
I20260709 13:18:44.827201  4187 leader_election.cc:400] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:44.827839  4187 leader_election.cc:403] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.792663  5835 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.823310  5541 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:44.834244  5761 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.850594  4143 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:44.837847  5542 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.814437  5797 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.858896  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:44.861747  4219 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:44.864899  4215 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:44.851734  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 62652.7us
I20260709 13:18:44.867710  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:44.871157  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1299) took 1256 ms. Trace:
I20260709 13:18:44.871628  4293 rpcz_store.cc:276] 0709 13:18:43.604049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.604243 (+   194us) service_pool.cc:224] Handling call
0709 13:18:43.604758 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.804278 (+199520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.804313 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.804877 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.110194 (+305317us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:44.110251 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.110353 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.748561 (+638208us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:44.851419 (+102858us) raft_consensus.cc:1685] finished
0709 13:18:44.851442 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.860172 (+  8730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16390,"raft.queue_time_us":26715,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"spinlock_wait_cycles":28895616,"thread_start_us":370551,"threads_started":2,"wal-append.queue_time_us":327448}
W20260709 13:18:44.875156  4213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.029s	sys 0.066s
W20260709 13:18:44.875547  4213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.029s	sys 0.066s
I20260709 13:18:44.876209  5345 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:44.878397  5345 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:44.878944  5345 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.880843  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:44.881692  4216 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.881906  5705 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.882081  5797 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:44.882378  5705 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:44.883571  5783 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:44.885591  5835 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:44.886463  5691 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:44.894621  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.895598  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:44.897595  4110 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a767a88581024d12b14e9f965193d404. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:44.902752  5750 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:44.902973  5776 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.899673  5737 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.851030  5761 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:44.905776  5783 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:44.906510  5761 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.903853  5541 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.912633  5795 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.914119  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:44.915004  5570 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.921275  5771 raft_consensus.cc:993] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:18:44.921869  5771 raft_consensus.cc:1081] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:18:44.914556  5705 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.925418  5705 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.915164  5737 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.931464  5737 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:44.919255  5828 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.637s	user 0.002s	sys 0.000s
I20260709 13:18:44.932269  5649 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.933458  4143 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.935293  4139 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:44.935772  4215 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:44.938295  5776 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:44.939627  5761 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.940146  5570 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:44.949199  4222 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:44.953293  4219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44160
I20260709 13:18:44.957341  4219 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:44.957978  4219 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:44.962958  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:44.964130  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:44.964269  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:44.964872  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50864us
I20260709 13:18:44.965227  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:44.965916  4295 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.966104  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:44.966218  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:44.963802  4294 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:44.950917  5732 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:44.981489  5738 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:44.874442  5852 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:18:44.993743  4222 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:44.994817  4295 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:44.993284  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:45.000326  4146 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:45.005007  4214 raft_consensus.cc:2410] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.006198  4219 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.010540  4219 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.011325  4213 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:45.014626  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48785.4us
I20260709 13:18:45.016732  4111 leader_election.cc:400] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
I20260709 13:18:45.017184  4111 leader_election.cc:403] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.995411  5649 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.029397  4219 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:45.030061  4219 pending_rounds.cc:85] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 1
I20260709 13:18:45.030370  4219 pending_rounds.cc:107] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:45.030690  4219 raft_consensus.cc:2889] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.001118  5738 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:44.998111  5650 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:18:45.033946  5387 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:45.039616  5387 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:45.040280  5387 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:45.010901  5759 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.971590  5570 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.014731  5760 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:45.005934  5776 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:45.050403  5387 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.054147  5387 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.043558  5759 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:45.039599  5600 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3.
I20260709 13:18:45.012843  5448 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:18:45.039755  5785 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:45.055477  5760 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:45.103263  4215 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.103498  4220 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:45.119230  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.565s (SENT) [suppressed 26 similar messages]
I20260709 13:18:45.054718  5776 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.057132  5781 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:18:45.087214  5782 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:45.166209  5732 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:45.170085  5854 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:18:45.158222  5759 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.159878  5815 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:45.172410  5759 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.172861  5815 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.173862  5782 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.175640  5815 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:45.157485  5755 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.176644  5755 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.177428  5570 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:45.149858  5823 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:45.194293  4216 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
W20260709 13:18:45.199019  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 79851.7us
I20260709 13:18:45.093850  5785 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.208966  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.176157  5782 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.216374  5387 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:45.217047  5387 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:45.224284  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 200283us
I20260709 13:18:45.225301  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:45.182632  5345 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.228878  5387 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:45.226276  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 190961us
I20260709 13:18:45.193570  5852 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:45.231468  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.234683  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:45.236147  4215 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:45.237949  5755 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.233944  5738 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:45.240314  5738 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.240731  5738 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:45.242139  5856 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:18:45.229001  5542 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:18:45.243547  5762 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:45.244005  5762 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:45.244604  4221 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.245474  5762 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.247046  5762 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.235909  5852 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.253198  5761 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.234442  5760 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.255019  5776 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.256951  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.255991  5756 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:45.236083  5859 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:18:45.264845  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.267611  4187 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:45.244310  5783 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:45.251380  5852 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:45.275630  4295 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.272123  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:45.273136  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:45.278807  5387 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.279575  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:45.284091  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:45.284914  4291 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:45.290205  5387 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:45.291313  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.291097  5387 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:45.271284  5705 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.298873  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:45.270865  5756 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:45.274482  5783 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:45.310709  5387 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:45.283383  5542 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.314731  4294 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.289857  5852 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:45.316792  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:45.310065  5846 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:45.317075  5650 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:18:45.320411  5866 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:45.331837  4288 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:45.318758  5797 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.336968  5570 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.337675  5570 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.340301  5570 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.321784  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:45.323513  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:45.328962  5345 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:45.354460  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 62966us
I20260709 13:18:45.356438  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.356961  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.357187  4146 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:45.358441  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.359982  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:45.360924  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:45.361557  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:45.362983  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:45.363426  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.363926  4141 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:45.364868  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.365149  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:45.366026  4145 raft_consensus.cc:2410] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.367125  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.364326  4141 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:45.359124  4146 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:45.361581  4288 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.369726  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.371932  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.372751  4213 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:45.373159  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.372061  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.309022  5705 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.379840  4147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52146
I20260709 13:18:45.383792  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:45.385102  4213 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:45.378505  4141 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.386339  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:45.386394  4141 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.380550  4143 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:45.381502  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:45.384238  4147 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:45.393639  4147 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.399776  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:45.400988  4292 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:45.405381  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.405606  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:45.408166  5756 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.415722  5705 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:45.416198  4289 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:45.421361  4147 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.424098  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:45.410772  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:45.402925  5838 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:18:45.320664  5852 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:45.420044  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:45.434021  5852 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:45.378090  5796 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:45.452193  4141 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:45.455282  4144 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:45.462723  4147 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.416854  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:45.472402  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:45.473131  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.417071  5599 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:45.437845  5783 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.466202  5750 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:45.475699  5705 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:45.476099  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:45.502839  4218 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.476711  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:45.479058  5852 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:45.478874  5738 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.479950  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:18:45.523857  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 43961.9us
I20260709 13:18:45.499257  5870 ts_tablet_manager.cc:933] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:45.501554  5599 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:45.455745  5785 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.525134  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:45.457142  5868 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:18:45.417429  5811 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:18:45.531493  5846 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:45.520226  5345 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.548563  4288 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:45.518749  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42922 (request call id 213) took 3187 ms. Trace:
I20260709 13:18:45.515332  5750 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:45.565734  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:18:45.570541  5874 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:18:45.571770  5846 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.536166  5819 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:45.464205  5796 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.552922  5808 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:45.575168  5345 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:45.599952  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 66193us
I20260709 13:18:45.613611  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:45.584218  5819 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.616760  5819 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.618062  5877 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:18:45.619261  5759 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:45.619715  5867 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260709 13:18:45.592388  5761 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:45.633395  4288 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:45.621119  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:45.622148  5796 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.578084  5718 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:45.654376  5796 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:45.653051  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:45.668144  5750 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.664583  4140 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:45.613381  5345 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.680574  5759 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.681181  5759 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:45.682127  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 151821us
W20260709 13:18:45.669888  5874 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:45.627733  5599 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.663234  5761 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:45.686511  5759 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.700645  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:45.701609  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:45.705744  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.713335  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:45.717186  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.723392  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.723695  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:45.724979  4141 raft_consensus.cc:2410] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.725387  4219 raft_consensus.cc:2368] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5.
I20260709 13:18:45.729396  4219 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:45.712213  5877 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:45.737267  5879 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:45.743510  4147 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:45.573743  5752 rpcz_store.cc:276] 0709 13:18:42.313270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.313557 (+   287us) service_pool.cc:224] Handling call
0709 13:18:42.580483 (+266926us) ts_tablet_manager.cc:934] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
0709 13:18:43.144476 (+563993us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b4c000bd540. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3cfaea20 00007fee3cfbfa29 00007fee3cfc013f 00007fee3cf842ab 00007fee3cfb1f3c 00007fee3cfb2461 00007fee3cfb2768 00007fee42d382eb 00007fee43c5dd3b 00007fee43c58008 00007fee43c57405
0709 13:18:44.597858 (+1453382us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:45.330542 (+732684us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:45.330687 (+   145us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:45.495116 (+164429us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:45.495647 (+   531us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:45.496131 (+   484us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:45.496307 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":62266,"spinlock_wait_cycles":16652672,"tablet-copy.queue_time_us":76852,"thread_start_us":190636,"threads_started":2}
I20260709 13:18:45.741833  4218 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:45.757091  4217 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:45.750885  4112 leader_election.cc:400] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5.
I20260709 13:18:45.730950  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.759357  4112 leader_election.cc:403] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:45.767236  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:45.768096  5752 tablet_copy_client.cc:806] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:45.765823  5732 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.776093  5879 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:45.801398  5752 tablet_copy_client.cc:670] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:45.813613  5782 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:45.833247  5782 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:45.834622  5782 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.756853  5877 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:45.859174  5877 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:45.871327  5345 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.876315  4213 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:45.880800  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:45.773501  5761 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.896507  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:45.896651  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:45.904208  4292 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:45.904592  4292 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:45.905424  4292 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:45.906728  4292 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.907532  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:45.913470  4288 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:45.915498  5738 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.928711  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:45.933933  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:45.901223  5345 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:45.947501  4292 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:45.948482  4293 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:45.958127  5650 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:45.975685  5882 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:45.987906  5797 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:46.003495  5783 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.024479  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:46.025974  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.037842  4893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.030s	sys 0.036s
W20260709 13:18:46.038369  4893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.030s	sys 0.036s
I20260709 13:18:46.038228  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:46.048871  4892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.018s	sys 0.047s
W20260709 13:18:46.049681  4892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.018s	sys 0.047s
W20260709 13:18:46.050143  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 560987us
I20260709 13:18:46.061576  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:46.064105  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:46.064966  4293 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.075037  4187 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:46.076507  5345 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.033746  5882 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.080717  5738 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.115805  5882 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:46.031306  5797 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:46.135478  4293 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:46.145924  5881 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:46.146790  5881 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.081323  5866 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.056926  5835 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:46.149748  5881 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:46.178619  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:46.181461  5345 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:46.182046  5345 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:46.182947  5345 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.177930  5835 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:46.175455  5866 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.219130  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:46.211882  5760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.023s	sys 0.049s
W20260709 13:18:46.221884  4261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.019s	sys 0.032s
I20260709 13:18:46.224452  4187 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:46.227828  4261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.020s	sys 0.032s
W20260709 13:18:46.230441  4260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.021s	sys 0.032s
W20260709 13:18:46.231428  4260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.021s	sys 0.032s
W20260709 13:18:46.225952  5760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.023s	sys 0.050s
W20260709 13:18:46.275174  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.282339  4222 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:46.288038  4146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.014s	sys 0.019s
I20260709 13:18:46.308209  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:46.308537  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:46.309614  4295 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:18:46.293180  4146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.015s	sys 0.019s
W20260709 13:18:46.315699  4112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.029s	sys 0.033s
W20260709 13:18:46.316098  4112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.029s	sys 0.033s
I20260709 13:18:46.316404  4215 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:46.228935  5870 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.013s	sys 0.040s
I20260709 13:18:46.229213  5541 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:46.316411  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 533703us
I20260709 13:18:46.230643  5732 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5.
I20260709 13:18:46.229514  5776 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.325253  5387 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:46.329785  5387 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:46.330231  5387 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:46.338340  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:46.322712  5870 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.013s	sys 0.041s
I20260709 13:18:46.344985  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:46.345661  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.315259  5846 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:46.347754  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:46.348242  5387 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.349449  5387 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.349889  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:46.352886  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 173237us
I20260709 13:18:46.357426  4142 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:46.325419  5887 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:46.355648  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:46.367312  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:46.347800  5819 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.006s
I20260709 13:18:46.372594  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:46.375351  4147 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:46.362960  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:46.376655  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:46.341604  5541 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:46.343045  5860 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:46.356915  5826 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.294118  5835 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.342741  5705 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:18:46.463399  5448 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.378901  5718 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:46.458019  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 279486us
W20260709 13:18:46.535159  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.357370  5815 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
W20260709 13:18:46.462163  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 100518us
W20260709 13:18:46.549387  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 81667.6us
I20260709 13:18:46.361224  5846 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:46.550292  5782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.002s	sys 0.007s
I20260709 13:18:46.402616  5795 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:46.458135  5870 tablet_copy_client.cc:323] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:18:46.399598  5819 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.366070  5887 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.719197  5887 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:46.722119  5902 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
W20260709 13:18:46.654655  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 91313.1us
I20260709 13:18:46.462997  5862 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:46.725003  5862 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.727473  5862 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:46.727905  5759 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.005s	user 0.013s	sys 0.000s
I20260709 13:18:46.536105  5599 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.641805  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 82716us
I20260709 13:18:46.728888  5599 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:46.663343  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 107056us
W20260709 13:18:46.653797  5782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.003s	sys 0.008s
I20260709 13:18:46.728785  5541 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.742827  5819 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:46.747877  5846 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:46.735836  5448 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:18:46.739391  5892 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:18:46.660755  5796 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:46.740185  5599 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:46.758294  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:46.461030  5860 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:46.770043  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 114848us
I20260709 13:18:46.775991  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1226) took 1074 ms. Trace:
I20260709 13:18:46.719960  5887 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:46.711503  5826 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:46.790117  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:46.732920  5705 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.800009  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:18:46.801261  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 245724us
W20260709 13:18:46.772640  5900 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
I20260709 13:18:46.776757  4146 rpcz_store.cc:276] 0709 13:18:45.701547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.702804 (+  1257us) service_pool.cc:224] Handling call
0709 13:18:45.703119 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.713010 (+  9891us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:45.720246 (+  7236us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.975164 (+254918us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b180008e600. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf5522 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:18:46.312726 (+337562us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.313680 (+   954us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.313910 (+   230us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:46.658647 (+344737us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.716889 (+ 58242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.716985 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.775334 (+ 58349us) raft_consensus.cc:1685] finished
0709 13:18:46.775456 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.775816 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21344,"prepare.queue_time_us":8766,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":1836,"raft.queue_time_us":86381,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":7807,"spinlock_wait_cycles":8157056,"thread_start_us":936181,"threads_started":2,"wal-append.queue_time_us":940010}
I20260709 13:18:46.751206  5759 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.813922  5759 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:46.780396  5815 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.814625  4145 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:46.815552  5897 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:18:46.817792  5649 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:46.817972  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1331) took 1452 ms. Trace:
I20260709 13:18:46.818452  5649 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:46.804214  5819 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.822530  5860 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:46.822295  5705 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.824440  5387 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:46.753341  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 190238us
I20260709 13:18:46.826398  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:46.814180  5896 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.348s	user 0.002s	sys 0.000s
I20260709 13:18:46.733978  5795 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.832453  5387 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.838443  5795 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:46.794981  5826 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:46.832610  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:46.818459  4145 rpcz_store.cc:276] 0709 13:18:45.365877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.383459 (+ 17582us) service_pool.cc:224] Handling call
0709 13:18:45.882258 (+498799us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b5800001298. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbdeee 0000000000375939 00007fee43c311e0 00007fee43cfa0c4 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:18:45.882553 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.815160 (+932607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.817671 (+  2511us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540044aa54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:46.817898 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151171584}
I20260709 13:18:46.838732  5797 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.842031  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1342) took 1138 ms. Trace:
I20260709 13:18:46.827346  5866 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:46.771651  5796 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:46.862449  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.862838  5387 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:46.864907  5876 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:46.872390  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37114 (request call id 6) took 2436 ms. Trace:
I20260709 13:18:46.877962  5448 rpcz_store.cc:276] 0709 13:18:44.423793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.424151 (+   358us) service_pool.cc:224] Handling call
0709 13:18:44.433065 (+  8914us) log.cc:844] Serialized 499 byte log entry
0709 13:18:45.178557 (+745492us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b54000bfa20. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec62b26 00007fee3ec5c49a 00007fee3ec5b714 00007fee3ec3beaa 00007fee3ec42d53 00007fee3ec42cd9 00007fee3ec42c69 00007fee3ec42c31 00007fee3ec41dfd 000000000038f354
0709 13:18:46.859823 (+1681266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20634,"raft.queue_time_us":28763,"raft.run_cpu_time_us":11510,"raft.run_wall_time_us":497569,"spinlock_wait_cycles":16204672,"thread_start_us":307610,"threads_started":1,"wal-append.queue_time_us":375491,"wal-append.run_cpu_time_us":2443,"wal-append.run_wall_time_us":1067257}
I20260709 13:18:46.874495  5387 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.871505  5705 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:46.856788  5718 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:46.889189  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 163770us
I20260709 13:18:46.890997  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:46.888276  5649 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:46.843554  5826 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.893381  5920 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.849694  4139 rpcz_store.cc:276] 0709 13:18:45.704259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.770131 (+ 65872us) service_pool.cc:224] Handling call
0709 13:18:45.770609 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.783424 (+ 12815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.801825 (+ 18401us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.808607 (+  6782us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.312869 (+504262us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:46.313148 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.313580 (+   432us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.841683 (+528103us) raft_consensus.cc:1685] finished
0709 13:18:46.841725 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.841890 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3178,"raft.queue_time_us":6564,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":20632,"thread_start_us":464169,"threads_started":1,"wal-append.queue_time_us":1022178}
I20260709 13:18:46.893721  5826 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.894918  4112 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:46.898036  5387 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:46.898799  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:46.904135  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:46.905828  5705 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.906652  5705 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.890091  5797 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.913600  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:46.914752  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1228) took 1212 ms. Trace:
W20260709 13:18:46.921763  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.942052  4289 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.941871  4144 rpcz_store.cc:276] 0709 13:18:45.702011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.754330 (+ 52319us) service_pool.cc:224] Handling call
0709 13:18:45.754767 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.755279 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:18:45.755312 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.755853 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.196686 (+440833us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:46.196750 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.196853 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.813472 (+616619us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:46.910467 (+ 96995us) raft_consensus.cc:1685] finished
0709 13:18:46.910492 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.914682 (+  4190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"spinlock_wait_cycles":15005056,"thread_start_us":387006,"threads_started":1,"wal-append.queue_time_us":571213}
I20260709 13:18:46.943537  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:46.917333  4145 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.901297  5732 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.883072  5876 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.945245  5705 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:46.912874  5783 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.875s	user 0.015s	sys 0.000s
I20260709 13:18:46.917095  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:46.939364  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:46.940573  4295 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:46.939616  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:46.940874  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:46.943532  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:46.952064  4142 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.952203  4288 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:46.945778  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:46.946288  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:46.909008  5920 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:46.917614  5649 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.949267  5752 tablet_copy_client.cc:538] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:46.968171  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:46.949795  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:46.950326  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:46.978458  4218 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:46.946579  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:46.948064  4145 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:46.961755  4217 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:46.959776  4219 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:46.965027  4293 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:46.912613  5785 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.974861  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:46.951013  5893 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:46.990957  4214 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:46.996140  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:47.004693  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:46.985589  5599 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.968259  5920 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:46.973147  5649 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.022573  4142 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
W20260709 13:18:47.038321  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81841us
I20260709 13:18:47.014144  5785 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:46.997368  5893 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.014834  5783 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:18:47.058277  5941 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.041571  5922 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.019351  5599 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.041117  5876 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.050752  5785 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:47.069432  5889 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.094453  5913 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:18:47.099797  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.100648  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:47.102259  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:18:47.126330  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 110015us
I20260709 13:18:47.128273  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.094904  5876 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.119388  4289 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:47.133432  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.146654  4112 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.137252  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:47.119383  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:47.150583  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:47.158025  4289 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:47.106781  5705 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:47.118615  5785 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:47.143227  5781 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.090508  5922 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.140024  5920 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.125340  5570 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.142501  5893 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:47.139674  5940 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.179486  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.163462  5936 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.175285  5705 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:47.193388  5732 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:47.178843  5785 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.198299  5570 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.095535  5941 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.108196  5889 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.164649  5876 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:47.166379  5910 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:18:47.178196  5541 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:18:47.205438  5940 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.218753  5649 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:47.349157  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 187023us
I20260709 13:18:47.334499  5752 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Bootstrap starting.
W20260709 13:18:47.332557  5944 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:18:47.217844  4138 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:47.287781  5864 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.333951  5876 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:47.243880  5796 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.335170  5941 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.332291  5570 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.215271  5860 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.361431  5851 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.362380  5889 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:47.224283  5922 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.367141  4291 raft_consensus.cc:2410] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:47.368425  5600 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:47.367813  5864 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.240710  5785 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.358408  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:47.223132  5705 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.257593  5936 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.401471  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:47.386606  5851 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.381799  5941 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.387351  5797 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.415715  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 204788us
W20260709 13:18:47.415719  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 250828us
I20260709 13:18:47.418260  5888 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:47.422863  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:47.420310  5795 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.418576  5864 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.449076  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.449878  4217 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:47.451534  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.451978  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.452212  4218 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:47.453402  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.454027  4294 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:47.402056  5600 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:47.395545  5860 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.455245  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.442847  5541 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:47.456763  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.457762  4215 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:47.459429  5946 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.461357  5940 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.461174  5946 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.446094  5783 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:47.454924  5732 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.421576  5797 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.468664  5946 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.468945  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.470141  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:47.473119  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.448323  5910 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:18:47.424634  5941 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:47.481436  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58732.7us
I20260709 13:18:47.431176  5936 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.446733  5888 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:47.512136  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.515060  5650 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.515591  5893 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.515748  5650 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.516459  5893 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.517031  5860 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.517661  5941 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.518218  5650 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.518560  5893 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:47.518112  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.477226  5732 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.518966  5600 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:47.520623  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:47.522109  5797 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:47.523656  5600 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.520812  5785 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.526860  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.526916  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.524152  5600 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.475440  5783 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.529991  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.520748  5732 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.544597  4215 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:47.540629  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.549994  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.552608  5936 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.552637  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:47.554073  5851 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.509712  5947 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.556023  5947 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.556524  5947 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.550750  4289 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:47.544538  5600 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.559995  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.566423  4293 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:47.565183  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.568539  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:18:47.569818  5773 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:47.570218  5773 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:47.570636  5773 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.573387  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.583212  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.584437  4219 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:47.586143  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.592314  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.570395  5888 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:47.593115  4293 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:47.593411  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:47.595727  5783 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:47.596897  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.597158  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.597612  4289 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:47.573681  5797 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.603088  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:47.606267  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet a767a88581024d12b14e9f965193d404 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:18:47.608457  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet a767a88581024d12b14e9f965193d404 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-a767a88581024d12b14e9f965193d404
W20260709 13:18:47.610767  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 272888us
I20260709 13:18:47.610313  4112 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:47.614921  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:47.615324  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:47.616308  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:47.617681  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:47.618269  4143 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:47.615549  4147 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:47.621676  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.628916  5448 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.585059  5947 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.629534  5448 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.630035  5448 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.631968  5947 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:47.649634  5908 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.806s	user 0.004s	sys 0.003s
I20260709 13:18:47.656752  5933 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.607604  5797 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.657696  5933 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:47.665010  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:47.668780  4215 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:47.654542  5771 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.674306  4156 tablet_copy_source_session.cc:215] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:47.677970  4294 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:47.674052  5771 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.681638  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.686218  5933 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.692441  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1356) took 1768 ms. Trace:
I20260709 13:18:47.696872  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.697341  5448 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.692910  4290 rpcz_store.cc:276] 0709 13:18:45.923749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.923857 (+   108us) service_pool.cc:224] Handling call
0709 13:18:45.924359 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.924798 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.924836 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.954631 (+ 29795us) log.cc:844] Serialized 499 byte log entry
0709 13:18:46.458785 (+504154us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:46.458855 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.458972 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.644901 (+1185929us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:18:47.692116 (+ 47215us) raft_consensus.cc:1685] finished
0709 13:18:47.692140 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.692375 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30924544,"thread_start_us":437252,"threads_started":1,"wal-append.queue_time_us":879447}
I20260709 13:18:47.700443  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.701144  4290 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
W20260709 13:18:47.715476  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 74096.9us
W20260709 13:18:47.716563  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 63743.3us
I20260709 13:18:47.719553  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:47.723719  5865 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.724186  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:47.724220  5865 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.725534  5865 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.727432  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.737118  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:47.747277  5885 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.747570  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.750185  4215 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.674067  5773 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:47.755805  4145 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:47.713752  5771 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:47.758929  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:47.737560  5448 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.763387  5599 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:47.766858  4290 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:47.768100  5773 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:47.769513  4290 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.762796  4215 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:47.775836  4290 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:47.742238  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.793164  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.775039  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:47.796586  5851 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.803961  4186 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:47.805066  5942 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.805476  5942 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.805853  5942 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.784613  5936 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.790019  5600 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.800652  5951 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.800329  5959 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.801540  5928 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.855s	user 0.004s	sys 0.003s
I20260709 13:18:47.813216  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.801967  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.801751  5737 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.818068  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:47.821354  5936 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:47.821656  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:47.826746  4146 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:47.833298  5948 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:47.834026  5948 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.851096  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.830246  5851 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.825114  5737 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.829000  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:47.852314  5847 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.844854  5650 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:47.873449  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44692.3us
I20260709 13:18:47.867178  5936 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.874065  5901 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:47.858551  5762 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.877560  5901 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:47.878204  5901 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.876616  5541 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:47.866997  5851 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.817214  5951 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.877768  5762 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.876518  5936 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.870090  5941 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:47.914115  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.882090  5851 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.881888  5948 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.939879  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1344) took 1037 ms. Trace:
I20260709 13:18:47.828881  5959 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.940423  4139 rpcz_store.cc:276] 0709 13:18:46.902650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.902992 (+   342us) service_pool.cc:224] Handling call
0709 13:18:46.903513 (+   521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.908184 (+  4671us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:46.933512 (+ 25328us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.674090 (+740578us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b1800382120. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf2455 00007fee426da3c7 00007fee3ecec9a7 00007fee3ecfc0bf 00007fee3ecfc038
0709 13:18:47.938628 (+264538us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.939046 (+   418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.939095 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:47.939140 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.939320 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.939452 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71,"prepare.queue_time_us":37598,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":5204,"raft.queue_time_us":612,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":5227,"spinlock_wait_cycles":14208640,"thread_start_us":376716,"threads_started":2,"wal-append.queue_time_us":187092}
I20260709 13:18:47.949954  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.884733  5541 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:47.965205  5959 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.965925  5541 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:47.968741  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:47.946481  5923 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:47.993072  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 142071us
I20260709 13:18:47.994199  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.985157  5881 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.002187  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.004038  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:18:48.002312  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 134211us
I20260709 13:18:48.005693  4214 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:47.987049  5600 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.008313  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.008445  4214 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:48.011265  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:48.014557  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45272.6us
I20260709 13:18:48.015838  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:47.997157  5761 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.019120  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:48.019574  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.023643  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:48.032560  5936 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.034308  5737 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.032406  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:47.989987  5927 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.173s
I20260709 13:18:48.012547  5909 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:48.057956  5909 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.058049  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.058465  5909 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.021224  5947 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.017613  5750 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:18:48.022011  5948 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:48.025034  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.063136  4142 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:48.052580  5762 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.045584  5888 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.055156  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.056572  4222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:18:48.057222  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.004426  5959 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:18:48.061262  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.047312  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.071085  4222 raft_consensus.cc:606] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:48.071669  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:48.065433  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.067950  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.074033  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.075268  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.072388  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.068663  4289 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:48.079602  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.071378  4144 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:48.049477  5941 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.112491  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.113111  4144 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:48.113955  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.114238  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.070380  5950 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:48.114946  4296 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:48.051008  5936 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.114277  4141 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:48.121176  5951 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.062999  5737 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.110525  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.111253  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.123988  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.107872  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.125240  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.125378  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.080528  5750 consensus_queue.cc:1243] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:48.133893  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.110720  5718 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.141399  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.143085  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.145905  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:18:48.167101  4142 raft_consensus.cc:606] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.108779  5847 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:18:48.126039  5783 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:48.169512  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.127259  5705 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.146481  5718 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.196079  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.201381  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.178175  4138 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:48.126072  5936 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.189532  5783 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.131919  5737 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.178520  5750 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:48.179184  5600 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:48.228188  4142 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:48.115178  5950 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:48.126421  5941 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.198983  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.205129  5718 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.199640  5942 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.220198  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.221686  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.223902  4144 pending_rounds.cc:85] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 1
I20260709 13:18:48.247061  4144 pending_rounds.cc:107] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:48.192006  5881 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.189002  5705 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.228108  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.227948  4288 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:48.222481  5910 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:48.233947  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.232724  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.240865  5733 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:48.247566  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.260969  4222 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
W20260709 13:18:48.261314  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 88672.8us
I20260709 13:18:48.251395  4144 raft_consensus.cc:2889] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.263021  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:48.234916  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 97115.5us
I20260709 13:18:48.227253  5783 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.232184  5750 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:48.253075  5752 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:18:48.264129  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:48.269227  4217 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:48.247952  5600 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:48.254377  5705 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.234565  5756 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:18:48.273140  5870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a767a88581024d12b14e9f965193d404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:48.268658  5968 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:48.266269  5541 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.280588  5750 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.308588  4187 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.297231  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:48.310987  5963 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 13:18:48.298053  5926 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.265780  5910 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:48.327898  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.270377  5733 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:48.319044  5761 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:18:48.334522  5541 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.337596  5970 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:48.338074  5970 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:48.338899  5970 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.334494  5835 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 13:18:48.345402  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 80303.9us
I20260709 13:18:48.361636  5826 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.362582  5826 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.374591  5797 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:48.385824  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 115204us
I20260709 13:18:48.333309  5968 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.391145  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1324) took 1452 ms. Trace:
I20260709 13:18:48.354861  5942 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.391721  4292 rpcz_store.cc:276] 0709 13:18:46.938623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.938817 (+   194us) service_pool.cc:224] Handling call
0709 13:18:46.939317 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.939603 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.939641 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.580867 (+641226us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b2c00138c78. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:18:47.581320 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.955819 (+374499us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:47.955878 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.956808 (+   930us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.390644 (+433836us) raft_consensus.cc:1685] finished
0709 13:18:48.390671 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.390939 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6427392,"thread_start_us":374015,"threads_started":1,"wal-append.queue_time_us":443968}
W20260709 13:18:48.391321  5901 consensus_meta.cc:287] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.004s
I20260709 13:18:48.386519  5600 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.445083  5737 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.454141  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:48.451282  5986 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.458171  5986 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.461143  5986 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:48.458868  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.466048  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.466189  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.476645  5705 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.421977  5936 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.396199  5909 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.453668  5970 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:48.495796  5972 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.281s	user 0.000s	sys 0.004s
I20260709 13:18:48.498750  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:18:48.501226  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 170663us
I20260709 13:18:48.460166  5910 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:48.509704  5910 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:48.513476  5783 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.515363  5733 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.504788  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.505538  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.483848  5881 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.507038  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.515774  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:48.522744  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.532648  4145 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:48.527994  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45777.9us
I20260709 13:18:48.488130  5947 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:48.502688  5573 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:48.518112  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.520390  5950 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:48.538847  5990 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:48.539675  5910 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.540068  5990 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:48.540548  5990 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:48.541445  5990 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.521763  4292 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:48.519981  5909 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.545331  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.516332  5826 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:48.407140  5901 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.537012  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.552943  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:18:48.520331  5851 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.574s	user 0.003s	sys 0.008s
I20260709 13:18:48.560695  5909 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:48.556272  4145 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:48.558415  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.562769  4112 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.564565  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.565567  5937 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.566385  5936 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.567243  5783 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:48.563305  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.569496  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.573880  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.568185  5987 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:18:48.578943  5923 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:48.579497  5923 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:48.480219  5718 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.587437  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.589592  5889 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.580319  5762 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:48.550601  5947 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:48.594743  5865 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.013s
I20260709 13:18:48.544356  5990 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.597637  4112 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.606244  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.571007  5851 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.524364  5881 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.595243  5865 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.654713  5986 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:48.657258  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:48.633949  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.624042  4147 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:48.582162  5893 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.662261  4143 raft_consensus.cc:2376] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4. Re-sending same reply.
W20260709 13:18:48.633317  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 56435.7us
W20260709 13:18:48.659351  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52720.6us
I20260709 13:18:48.620960  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1395) took 1029 ms. Trace:
I20260709 13:18:48.664407  4294 rpcz_store.cc:276] 0709 13:18:47.591638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.591749 (+   111us) service_pool.cc:224] Handling call
0709 13:18:48.620671 (+1028922us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b54000affd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:48.620880 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184165248}
I20260709 13:18:48.621598  5901 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.666968  4292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:48.595248  5705 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:48.604941  5782 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.623888  5718 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:48.667364  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.672606  4292 raft_consensus.cc:606] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:48.690340  4292 raft_consensus.cc:614] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:48.690644  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.609252  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:48.672533  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 74992.5us
I20260709 13:18:48.674357  4141 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
W20260709 13:18:48.662657  5649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.015s	sys 0.020s
W20260709 13:18:48.695789  5649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.016s	sys 0.020s
I20260709 13:18:48.612489  5762 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:48.608875  5750 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.697781  5762 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.699529  5826 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.700251  5826 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:48.700785  5826 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.702039  5865 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.664198  5989 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:48.708674  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.709661  4219 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:48.710223  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:48.712399  4213 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:48.712316  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:48.713022  4213 pending_rounds.cc:85] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 2
I20260709 13:18:48.713263  4213 pending_rounds.cc:107] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:48.713474  4213 raft_consensus.cc:2889] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.716253  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:48.716509  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:48.717195  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:48.717876  4295 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.610553  5987 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:48.720970  5975 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.674510  5936 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.724551  4293 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:48.727501  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:48.737404  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47553.1us
I20260709 13:18:48.734054  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.738729  4217 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:48.738796  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:48.743623  5752 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:48.744590  5750 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.744853  5752 tablet_bootstrap.cc:492] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:48.746493  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.750909  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:48.735983  4215 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:48.765406  4186 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.768321  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:48.768388  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:48.775812  4222 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:48.728750  5975 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:48.777667  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.776700  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:48.786402  4217 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.788297  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.797487  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1360) took 1192 ms. Trace:
I20260709 13:18:48.797945  4146 rpcz_store.cc:276] 0709 13:18:47.606869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.606987 (+   118us) service_pool.cc:224] Handling call
0709 13:18:47.608557 (+  1570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.827271 (+218714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.797262 (+969991us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54003da754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:48.797430 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501332352}
I20260709 13:18:48.806941  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:48.807941  4288 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.785858  5752 ts_tablet_manager.cc:1403] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.446s	user 0.051s	sys 0.076s
I20260709 13:18:48.806566  5783 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:48.847321  4295 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:48.817557  5733 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:48.793587  5975 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.831631  5851 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.776803  5776 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:48.771827  5929 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.836817  5881 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:48.815464  5995 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:48.848790  4293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:48.875752  4293 raft_consensus.cc:606] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:18:48.854470  4217 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
W20260709 13:18:48.876946  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.856392  4295 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:18:48.768244  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 178617us
I20260709 13:18:48.847625  5783 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.799257  5705 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:18:48.885325  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:48.885071  4288 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:48.861340  5733 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:18:48.888612  5783 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:48.903429  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:48.890048  5826 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.939630  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.942279  4296 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:48.932318  5971 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:48.912783  5923 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.944801  5970 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:48.952481  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:48.954469  5988 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:48.955063  5705 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:48.962435  5926 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:48.976522  5953 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:48.976974  5953 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:48.977212  5705 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.977869  5953 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.979378  5926 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:48.979570  5705 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:48.971431  5970 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:48.981634  5970 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.982436  5752 raft_consensus.cc:359] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:48.983331  5752 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:48.987164  5947 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.988739  5826 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:48.990906  5923 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:48.984831  5926 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:48.961594  5870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42922 (request call id 235) took 3696 ms. Trace:
I20260709 13:18:49.006386  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.022786  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:49.023820  5783 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.025281  5705 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:49.025832  5705 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:49.026612  5783 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.034420  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.035580  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:49.026692  5705 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.001106  5752 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:49.037978  5756 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.042352  5756 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.043857  5752 ts_tablet_manager.cc:1434] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.200s	user 0.007s	sys 0.003s
W20260709 13:18:49.046816  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 269232us
I20260709 13:18:49.048729  5773 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:49.049371  5773 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.049846  5773 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.056380  5733 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:49.058506  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.059360  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:49.060892  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:49.061409  4217 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.070550  5941 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.073958  4217 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:18:49.075867  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.078660  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.085880  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:49.057509  5733 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.098104  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:49.095446  5797 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.089905  5923 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.107942  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:49.065208  5987 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.108603  5797 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.108971  5987 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:49.109874  5783 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:49.110689  5783 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:49.044929  5756 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.113735  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:49.114862  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.116209  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.116835  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:49.117676  4287 raft_consensus.cc:2368] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6.
W20260709 13:18:49.149981  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 44548.2us
I20260709 13:18:49.156075  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.157347  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.154734  4292 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:49.153268  4141 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:49.067981  5975 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.098822  5941 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.168345  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:49.111074  5987 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.171653  4288 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:49.111014  5797 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.168663  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.120261  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-a35e1cee8a15436dbfaf75dd67824aad received from {username='slave'} at 127.0.0.1:37124
I20260709 13:18:49.162036  5757 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.176626  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:49.183831  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 63994.3us
I20260709 13:18:49.166500  5989 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.166059  5815 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.108613  5923 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.188480  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-a35e1cee8a15436dbfaf75dd67824aad on tablet a35e1cee8a15436dbfaf75dd67824aad with peer b81584b21ed144698954548303f1e507
I20260709 13:18:49.180646  5738 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:49.186199  5757 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.191316  5757 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.170977  5881 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:49.188257  4187 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:49.192788  5881 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.200273  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.200273  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.172210  5990 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:18:49.197434  5815 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.201045  4147 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:49.198040  5882 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:49.213289  5946 raft_consensus.cc:993] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:49.206058  5757 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:49.213625  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.201916  5936 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:49.206617  5979 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:49.207141  5990 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:49.206056  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.196784  5988 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:49.208132  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.209460  5815 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.212219  5882 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.177372  5783 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.001327  5870 rpcz_store.cc:276] 0709 13:18:45.262259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.264539 (+  2280us) service_pool.cc:224] Handling call
0709 13:18:45.536582 (+272043us) ts_tablet_manager.cc:934] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
0709 13:18:48.045966 (+2509384us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:48.618517 (+572551us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:48.618691 (+   174us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:48.915418 (+296727us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:48.939889 (+ 24471us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:48.955568 (+ 15679us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:48.958298 (+  2730us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":67604,"tablet-copy.queue_time_us":121406,"thread_start_us":782297,"threads_started":2}
I20260709 13:18:49.221427  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.249023  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.226848  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.192911  5879 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:49.175311  5941 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.257001  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.207408  5947 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.244534  4144 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:49.228457  5921 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.255878  4138 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:49.270805  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.238087  4147 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:49.253724  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.229626  5901 raft_consensus.cc:1081] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:49.273702  5941 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.257673  4145 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.265619  5879 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:49.276542  5879 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:49.277444  5921 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:49.236608  4142 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:49.271754  4141 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.269686  5870 tablet_copy_client.cc:806] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:49.276556  5815 raft_consensus.cc:993] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:49.282826  5870 tablet_copy_client.cc:670] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:49.283006  5923 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.235769  5979 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.196601  5989 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.285130  5921 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.286243  5989 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.194545  5970 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:49.278040  5882 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.271526  4144 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.265264  5988 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:49.285192  5979 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.254906  5926 raft_consensus.cc:2764] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:49.289235  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.232044  5936 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.231966  5990 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:49.304455  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.295063  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.295281  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:49.305212  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 120430us
I20260709 13:18:49.291734  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.304661  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.307192  4217 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:49.299633  4145 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:49.312676  4110 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:49.319085  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.320870  4144 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:18:49.323815  4218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44160
I20260709 13:18:49.324420  4218 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:49.324776  4218 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.329339  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.332115  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.333343  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.334517  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.335141  4218 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:49.335235  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.336664  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.337803  4218 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.341167  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.341594  4144 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:49.344059  4145 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.345243  4140 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.310298  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:49.297983  5921 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:49.270742  5947 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.352984  5865 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:49.299230  5989 raft_consensus.cc:1081] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:49.359545  5773 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.360664  5990 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.364854  5988 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.368698  5947 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.373518  5921 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:49.368988  5936 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:49.373575  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.375514  4141 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:49.382550  5921 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.375375  5975 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.353950  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.357769  5797 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:49.386624  5797 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.387387  5797 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.388854  4145 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:49.399768  4143 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:49.403178  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.403363  5990 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:49.404906  5773 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.408620  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.409361  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.410108  4289 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:49.410846  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:49.411736  4292 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:49.414291  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 87412.1us
I20260709 13:18:49.414825  4146 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:49.422487  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.423247  4141 raft_consensus.cc:3055] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:49.423580  4141 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:49.423858  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.418449  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:49.425601  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.429776  4292 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:49.424752  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.432044  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.434139  4141 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:49.435731  4141 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.437377  4111 leader_election.cc:400] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6.
I20260709 13:18:49.437676  4111 leader_election.cc:403] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:49.443646  6021 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.443881  5937 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6.
I20260709 13:18:49.436679  5773 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:49.445698  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.445876  5773 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:49.446434  5773 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.446581  5879 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:49.450213  5953 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:49.452951  4185 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9ed971e9cd64f17bc8646a1d19e3622. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.454309  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.455276  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:49.456522  5988 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:49.456701  5738 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:49.457517  5750 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:49.458236  5750 raft_consensus.cc:697] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:49.458405  5921 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:49.459017  5921 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:49.462882  4214 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:49.463759  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.463418  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:49.464032  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:49.467061  5950 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.467872  5950 consensus_queue.cc:1243] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:49.468312  5950 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:49.468616  5950 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:49.469349  5950 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.473985  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:49.476677  4218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44154
I20260709 13:18:49.477440  4218 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:49.477882  4218 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.463802  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:49.480691  5950 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:49.470264  5797 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.483134  4293 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:49.484455  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.487214  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:49.494685  4294 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:49.457535  5988 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:49.494287  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.498689  4296 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.482730  5797 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:49.501317  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.459401  5750 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:49.495692  5937 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:49.489236  5921 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.515304  4141 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:49.518383  5881 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.499846  5947 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.499061  5988 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:49.545871  5988 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.549258  5988 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.549410  5926 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:49.550640  5926 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:49.551043  5926 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:49.547693  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.509464  5946 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.556825  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.533417  5756 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:49.543943  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.569188  5599 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:49.568640  4292 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:49.576761  4140 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:49.599009  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:49.618630  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.621070  4290 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.620150  4218 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.627149  4216 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.552014  5926 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.628968  5926 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.631242  4041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 174) took 8451 ms. Trace:
I20260709 13:18:49.631635  4041 rpcz_store.cc:276] 0709 13:18:41.172651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.175886 (+  3235us) service_pool.cc:224] Handling call
0709 13:18:49.623718 (+8447832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:45.049788 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:45.229118 (+179330us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:45.231574 (+  2456us) write_op.cc:435] Acquired schema lock
0709 13:18:45.233034 (+  1460us) tablet.cc:662] Decoding operations
0709 13:18:45.340265 (+107231us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:45.340390 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:45.340429 (+    39us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:45.341082 (+   653us) tablet.cc:701] Row locks acquired
0709 13:18:45.341106 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:18:45.341269 (+   163us) write_op.cc:270] Start()
0709 13:18:45.341403 (+   134us) write_op.cc:276] Timestamp: P: 1783603125341218 usec, L: 0
0709 13:18:45.341425 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:45.439381 (+ 97956us) log.cc:844] Serialized 2463 byte log entry
0709 13:18:46.866525 (+1427144us) op_driver.cc:464] REPLICATION: finished
0709 13:18:47.086112 (+219587us) write_op.cc:301] APPLY: starting
0709 13:18:47.093767 (+  7655us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:47.129479 (+ 35712us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:47.140209 (+ 10730us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:47.141264 (+  1055us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:47.141483 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:47.141546 (+    63us) write_op.cc:312] APPLY: finished
0709 13:18:47.141834 (+   288us) log.cc:844] Serialized 52 byte log entry
0709 13:18:47.142062 (+   228us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.142192 (+   130us) write_op.cc:454] Released schema lock
0709 13:18:47.142250 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:47.142711 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.142740 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8739,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":192521,"apply.run_cpu_time_us":3404,"apply.run_wall_time_us":75084,"num_ops":6,"prepare.queue_time_us":191839,"prepare.run_cpu_time_us":93778,"prepare.run_wall_time_us":785440,"raft.queue_time_us":661782,"raft.run_cpu_time_us":32471,"raft.run_wall_time_us":128368,"replication_time_us":1524901,"thread_start_us":868961,"threads_started":4,"wal-append.queue_time_us":703850,"wal-append.run_cpu_time_us":22769,"wal-append.run_wall_time_us":2005050}]]}
I20260709 13:18:49.635928  4222 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:49.639042  5851 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.630905  5756 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:49.624549  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.650054  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.652684  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.662706  4289 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:49.663596  4187 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.663932  4044 catalog_manager.cc:5697] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.655339  5888 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:18:49.625144  5783 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:49.672380  4187 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.673781  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.653506  5979 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:49.675254  5954 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:49.675313  5776 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:49.675987  5954 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:49.677026  5954 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.677134  4215 raft_consensus.cc:2410] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:49.677244  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.682737  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.652418  5599 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:49.689934  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.678866  5815 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:49.695744  6027 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.002s
I20260709 13:18:49.684283  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.698731  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.699370  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:49.706051  5773 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.707306  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.708053  5773 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.708211  4218 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:49.709447  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:49.709932  5649 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:49.710402  5950 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:49.712389  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:49.723198  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.720062  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.724713  4294 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:49.726632  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:49.728391  4141 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.731546  5979 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:49.732339  5979 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:49.733309  4147 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:49.733760  4147 pending_rounds.cc:85] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 1
I20260709 13:18:49.734040  4147 pending_rounds.cc:107] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:49.733520  5979 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.734302  4147 raft_consensus.cc:2889] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:49.737080  4141 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:49.737993  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.738718  4138 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.745299  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.746980  4142 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:49.748230  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:49.749097  4289 raft_consensus.cc:3055] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:49.749395  4289 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:49.749596  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.749799  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:49.721799  5649 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:49.721634  5815 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:49.750154  4289 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.762256  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.757449  5783 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:49.760601  4289 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.758370  5888 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.768885  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.774142  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.774482  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:49.754393  6009 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:18:49.786185  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:49.778829  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.758456  5738 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:18:49.769207  5797 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:49.792141  5649 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:49.792928  4138 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:49.793130  5929 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:49.788566  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.800136  5927 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:49.800881  5783 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.804831  4218 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:49.844245  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 63757.9us
I20260709 13:18:49.846072  4893 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.846604  4218 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:49.815295  4922 raft_consensus.cc:1217] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:49.779999  5733 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:49.821754  4289 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:49.823305  5954 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:49.776037  5909 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:49.848407  5909 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:49.850564  5909 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:49.779740  5921 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:49.785490  5776 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:18:49.856065  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.861349  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:49.789773  5936 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:49.866835  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 78553.7us
I20260709 13:18:49.840433  5870 tablet_copy_client.cc:538] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:49.888902  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:49.867779  5946 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.843901  5951 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:18:49.895200  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.870453  5733 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:49.867828  5826 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:49.898430  4289 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:49.881494  5882 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:18:49.882172  5910 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:49.882562  5649 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.921378  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.865475  5888 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:18:49.947098  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:49.922444  5599 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.959512  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 87356.5us
I20260709 13:18:49.938607  5759 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.941183  5910 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:49.952013  5923 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:49.961750  5879 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:50.029959  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 73686.7us
I20260709 13:18:49.960700  5599 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.031754  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:50.068977  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:50.065657  5865 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:50.055970  5881 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:18:50.078176  6018 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.101550  4292 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:50.107182  4288 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.078487  5910 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.118496  5599 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:50.109670  5879 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.112182  5776 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:50.110018  5750 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:18:50.124032  5879 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:50.134800  5926 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:50.152828  5926 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:50.174012  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:50.177278  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:50.190222  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:50.199230  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:50.196952  4139 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:50.202436  4139 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.203176  6041 ts_tablet_manager.cc:933] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:50.205022  4140 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.206005  4145 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:50.175215  5947 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:50.209138  4139 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:50.180568  5757 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:50.178041  5599 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:50.188565  5815 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.229173  5783 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.214908  5757 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:50.238530  5757 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.240250  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:50.207648  5929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54760 (request call id 7) took 2139 ms. Trace:
I20260709 13:18:50.211565  5947 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:50.213651  5926 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.262063  5926 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.262293  5870 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Bootstrap starting.
W20260709 13:18:50.262662  6037 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:18:50.249214  5757 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.250847  5929 rpcz_store.cc:276] 0709 13:18:48.053481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.053613 (+   132us) service_pool.cc:224] Handling call
0709 13:18:48.724032 (+670419us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b5400402020. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec5f520 00007fee3ece8b42 00007fee3ece7800 00007fee43ca8d29 00007fee3d2271d4 00007fee3d227162 00007fee3d227091 00007fee3d22700c 00007fee3d2262c2 00007fee3d01d48c
0709 13:18:48.841002 (+116970us) log.cc:844] Serialized 499 byte log entry
0709 13:18:49.052254 (+211252us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b5400402020. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec5b142 00007fee3ec3beaa 00007fee3ec42d53 00007fee3ec42cd9 00007fee3ec42c69 00007fee3ec42c31 00007fee3ec41dfd 000000000038f354 000000000038f199 00007fee3bbf5475
0709 13:18:49.111704 (+ 59450us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b180039c280. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:18:49.357453 (+245749us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b180039c280. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbc32a6 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec62b26 00007fee3ec5c49a 00007fee3ec5b714
0709 13:18:49.362703 (+  5250us) spinlock_profiling.cc:243] Waited 930 us on lock 0x7b5400402020. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec62b26 00007fee3ec5c49a 00007fee3ec5b714 00007fee3ec3beaa 00007fee3ec42d53 00007fee3ec42cd9 00007fee3ec42c69 00007fee3ec42c31 00007fee3ec41dfd 000000000038f354
0709 13:18:50.189735 (+827032us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102149,"raft.queue_time_us":16388,"raft.run_cpu_time_us":13202,"raft.run_wall_time_us":671470,"spinlock_wait_cycles":57576832,"thread_start_us":56710,"threads_started":1,"wal-append.queue_time_us":87893,"wal-append.run_cpu_time_us":2831,"wal-append.run_wall_time_us":1059484}
I20260709 13:18:50.254321  5815 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:18:50.290143  4215 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:50.274896  5947 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.269536  5847 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:50.259164  5979 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:18:50.277307  5879 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:50.290971  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:50.322153  4928 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:50.325515  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:18:50.331709  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.331713  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:50.333397  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:50.342304  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 65396.1us
W20260709 13:18:50.343089  4185 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:50.335799  5879 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:50.350296  5879 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.350767  5879 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.346797  6041 tablet_copy_client.cc:323] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:18:50.353753  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet d9ed971e9cd64f17bc8646a1d19e3622 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:18:50.354640  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet d9ed971e9cd64f17bc8646a1d19e3622 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-d9ed971e9cd64f17bc8646a1d19e3622
I20260709 13:18:50.331558  5882 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.356676  5882 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.358858  5882 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:50.385013  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 133015us
W20260709 13:18:50.389001  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 157608us
I20260709 13:18:50.364184  5947 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:50.393087  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 152898us
I20260709 13:18:50.403169  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:50.418361  4290 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:50.452466  5756 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:50.452584  5926 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:50.613998  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 265579us
W20260709 13:18:50.618881  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 138848us
I20260709 13:18:50.643044  5750 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:50.658545  4232 tablet_copy_source_session.cc:215] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:50.645744  5750 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.602159  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.683151  5738 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:50.699435  5738 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:50.703101  5738 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:50.711103  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:50.712867  4920 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:50.684911  5750 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:50.695451  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:50.723415  4213 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:50.727921  4185 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:18:50.728888  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 293267us
I20260709 13:18:50.737403  5879 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:50.738178  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:50.739974  5879 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:50.727470  5738 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.785220  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 69507.3us
I20260709 13:18:50.794437  5750 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:50.795315  5750 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:50.795889  5750 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.779421  5738 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.820176  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:50.821076  4927 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.833928  5879 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:50.834761  5879 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.835199  5879 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.835403  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:50.841661  4295 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:50.842767  5738 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:50.866863  4291 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.885609  4218 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.882829  4045 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 2 to 4, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 4 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:50.907819  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:50.909750  4045 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 4, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 4 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.917168  5865 raft_consensus.cc:1064] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:50.920477  4045 catalog_manager.cc:5697] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index -1 to 2, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:50.923990  6041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ed971e9cd64f17bc8646a1d19e3622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.924893  4045 catalog_manager.cc:5697] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 3, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.933055  4045 catalog_manager.cc:5697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:50.934852  6047 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:50.936545  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:50.945730  5847 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:50.946255  5847 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:50.946767  5847 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.936806  4045 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 2, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.957697  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:50.959252  4145 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.960697  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:50.961442  4145 raft_consensus.cc:2368] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:18:50.935845  6047 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.923722  5865 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:50.957885  4141 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:50.976859  6045 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:50.977517  5979 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:50.986232  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:50.987280  4295 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:50.992589  5979 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:50.997466  4044 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 171) took 9431 ms. Trace:
I20260709 13:18:50.998229  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:50.998972  4927 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:18:50.999186  4142 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:51.000088  5979 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:51.009022  4187 leader_election.cc:400] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:18:51.017196  6047 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.017606  5757 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:51.020830  5870 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:18:51.028460  5909 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.983235  4045 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 2 to 3, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:51.043604  5870 tablet_bootstrap.cc:492] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:51.049122  5870 ts_tablet_manager.cc:1403] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.802s	user 0.024s	sys 0.021s
I20260709 13:18:51.048840  4045 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.052067  5757 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.052750  5757 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.055284  5757 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.070899  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:51.077549  4045 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 3 to 6, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 6 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:18:51.085834  6072 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:18:51.066522  5909 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.091379  5909 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.092556  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:51.092832  5870 raft_consensus.cc:359] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 3 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:51.093745  6047 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:51.094827  6047 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:51.095947  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:51.097496  6049 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:51.096066  6047 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:51.093916  5870 raft_consensus.cc:886] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 3 LEARNER]: Ignoring setting pending config change with OpId 3.3 because the committed config has OpId index 3. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:51.102947  5870 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:51.103899  5870 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:50.998250  4044 rpcz_store.cc:276] 0709 13:18:41.565765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.566083 (+   318us) service_pool.cc:224] Handling call
0709 13:18:50.997100 (+9431017us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:49.996478 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:49.997207 (+   729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:49.997249 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:18:49.997263 (+    14us) tablet.cc:662] Decoding operations
0709 13:18:49.997688 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:49.997770 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:49.997800 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:49.998028 (+   228us) tablet.cc:701] Row locks acquired
0709 13:18:49.998048 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:49.998221 (+   173us) write_op.cc:270] Start()
0709 13:18:49.998361 (+   140us) write_op.cc:276] Timestamp: P: 1783603129998167 usec, L: 0
0709 13:18:49.998380 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:49.999248 (+   868us) log.cc:844] Serialized 532 byte log entry
0709 13:18:50.455259 (+456011us) op_driver.cc:464] REPLICATION: finished
0709 13:18:50.543686 (+ 88427us) write_op.cc:301] APPLY: starting
0709 13:18:50.543801 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:50.543946 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:50.544116 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:50.544488 (+   372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:50.544699 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:50.544746 (+    47us) write_op.cc:312] APPLY: finished
0709 13:18:50.553500 (+  8754us) log.cc:844] Serialized 22 byte log entry
0709 13:18:50.554570 (+  1070us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.555215 (+   645us) write_op.cc:454] Released schema lock
0709 13:18:50.555271 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:50.555661 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.555710 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":212518,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":88110,"apply.run_cpu_time_us":2251,"apply.run_wall_time_us":11940,"num_ops":1,"prepare.queue_time_us":284652,"prepare.run_cpu_time_us":12457,"prepare.run_wall_time_us":132821,"raft.queue_time_us":191080,"raft.run_cpu_time_us":15203,"raft.run_wall_time_us":77167,"replication_time_us":456692,"thread_start_us":421481,"threads_started":4,"wal-append.queue_time_us":110615}]]}
I20260709 13:18:51.109812  5870 ts_tablet_manager.cc:1434] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.002s
I20260709 13:18:51.079420  4045 catalog_manager.cc:5697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.040823  5879 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.117329  4138 raft_consensus.cc:2368] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4.
I20260709 13:18:51.120973  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:51.123512  5847 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.115447  4045 catalog_manager.cc:5697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 4, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 4 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.135715  4045 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 3, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.147578  4218 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.146715  4143 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:51.172703  5783 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:18:51.127247  5750 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:51.177103  4213 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:51.177418  5750 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:51.178668  4219 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.158768  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:51.184698  5773 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:51.217867  4927 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:51.230448  4219 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:18:51.239305  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:51.246951  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:51.247846  4291 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:51.248849  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:51.249439  6066 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:51.191044  5879 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.227068  5750 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:51.250108  6066 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:51.298316  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 61785.4us
I20260709 13:18:51.298470  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:51.302726  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 150531us
I20260709 13:18:51.312953  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-a767a88581024d12b14e9f965193d404 received from {username='slave'} at 127.0.0.1:37124
I20260709 13:18:51.313777  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-a767a88581024d12b14e9f965193d404 on tablet a767a88581024d12b14e9f965193d404 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:51.315011  4141 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:51.315181  4187 leader_election.cc:400] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4.
I20260709 13:18:51.317714  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:51.318372  4295 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.280664  5750 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.281152  5865 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:51.308570  4145 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:51.342238  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:51.354809  4218 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:51.326345  5750 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.330842  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:18:51.377036  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 119440us
I20260709 13:18:51.399986  4290 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:51.390822  5847 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.399286  4927 raft_consensus.cc:2368] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
W20260709 13:18:51.416000  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59435.5us
I20260709 13:18:51.377234  5865 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.427556  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:51.428613  4222 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:51.402454  5950 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.155s
I20260709 13:18:51.476869  4295 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:51.493549  4185 leader_election.cc:400] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:18:51.495662  4185 leader_election.cc:403] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.490669  5927 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.500480  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49320.7us
I20260709 13:18:51.509331  4112 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:51.501256  5865 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.528491  6058 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:51.529073  6058 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:51.529621  6058 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.532757  5927 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.534596  6038 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:18:51.548805  5756 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.549670  5756 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.554934  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:51.536103  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:51.566411  6087 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:51.574807  6066 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.578503  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:51.580972  5910 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.581642  5910 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.582687  6045 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.583369  6045 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.583775  6045 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.587069  5910 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.589721  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:51.590487  4292 raft_consensus.cc:2368] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4.
I20260709 13:18:51.593403  5927 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.597564  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42908 (request call id 266) took 1442 ms. Trace:
I20260709 13:18:51.598155  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:51.601172  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:51.602056  5773 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:51.602559  5773 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:51.603940  5773 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.609829  5797 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:51.610503  5797 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.612675  5797 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:51.614588  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:51.618053  5756 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.618911  4218 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:51.621465  4186 leader_election.cc:400] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4.
I20260709 13:18:51.624985  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:51.626814  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:51.633008  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 311285us
I20260709 13:18:51.635571  4186 leader_election.cc:403] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.639433  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:51.646509  5881 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:18:51.647235  4291 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:51.648312  4292 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:51.661917  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:51.654089  5756 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4.
I20260709 13:18:51.678897  4145 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:51.694170  4186 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:51.700165  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:51.709591  4147 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:51.716166  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:51.713752  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:51.735230  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:51.736181  4213 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:51.598277  6041 rpcz_store.cc:276] 0709 13:18:50.155554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.155756 (+   202us) service_pool.cc:224] Handling call
0709 13:18:50.203627 (+ 47871us) ts_tablet_manager.cc:934] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
0709 13:18:50.742492 (+538865us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:51.217404 (+474912us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:51.217566 (+   162us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:51.596174 (+378608us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:51.596786 (+   612us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:51.597261 (+   475us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:51.597379 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":24235,"tablet-copy.queue_time_us":33893,"thread_start_us":130232,"threads_started":2}
I20260709 13:18:51.724982  5756 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.784710  4145 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:51.725296  5910 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:51.786301  4928 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 3 LEARNER]: Advancing to term 4
I20260709 13:18:51.728024  5847 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:51.800046  6073 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:18:51.800767  6058 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.698894  6049 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:18:51.785581  5756 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:51.834388  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 102383us
I20260709 13:18:51.733992  5750 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.809422  4928 raft_consensus.cc:2962] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 4 LEARNER]: Ignoring commit of config change with OpId 3.3 because the committed config has OpId index 3. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:18:51.833963  6041 tablet_copy_client.cc:806] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:51.841681  6041 tablet_copy_client.cc:670] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:51.849372  5750 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:51.856523  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 140314us
I20260709 13:18:51.817045  5847 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:51.869518  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 126636us
I20260709 13:18:51.834818  5756 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.810468  5910 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.859048  6045 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:51.910831  6045 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:51.908094  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:51.911821  4287 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.912672  4218 raft_consensus.cc:2368] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:18:51.872133  5847 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.074416  5910 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:52.077984  6058 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:52.085481  6097 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
W20260709 13:18:52.087846  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 219738us
I20260709 13:18:52.090600  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:52.091281  4290 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.083516  4287 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:52.092712  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:52.109648  4290 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:18:52.118026  6047 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:52.131744  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:52.129487  4927 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:52.111106  6058 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:52.112507  5950 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.138762  4187 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:52.140928  5887 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:18:52.141613  5649 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:52.142081  5649 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:52.142443  5649 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.155011  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:52.136780  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:52.168483  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:52.169633  4290 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:52.180305  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:52.181694  4295 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:52.177335  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:52.176872  6058 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.199738  6058 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:52.225744  4215 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:52.241331  5953 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:52.242225  5953 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:52.243136  4920 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:52.243831  5953 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.249871  5756 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.265373  5649 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.274911  5756 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:52.277493  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:52.278422  4142 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:52.280081  5649 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:52.280853  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:52.282380  5847 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.292106  4147 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:52.295403  5783 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.296233  4221 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
W20260709 13:18:52.312597  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 140560us
W20260709 13:18:52.324620  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 122433us
I20260709 13:18:52.331796  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:52.333679  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:52.345408  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 185158us
I20260709 13:18:52.358980  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:52.359516  6112 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:52.359947  6066 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.356120  4044 catalog_manager.cc:5697] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 3, term changed from 3 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66), NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 4 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.362231  4044 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 4 to 6, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 6 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.364377  4044 catalog_manager.cc:5697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 4 to 5, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.368371  4044 catalog_manager.cc:5697] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 2, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 2 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:52.359576  4112 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:52.304911  5783 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.382213  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:52.401589  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75950.1us
I20260709 13:18:52.376946  6041 tablet_copy_client.cc:538] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:18:52.410583  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51099.9us
W20260709 13:18:52.379448  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 191906us
W20260709 13:18:52.468118  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 90548.2us
I20260709 13:18:52.377995  4044 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:52.468499  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:52.469925  4044 catalog_manager.cc:5697] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 5, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:52.489344  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 140032us
I20260709 13:18:52.489902  4044 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.484928  4215 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:52.494853  4042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 81) took 9868 ms. Trace:
I20260709 13:18:52.495298  4042 rpcz_store.cc:276] 0709 13:18:42.593995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.594188 (+   193us) service_pool.cc:224] Handling call
0709 13:18:52.379330 (+9785142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45074,"reported_tablets":4}
I20260709 13:18:52.497009  6114 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:52.498164  6082 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:52.493427  4044 catalog_manager.cc:5697] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 4, term changed from 1 to 5, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.502091  4290 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:52.506978  4045 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 158) took 7612 ms. Trace:
I20260709 13:18:52.518719  4044 catalog_manager.cc:5697] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 2, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 2 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:52.524248  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:52.524271  4044 catalog_manager.cc:5697] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:52.507402  4045 rpcz_store.cc:276] 0709 13:18:44.880185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.888586 (+  8401us) service_pool.cc:224] Handling call
0709 13:18:52.492639 (+7604053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:51.429135 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:51.429864 (+   729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:51.430061 (+   197us) write_op.cc:435] Acquired schema lock
0709 13:18:51.430095 (+    34us) tablet.cc:662] Decoding operations
0709 13:18:51.431636 (+  1541us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:51.431746 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:51.431780 (+    34us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:18:51.453424 (+ 21644us) tablet.cc:701] Row locks acquired
0709 13:18:51.453478 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:18:51.453674 (+   196us) write_op.cc:270] Start()
0709 13:18:51.453839 (+   165us) write_op.cc:276] Timestamp: P: 1783603131453608 usec, L: 0
0709 13:18:51.453873 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:18:51.454646 (+   773us) log.cc:844] Serialized 4820 byte log entry
0709 13:18:51.641233 (+186587us) op_driver.cc:464] REPLICATION: finished
0709 13:18:51.806394 (+165161us) write_op.cc:301] APPLY: starting
0709 13:18:51.830084 (+ 23690us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:51.900444 (+ 70360us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:51.903254 (+  2810us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:51.905731 (+  2477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:51.906160 (+   429us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:18:51.906226 (+    66us) write_op.cc:312] APPLY: finished
0709 13:18:51.906790 (+   564us) log.cc:844] Serialized 88 byte log entry
0709 13:18:51.966212 (+ 59422us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:52.080566 (+114354us) write_op.cc:454] Released schema lock
0709 13:18:52.080658 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:52.081209 (+   551us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:52.081238 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":540807,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":88159,"apply.run_cpu_time_us":10092,"apply.run_wall_time_us":296260,"num_ops":12,"prepare.queue_time_us":205797,"prepare.run_cpu_time_us":6041,"prepare.run_wall_time_us":25961,"replication_time_us":187146,"thread_start_us":120635,"threads_started":2}]]}
I20260709 13:18:52.527799  4044 catalog_manager.cc:5697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 5 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:18:52.551779  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50280.3us
I20260709 13:18:52.554250  4044 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 2 to 4, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 4 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.573065  4044 catalog_manager.cc:5697] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 2, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 2 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:52.554334  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:52.575110  4044 catalog_manager.cc:5697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:52.576381  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84398.3us
I20260709 13:18:52.499126  6082 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.589505  6090 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:52.589340  5947 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:18:52.529421  6114 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:52.584558  4044 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.579149  6047 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.577368  5847 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:52.613590  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:18:52.625473  6121 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:18:52.608489  6090 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:52.626959  4044 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.641494  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:52.646266  4289 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.657606  4044 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:52.661252  6090 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.663308  5783 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:52.630834  6123 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.111s	user 0.001s	sys 0.003s
I20260709 13:18:52.630638  6114 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.668941  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:52.676061  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:52.679741  4292 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:52.665575  4044 catalog_manager.cc:5697] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 4, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 4 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.686372  4147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:18:52.687253  4147 raft_consensus.cc:606] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:18:52.687628  4147 raft_consensus.cc:614] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:52.699993  4289 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:52.711519  6082 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:52.707192  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 94603.6us
I20260709 13:18:52.714460  6041 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:18:52.728557  4289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c130eddd78204cee994818f0043bf88c"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:52.729818  4289 raft_consensus.cc:606] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:18:52.777027  5975 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:52.777630  5975 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:18:52.781688  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 227426us
I20260709 13:18:52.784260  6116 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:52.784847  6116 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.785308  6116 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.784691  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:52.820613  6049 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.841462  6049 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:52.842196  6049 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.849004  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:52.850354  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 60059.8us
I20260709 13:18:52.854890  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:52.857753  4215 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:52.856117  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:52.860438  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:52.861123  4147 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.861760  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:52.863502  4142 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.871376  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:52.872020  4141 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:52.882475  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 86581.8us
I20260709 13:18:52.881893  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:52.861356  6082 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:52.885589  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:52.886098  4143 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.886278  6082 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:52.878970  6113 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:18:52.889400  6118 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.254s	user 0.003s	sys 0.000s
I20260709 13:18:52.901829  4141 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:18:52.905395  4143 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:52.906262  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:52.906839  4290 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:52.910499  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 88381.6us
W20260709 13:18:52.927345  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67309.7us
I20260709 13:18:52.933048  4290 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:52.937475  4295 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:52.969982  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 57519.8us
I20260709 13:18:52.974602  4261 leader_election.cc:400] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:18:52.977173  4261 leader_election.cc:403] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:52.981487  4186 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:52.984570  4142 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:52.995456  6104 raft_consensus.cc:993] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:52.995810  5979 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:18:52.996052  6104 raft_consensus.cc:1081] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:52.991081  5909 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:52.992787  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:52.980167  6082 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:53.010015  5909 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:53.011371  5909 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.015079  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:53.020323  6045 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:53.021276  6045 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:53.022608  6045 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:53.051218  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49654.7us
I20260709 13:18:53.051671  6141 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.053016  5757 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:53.054162  4292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:53.054915  4292 raft_consensus.cc:606] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:53.055341  4292 raft_consensus.cc:614] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:53.054921  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:53.059330  4221 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.062884  4147 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:53.062350  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:53.066383  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 121581us
I20260709 13:18:53.064749  5979 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:53.088587  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 133606us
I20260709 13:18:53.071985  5979 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.122154  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:53.100193  6093 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:53.137374  4292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6478d83fa954184a297fb7466378df1"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:53.110569  4216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c130eddd78204cee994818f0043bf88c"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44154
I20260709 13:18:53.142876  4216 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.143469  4216 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.139787  4292 raft_consensus.cc:606] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
W20260709 13:18:53.154109  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 92510.8us
W20260709 13:18:53.154731  6138 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:18:53.157841  6116 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.162456  4142 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:53.125205  5979 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.164037  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:53.127583  5738 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:53.130698  5879 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:53.131894  6139 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:53.199661  4187 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:18:53.204216  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 127989us
I20260709 13:18:53.169728  6116 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.206610  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:53.174331  6066 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:53.193274  5865 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:53.175474  6093 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.215691  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:53.217772  6093 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:53.215867  6047 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:53.220543  6047 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:53.222081  6066 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.223336  6047 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:53.197324  6049 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.210759  5975 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:53.210327  6139 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:53.274682  6049 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:53.275556  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50319.9us
I20260709 13:18:53.275375  6139 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:53.277578  6066 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.202646  5879 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.228278  5738 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:53.278502  5979 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:53.281147  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81551.1us
I20260709 13:18:53.281759  6045 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.234011  5865 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:53.289006  4287 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.292423  4290 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:53.295367  4216 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:53.302131  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 65036.2us
I20260709 13:18:53.314296  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:53.317978  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:53.323423  4287 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:53.324815  4216 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:53.327836  4145 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:53.322887  5773 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:53.332285  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:53.332917  4139 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.333608  6086 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:53.333853  5879 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.332379  5773 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.336884  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:53.296993  5738 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.361443  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:53.348047  6116 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:53.333629  6149 raft_consensus.cc:1064] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:53.345299  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:53.350373  5773 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.367026  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:53.350770  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:53.356843  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:53.359527  4139 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:53.368010  4927 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.348148  5865 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.372805  5738 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.366137  6104 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:53.375957  5979 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:53.376502  6140 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:53.377105  6140 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.379258  6140 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.380612  4221 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:53.381698  6133 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:18:53.382766  6133 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:53.382790  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:53.383204  6133 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:53.394481  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:53.403358  4927 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:53.393082  4110 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:53.405699  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:53.406250  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:53.408561  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:53.407317  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:53.411216  6147 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:18:53.412720  6090 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:53.413121  5941 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:53.413643  5941 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:53.384143  6133 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.414673  5941 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:53.415201  6133 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.418666  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:53.419682  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:53.417140  5909 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:53.421756  5909 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:53.422022  6149 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:53.422812  5909 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.426986  4141 raft_consensus.cc:2368] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:18:53.433738  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:53.427852  5953 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:53.440478  5953 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.440809  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:53.444603  5953 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.450110  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:53.454891  4292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:56200
I20260709 13:18:53.455732  4292 raft_consensus.cc:606] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:53.456311  4261 leader_election.cc:400] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:18:53.456771  4261 leader_election.cc:403] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:53.459123  6133 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:18:53.464704  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:53.469053  6133 raft_consensus.cc:993] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:18:53.469762  6133 raft_consensus.cc:1081] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:18:53.473923  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:53.481419  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:53.487118  4144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52146
I20260709 13:18:53.487974  4144 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.488432  4144 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.499945  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:53.500401  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:53.513465  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:53.514253  5879 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:53.518793  5879 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:53.516240  4289 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:53.521472  4289 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:53.522662  4289 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:53.524217  4289 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.524557  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:53.514145  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:53.527143  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:53.533784  4289 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:53.538370  4221 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.535159  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:53.549358  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:53.557664  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:53.554852  4144 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.560238  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:53.566682  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:53.568488  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:53.571429  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:53.577131  4218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:18:53.584363  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:53.585583  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:53.586671  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:53.587288  4215 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.588105  4218 raft_consensus.cc:606] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:18:53.591794  4287 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.592624  4221 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:18:53.593659  4216 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:53.562639  6049 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.600648  4144 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:53.575809  5947 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:53.619743  6136 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:53.578797  6113 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:53.589498  5738 raft_consensus.cc:1027] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: attempt to promote peer b81584b21ed144698954548303f1e507: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:18:53.630621  4215 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:53.631479  4288 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:53.625185  4045 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 4 to 6, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 6 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:53.641360  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:53.642081  4144 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:53.648967  4111 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:53.653867  6082 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:53.660207  5879 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.684089  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:53.691504  6139 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.692689  6139 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:53.693876  5887 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:53.694330  5887 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:53.694712  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:53.695366  5887 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.695942  6150 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.696976  5887 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.708200  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:53.712286  4296 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.712750  4296 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:53.662716  5756 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:18:53.705161  6082 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:18:53.738536  4146 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:53.738628  6082 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.713658  4296 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.769404  6041 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:18:53.773633  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 158999us
I20260709 13:18:53.776909  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:53.818429  4045 catalog_manager.cc:5697] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 2 to 3, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:53.824708  5750 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:53.781162  6116 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.860997  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:53.855177  6041 tablet_bootstrap.cc:492] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:18:53.872802  4927 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 4 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:53.890530  6041 ts_tablet_manager.cc:1403] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.176s	user 0.039s	sys 0.020s
I20260709 13:18:53.890945  4922 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:53.899856  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:53.906834  4295 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:53.892057  5953 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:53.924749  6114 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:53.891629  6149 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:18:53.929941  6169 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:53.897608  5941 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:18:53.912781  6104 raft_consensus.cc:993] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:53.914070  6090 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.950636  6090 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:53.951795  6090 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:53.952780  6104 raft_consensus.cc:1081] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:18:53.956004  4293 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:53.981866  6041 raft_consensus.cc:359] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:53.983386  6041 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:18:53.989753  4296 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:54.001276  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 63063.3us
I20260709 13:18:54.005796  4141 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:54.013789  6041 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:54.024857  4289 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:54.029414  4289 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:54.032908  4221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6478d83fa954184a297fb7466378df1"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44154
I20260709 13:18:54.034025  4221 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:54.042951  4221 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.065721  4044 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 175) took 2604 ms. Trace:
I20260709 13:18:54.066521  4044 rpcz_store.cc:276] 0709 13:18:51.458273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.465094 (+  6821us) service_pool.cc:224] Handling call
0709 13:18:54.053880 (+2588786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:52.983119 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:52.983719 (+   600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:52.983752 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:18:52.983772 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:52.985508 (+  1736us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:52.985597 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:52.985624 (+    27us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:18:52.986944 (+  1320us) tablet.cc:701] Row locks acquired
0709 13:18:52.986968 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:18:52.987118 (+   150us) write_op.cc:270] Start()
0709 13:18:52.987403 (+   285us) write_op.cc:276] Timestamp: P: 1783603132987071 usec, L: 0
0709 13:18:52.987429 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:52.988187 (+   758us) log.cc:844] Serialized 7188 byte log entry
0709 13:18:53.377817 (+389630us) op_driver.cc:464] REPLICATION: finished
0709 13:18:53.431935 (+ 54118us) write_op.cc:301] APPLY: starting
0709 13:18:53.432017 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:53.458486 (+ 26469us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:53.461064 (+  2578us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:53.463472 (+  2408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:53.464204 (+   732us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:18:53.464256 (+    52us) write_op.cc:312] APPLY: finished
0709 13:18:53.464712 (+   456us) log.cc:844] Serialized 124 byte log entry
0709 13:18:53.466512 (+  1800us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:53.466715 (+   203us) write_op.cc:454] Released schema lock
0709 13:18:53.466779 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:53.468739 (+  1960us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:53.468776 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9259,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":53844,"apply.run_cpu_time_us":5336,"apply.run_wall_time_us":36736,"num_ops":18,"prepare.queue_time_us":55936,"prepare.run_cpu_time_us":17614,"prepare.run_wall_time_us":148787,"raft.queue_time_us":89829,"raft.run_cpu_time_us":5837,"raft.run_wall_time_us":76204,"replication_time_us":390195,"thread_start_us":211514,"threads_started":4,"wal-append.queue_time_us":227206}]]}
I20260709 13:18:54.072271  4218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:18:54.073037  4218 raft_consensus.cc:606] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Received request to transfer leadership
W20260709 13:18:54.082690  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 166596us
W20260709 13:18:54.166785  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 94196.6us
W20260709 13:18:54.177779  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 62311.2us
I20260709 13:18:54.181414  6041 ts_tablet_manager.cc:1434] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.290s	user 0.008s	sys 0.005s
I20260709 13:18:54.074537  6045 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:54.190728  6086 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:18:54.181309  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 85842.8us
I20260709 13:18:54.207127  6114 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:54.272598  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 54982.6us
W20260709 13:18:54.390905  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 275056us
W20260709 13:18:54.455029  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51547.5us
W20260709 13:18:54.468963  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 131924us
I20260709 13:18:54.475180  4216 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:54.531168  4221 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:54.477517  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-d9ed971e9cd64f17bc8646a1d19e3622 received from {username='slave'} at 127.0.0.1:54764
W20260709 13:18:54.535048  6159 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:18:54.434769  5847 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
W20260709 13:18:54.546368  6171 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:18:54.594033  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-d9ed971e9cd64f17bc8646a1d19e3622 on tablet d9ed971e9cd64f17bc8646a1d19e3622 with peer b81584b21ed144698954548303f1e507
I20260709 13:18:54.683542  4221 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:54.534741  6153 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
W20260709 13:18:54.683543  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 172472us
W20260709 13:18:54.731069  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 218488us
W20260709 13:18:54.752195  4296 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.761s	user 0.007s	sys 0.012s
W20260709 13:18:54.818603  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 186502us
I20260709 13:18:54.874095  4927 raft_consensus.cc:1217] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:18:54.879400  4296 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:54.881129  4287 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:54.827366  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 72128.5us
W20260709 13:18:54.815366  6185 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:54.890339  6195 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:54.877636  6174 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.329s	user 0.002s	sys 0.000s
I20260709 13:18:54.904773  6189 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.838912  6133 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.785782  6178 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:54.838493  6104 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.926179  6104 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:54.927186  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:54.927955  4289 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.928283  4289 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:18:54.920666  4031 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for a767a88581024d12b14e9f965193d404 already in progress
I20260709 13:18:54.929229  4289 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:54.934427  4289 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.931922  6104 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:54.955614  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:54.886386  4296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1535) took 1235 ms (client timeout 1579 ms). Trace:
I20260709 13:18:54.942194  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1391) took 1093 ms. Trace:
W20260709 13:18:54.974351  4296 rpcz_store.cc:269] 0709 13:18:53.646639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.650190 (+  3551us) service_pool.cc:224] Handling call
0709 13:18:53.975016 (+324826us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b58006d04d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec3e0aa 00007fee3ecc0447 00007fee3ecd8fe7 00007fee3ecda7de 00007fee3ece627c 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c
0709 13:18:54.881933 (+906917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183554432}
I20260709 13:18:54.939877  6133 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.067009  6133 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:55.067458  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52877.2us
I20260709 13:18:55.067739  6133 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.069589  6045 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.070436  6045 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:54.933113  6189 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.076177  6199 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.104266  4289 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:54.977317  4138 rpcz_store.cc:276] 0709 13:18:53.849037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.849191 (+   154us) service_pool.cc:224] Handling call
0709 13:18:53.849653 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.850120 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.850159 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.850692 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.038468 (+187776us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:54.043782 (+  5314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.054381 (+ 10599us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.941879 (+887498us) raft_consensus.cc:1685] finished
0709 13:18:54.941908 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.942075 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1615,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":165756,"threads_started":1,"wal-append.queue_time_us":562224}
W20260709 13:18:55.169065  4031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 250768us
I20260709 13:18:55.107442  6133 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:55.135119  6199 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:55.174664  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 286555us
W20260709 13:18:55.316501  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 321681us
I20260709 13:18:55.348366  6208 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:55.347522  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 361610us
I20260709 13:18:55.349080  6208 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:55.330317  4922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 296) took 1213 ms. Trace:
I20260709 13:18:55.352375  4922 rpcz_store.cc:276] 0709 13:18:54.090127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.092467 (+  2340us) service_pool.cc:224] Handling call
0709 13:18:54.193679 (+101212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.194392 (+   713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.194430 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.195079 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.630648 (+435569us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:54.630783 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.630881 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.252682 (+621801us) raft_consensus.cc:1685] finished
0709 13:18:55.269307 (+ 16625us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.303437 (+ 34130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5087,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"thread_start_us":396724,"threads_started":1,"wal-append.queue_time_us":517463}
I20260709 13:18:55.372083  4147 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:55.372862  4147 pending_rounds.cc:85] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 2
I20260709 13:18:55.373199  4147 pending_rounds.cc:107] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:55.373612  4147 raft_consensus.cc:2889] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:55.383548  6111 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.384372  6111 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:55.132917  5847 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:55.170070  6180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.003s	sys 0.029s
I20260709 13:18:55.138281  6186 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.420077  6190 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.421631  6190 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.420603  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:55.171129  6195 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.266069  6045 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:18:55.415597  6180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.007s	sys 0.051s
W20260709 13:18:55.541780  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 191091us
I20260709 13:18:55.417035  5847 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:55.552614  6112 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.351543  6199 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:55.556502  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.557386  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.387004  6111 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:55.565097  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 139476us
I20260709 13:18:55.484189  6190 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:55.543517  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:55.573264  6189 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:55.574086  6189 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.574628  6189 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.573433  6208 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:55.493553  6195 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.491876  6186 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.561514  6139 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.565233  6199 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.633733  5953 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.594965  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 297) took 1499 ms. Trace:
I20260709 13:18:55.561942  6112 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.769827  6190 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.796597  5953 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.599653  6208 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.788586  5847 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:55.785538  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:55.774899  6139 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.776587  6199 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.808104  6207 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.812202  6220 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.846127  4138 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.843663  6223 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.824157  6190 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.833485  6208 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.858512  6219 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.867935  6133 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:55.867408  6224 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.870671  6226 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.873626  6212 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:55.880950  6104 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.807859  4920 rpcz_store.cc:276] 0709 13:18:54.090440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.092546 (+  2106us) service_pool.cc:224] Handling call
0709 13:18:54.461747 (+369201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.609350 (+147603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.621807 (+ 12457us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.066380 (+444573us) log.cc:844] Serialized 556 byte log entry
0709 13:18:55.288904 (+222524us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:55.299938 (+ 11034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.312155 (+ 12217us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.571638 (+259483us) raft_consensus.cc:1685] finished
0709 13:18:55.576433 (+  4795us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.589346 (+ 12913us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":138556,"threads_started":1,"wal-append.queue_time_us":282403}
I20260709 13:18:55.858975  6207 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.878981  6187 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.900103  6189 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:55.892385  6177 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.890702  6201 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.872262  6220 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.900537  6166 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.905077  6212 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.922513  6177 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:55.930773  6228 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:55.933072  6202 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
I20260709 13:18:55.922783  6201 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:55.897230  6045 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.904932  6226 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.895078  6214 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.063676  4213 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:55.920635  6187 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.068145  6208 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.068454  6218 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.068890  6208 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.069180  6218 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:56.069439  6208 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.070658  6187 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.070763  6177 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:55.906672  6133 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.971318  6062 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.901772  6223 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:55.937170  6215 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.258s	user 0.000s	sys 0.002s
I20260709 13:18:55.891711  6219 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:56.107151  4892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.011s	sys 0.018s
W20260709 13:18:56.139281  4892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.015s	sys 0.018s
W20260709 13:18:56.113798  4262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.000s	sys 0.032s
W20260709 13:18:56.140331  4262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.001s	sys 0.032s
I20260709 13:18:56.058548  6139 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:55.919929  6165 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.081740  5953 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.082048  6112 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:55.909296  6104 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:55.924589  6153 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:55.972882  6190 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.082705  6208 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:55.936687  6207 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.129171  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.050151  6086 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.063258  5909 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.040536  5881 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.076679  6195 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:55.972083  6049 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:55.899020  6224 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:56.170807  4259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.036s	sys 0.021s
I20260709 13:18:56.081496  6186 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.071844  6218 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.183034  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.195796  4294 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:56.187664  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.188417  6229 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.189141  6233 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.113788  6166 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.209343  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.115625  6228 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.115406  6045 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:56.194049  4259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.036s	sys 0.021s
I20260709 13:18:56.196756  4217 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:56.188280  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.177768  6187 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.200371  6111 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.197556  5953 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.223341  6111 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.195096  6049 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.195696  6199 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.199167  5909 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.169176  6165 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:56.215284  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.183015  6190 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.217887  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.219274  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.217664  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:56.219748  6220 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:56.220886  6224 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.222560  6045 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.223917  5953 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.177495  6153 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.073128  6214 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.207998  6104 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.394357  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.283035  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.131819  6062 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.208716  6082 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:18:56.442114  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 224499us
I20260709 13:18:56.170625  6133 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.392766  5776 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:56.439018  5847 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.446841  6049 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.447512  6126 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.448199  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.226220  6111 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:56.396109  4138 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.001s
I20260709 13:18:56.216734  6208 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:56.467311  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.194424  5881 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.392153  6165 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.395720  6201 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.392578  6186 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.392304  5909 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.194150  6086 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.517725  6213 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:56.518083  6133 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:56.393204  6230 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.392819  6226 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.391731  6223 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.440814  6194 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.215111  6233 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.480149  6191 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.480997  6234 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.496166  5847 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.456287  6112 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.233083  6187 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.392382  6190 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.506896  6195 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.480492  6045 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:56.513309  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.213472  6229 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.505734  5776 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.506906  6126 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.516219  6231 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.516585  6140 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.583635  6124 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.497735  6199 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.480747  6176 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:56.575578  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.581115  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.502465  4138 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:56.583890  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.639127  4294 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:18:56.509673  6104 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.642264  6104 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.642808  6166 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.605270  6112 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.620206  6045 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.479563  6082 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.522523  6049 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:56.605149  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 137597us
I20260709 13:18:56.606207  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.607563  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.518741  6086 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.518427  6213 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.516520  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.672583  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.641760  5953 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.511087  6208 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.564800  6230 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.686633  6208 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:56.586086  6224 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.687783  6230 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.524909  6186 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.585222  6220 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.599668  6133 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.608242  6036 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.605017  6226 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.637475  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.661212  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.664886  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.668375  5879 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.667429  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:56.663013  5947 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.671648  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.668848  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.620725  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:56.678362  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.636379  6124 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.685081  5923 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:56.631894  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.591728  6113 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.663553  6166 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:56.725656  6104 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:56.725971  6166 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.693440  6164 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.665009  6212 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.649430  6062 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.665616  4296 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:56.704659  6230 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.763407  6230 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.766595  6235 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.585839  6194 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.710275  6086 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.670854  6228 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.705770  4288 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:56.710577  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.646718  6199 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.628859  6231 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.601078  6191 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.714232  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.723966  4292 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:56.636090  6195 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.638219  6140 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.724962  6162 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.724562  5947 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.637001  6176 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.810758  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:56.723336  4294 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:18:56.675875  6219 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:56.729856  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 62463.5us
I20260709 13:18:56.693198  5776 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:56.690388  5941 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:56.707159  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 88237.6us
I20260709 13:18:56.721810  5879 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.730947  6113 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.767441  6235 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.743073  5881 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.744860  6082 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.717289  6133 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.670964  6049 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.816066  6176 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.709283  6220 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.755136  6186 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.758131  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.609001  6234 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.860204  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:56.707888  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 181205us
I20260709 13:18:56.668406  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1415) took 1079 ms. Trace:
I20260709 13:18:56.788014  4217 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 1.
I20260709 13:18:56.788937  6238 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.789485  6187 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.789830  6233 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.790417  6112 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.729013  6239 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.806510  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.775028  6062 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.714010  6226 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.811900  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.819715  4291 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:18:56.811457  4927 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:56.710568  5887 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.822597  6241 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.824543  4141 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:56.825534  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.911785  4289 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:56.729465  5923 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.823581  5941 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.803377  6214 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:56.828401  4215 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:56.829138  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.921005  4294 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:56.798893  5950 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.834571  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.692960  6224 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.842607  4112 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:56.843436  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:56.851873  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:56.925844  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83460.8us
I20260709 13:18:56.926185  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.926366  4213 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:56.791673  6086 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.926932  4222 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:56.916911  6233 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.868191  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.869357  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.726342  6036 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:56.873270  4138 rpcz_store.cc:276] 0709 13:18:55.579638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.582957 (+  3319us) service_pool.cc:224] Handling call
0709 13:18:56.647893 (+1064936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.931892  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.933750  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.934006  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.883669  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.840018  5847 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.885358  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1413) took 1321 ms. Trace:
I20260709 13:18:56.899237  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.901870  4220 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:18:56.903491  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.910072  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.881609  6190 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:56.919376  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 124833us
I20260709 13:18:56.734448  6164 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.922119  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:56.922869  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.823733  6219 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:56.891993  6126 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.922881  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:56.929682  4142 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:56.830427  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:56.931906  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.937851  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.911226  6241 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.939674  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.965595  4185 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:56.937909  4140 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:56.913015  6195 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:56.915234  6045 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:56.935020  4145 rpcz_store.cc:276] 0709 13:18:55.564014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.564150 (+   136us) service_pool.cc:224] Handling call
0709 13:18:55.564676 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.871630 (+306954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.871680 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.871744 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:55.871808 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.885069 (+1013261us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400021cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:56.885128 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.885291 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705072000}
I20260709 13:18:56.970055  6231 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:56.958657  6228 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:56.970840  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.941641  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:56.815789  6162 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.971194  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:56.994987  5757 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.994690  4294 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:57.000198  5757 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.918111  5887 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.002208  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.002969  4289 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:18:56.996488  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.005158  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.000627  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.007906  6231 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:57.008397  6231 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:57.008800  6231 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.009898  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.962298  6219 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.011206  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.011579  6213 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:57.011844  5887 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.008710  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.013577  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.012274  6219 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.974330  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.020843  4288 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:56.921051  6140 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.024560  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1414) took 1457 ms. Trace:
I20260709 13:18:56.940590  6233 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.974838  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.975348  6237 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:56.970733  6245 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:18:56.926853  6229 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:56.935917  6211 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.232s	user 0.007s	sys 0.011s
I20260709 13:18:56.978219  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.979660  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.936378  6243 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:56.980316  5941 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.981047  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:56.937822  5879 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:56.982560  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:56.983741  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.984568  6120 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:56.985854  5923 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:56.987627  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:56.958214  6240 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:56.932898  6047 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:56.913575  6062 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:56.973157  5909 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:18:57.016269  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 74702.2us
I20260709 13:18:56.965816  4142 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:56.973455  6241 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.004241  5757 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.025194  4147 rpcz_store.cc:276] 0709 13:18:55.567201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.567434 (+   233us) service_pool.cc:224] Handling call
0709 13:18:55.567830 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.934637 (+366807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.934675 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.934726 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:55.934764 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.024171 (+1089407us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400285854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:57.024249 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.024486 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842854272}
I20260709 13:18:56.907796  6239 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.017594  6242 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 13:18:56.883688  6238 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.236827  6191 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.195293  6230 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:57.379812  6047 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.380738  6047 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.131547  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.223716  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.213276  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.195585  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.144627  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.382200  4145 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:56.931852  5950 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:57.391274  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.399340  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.383193  4213 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:57.400125  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.387025  4144 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:57.392021  4140 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
W20260709 13:18:57.222494  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 205508us
I20260709 13:18:57.403257  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.038765  6166 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:57.408452  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.401153  4147 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:57.403862  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.382644  6049 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:57.405650  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1638) took 1329 ms. Trace:
I20260709 13:18:57.405798  6235 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:57.413513  4214 rpcz_store.cc:276] 0709 13:18:56.072820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.073093 (+   273us) service_pool.cc:224] Handling call
0709 13:18:57.401683 (+1328590us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:18:57.401886 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.402110 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.402136 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.402184 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:57.402225 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.402283 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.402398 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54103296}
I20260709 13:18:57.347752  6090 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:57.410197  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.023138  6113 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.352636  5887 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:57.415071  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.380002  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.417747  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.239420  6233 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:57.220775  6163 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:57.411362  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.235445  6209 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:57.144546  6036 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.047369  6234 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.422518  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.488867  4218 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
W20260709 13:18:57.489789  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 70011.9us
I20260709 13:18:57.418280  4143 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:57.490099  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.494223  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.494856  4218 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:57.354694  6124 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.415589  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:57.496531  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.457886  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.496034  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:57.497377  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 88131.7us
I20260709 13:18:57.497592  4213 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:18:57.498307  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:57.380859  6120 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:57.413029  6082 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:57.498665  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.502887  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.503544  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.506393  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:57.509467  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:57.510802  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.511127  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.404287  5909 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:57.513796  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.514415  6247 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:57.514654  6132 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:57.515440  6238 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.505540  6220 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:57.491961  5950 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.517994  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.519428  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.502534  6234 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:57.502810  6140 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:57.506713  6166 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:57.512809  6164 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.526998  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:57.201190  6237 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:57.414237  6240 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:57.516669  6066 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:57.610177  6066 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.610993  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.529313  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.533391  6234 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:57.612556  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.612761  6234 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.613220  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.492897  5887 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.532022  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.532240  4214 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:57.496763  6163 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:57.499954  6090 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.620072  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.393772  6243 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:57.533082  6250 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.506s	user 0.000s	sys 0.002s
I20260709 13:18:57.628963  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.630048  4292 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:18:57.630612  6243 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:57.631093  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.631835  6066 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.613241  4923 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:18:57.533469  6132 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:57.633432  6132 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.511878  6082 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:57.532065  6231 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.003s
I20260709 13:18:57.631767  4287 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:18:57.707806  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.708882  4292 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
W20260709 13:18:57.603194  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76285.6us
I20260709 13:18:57.528036  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.716955  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.529685  5881 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:57.711709  4219 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:18:57.520955  6133 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:57.723124  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.713053  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1633) took 1669 ms. Trace:
I20260709 13:18:57.499662  6209 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.604775  6166 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:57.621526  6045 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:57.720046  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 191248us
I20260709 13:18:57.534451  6197 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.185s
I20260709 13:18:57.728320  6062 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.601994  6140 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:57.733513  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 219992us
I20260709 13:18:57.736732  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:57.738373  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:18:57.733842  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.723934  4221 rpcz_store.cc:276] 0709 13:18:56.043624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.062787 (+ 19163us) service_pool.cc:224] Handling call
0709 13:18:56.063988 (+  1201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.226869 (+162881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.226901 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.226950 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:56.226988 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.712680 (+1485692us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400215054. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:57.712750 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.712963 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375548672}
I20260709 13:18:57.722536  6090 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.740891  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1567) took 1299 ms. Trace:
I20260709 13:18:57.721352  5881 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:57.743677  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1565) took 1348 ms. Trace:
I20260709 13:18:57.744050  4221 rpcz_store.cc:276] 0709 13:18:56.441421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.739703 (+1298282us) service_pool.cc:224] Handling call
0709 13:18:57.740027 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.740232 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.740263 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.740310 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:57.740402 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.740703 (+   301us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.740827 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.744787  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:18:57.730419  6166 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.750702  5649 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.750867  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:57.755594  5649 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.752758  4215 rpcz_store.cc:276] 0709 13:18:56.394975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.733370 (+1338395us) service_pool.cc:224] Handling call
0709 13:18:57.743136 (+  9766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.743346 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.743370 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.743412 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.743464 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.743516 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.743620 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.726104  6162 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.730199  6045 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:57.755836  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.756067  5649 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.755862  4139 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:18:57.718964  6231 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:57.759191  5887 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.533285  6247 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:57.766047  6240 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:57.763533  4287 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:57.760107  6237 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:57.761807  6140 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.735617  5909 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:57.767308  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.762763  6219 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:57.776000  6219 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:57.767622  6045 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.737289  6133 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:57.774912  6082 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:57.777470  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.755213  5881 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:57.789429  4922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 312) took 1092 ms. Trace:
I20260709 13:18:57.790045  4922 rpcz_store.cc:276] 0709 13:18:56.697522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.701810 (+  4288us) service_pool.cc:224] Handling call
0709 13:18:57.788374 (+1086564us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:18:57.788674 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.788930 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.788967 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.789023 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:57.789084 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.789174 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.789350 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3847552}
I20260709 13:18:57.764225  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:57.793926  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1554) took 1161 ms. Trace:
I20260709 13:18:57.794845  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.776501  6219 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.794399  4290 rpcz_store.cc:276] 0709 13:18:56.632497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.726726 (+ 94229us) service_pool.cc:224] Handling call
0709 13:18:57.792400 (+1065674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.792672 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.792697 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.792746 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:57.792796 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.792856 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.793700 (+   844us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400288f50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:57.793825 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449843456}
I20260709 13:18:57.795039  6209 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.749807  6253 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:57.781113  4259 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:18:57.789484  4291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1562) took 1182 ms (client timeout 1504 ms). Trace:
W20260709 13:18:57.800864  4291 rpcz_store.cc:269] 0709 13:18:56.607506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.607627 (+   121us) service_pool.cc:224] Handling call
0709 13:18:57.789243 (+1181616us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b5400288f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:57.789397 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221132032}
W20260709 13:18:57.808565  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45782.2us
I20260709 13:18:57.806141  6195 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:57.810050  6195 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:57.810526  6195 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:57.811452  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1555) took 1178 ms. Trace:
I20260709 13:18:57.811908  4296 rpcz_store.cc:276] 0709 13:18:56.632772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.775583 (+142811us) service_pool.cc:224] Handling call
0709 13:18:56.775953 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.972537 (+196584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.972573 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.972619 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:56.972657 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.811137 (+838480us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54002d64d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:57.811205 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.811363 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451426048}
I20260709 13:18:57.813678  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.815882  6239 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.817032  6120 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:57.795779  6163 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:57.798110  6133 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:57.824810  6199 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:57.832389  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.884650  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1559) took 1491 ms. Trace:
I20260709 13:18:57.885207  4217 rpcz_store.cc:276] 0709 13:18:56.393246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.936929 (+543683us) service_pool.cc:224] Handling call
0709 13:18:56.988703 (+ 51774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.019462 (+ 30759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.019493 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.019539 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:57.019578 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.837782 (+818204us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b5400181354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:57.837865 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.884558 (+ 46693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70105472}
W20260709 13:18:57.888942  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 75847.2us
I20260709 13:18:57.888458  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.804848  6253 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:57.899734  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.911190  4291 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
I20260709 13:18:57.897084  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.897583  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.932567  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.911489  6253 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.019419  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:57.898208  6163 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:58.029371  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.047837  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.032327  4290 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:57.932158  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:58.076200  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:18:58.073297  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 183332us
I20260709 13:18:58.082918  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.079087  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.087031  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.107097  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.108412  6252 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.109037  6252 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.109514  6252 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.139314  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.140516  4291 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:58.141959  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.142846  4288 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:58.144623  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:57.888669  5757 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.021754  5756 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:58.017717  5909 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:58.153487  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:58.204877  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.208916  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:58.212713  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.222396  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.219586  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1563) took 1825 ms. Trace:
I20260709 13:18:58.146422  4288 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:58.258177  4293 raft_consensus.cc:2410] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:58.251653  4290 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:58.265926  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1556) took 1692 ms. Trace:
I20260709 13:18:58.235080  5649 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.158195  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:18:58.269798  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 155908us
I20260709 13:18:58.258658  4214 rpcz_store.cc:276] 0709 13:18:56.394274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.627519 (+1233245us) service_pool.cc:224] Handling call
0709 13:18:57.628157 (+   638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.723331 (+ 95174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.723384 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.733706 (+ 10322us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.894550 (+160844us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.894610 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.894715 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.219332 (+324617us) raft_consensus.cc:1685] finished
0709 13:18:58.219358 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.219520 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83797,"raft.queue_time_us":90083,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":5385,"thread_start_us":113242,"threads_started":1,"wal-append.queue_time_us":315112}
I20260709 13:18:58.272629  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1650) took 1307 ms. Trace:
I20260709 13:18:58.273061  4217 rpcz_store.cc:276] 0709 13:18:56.964740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.271293 (+1306553us) service_pool.cc:224] Handling call
0709 13:18:58.271858 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.272238 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.272267 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.272313 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.272385 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.272444 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.272563 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.274825  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 235) took 1276 ms. Trace:
I20260709 13:18:58.276723  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:58.277266  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1470) took 1409 ms. Trace:
I20260709 13:18:58.277714  4143 rpcz_store.cc:276] 0709 13:18:56.867722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.867867 (+   145us) service_pool.cc:224] Handling call
0709 13:18:58.277047 (+1409180us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400286c54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:58.277186 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124255616}
I20260709 13:18:58.188392  6062 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.278949  6062 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.266607  4295 rpcz_store.cc:276] 0709 13:18:56.573492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.591899 (+ 18407us) service_pool.cc:224] Handling call
0709 13:18:56.592456 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.879406 (+286950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.879437 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.879483 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:56.879526 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.265542 (+1386016us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400288a54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.265672 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.265849 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659314944}
I20260709 13:18:58.279382  6062 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.203258  6066 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:58.281495  6066 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.281809  6066 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.219264  5756 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.283085  4921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 303) took 1480 ms. Trace:
I20260709 13:18:58.223989  6231 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:58.256947  6176 consensus_meta.cc:287] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.383s	user 0.026s	sys 0.032s
I20260709 13:18:58.221715  5909 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:58.209923  6255 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:18:58.216180  6241 consensus_meta.cc:287] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.000s
I20260709 13:18:58.285283  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1563) took 1575 ms. Trace:
I20260709 13:18:58.285633  4215 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.286339  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.293205  5649 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.294307  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.296401  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:58.308022  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1577) took 1518 ms. Trace:
I20260709 13:18:58.075821  6163 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.312028  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:18:58.268602  6047 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.881s	user 0.006s	sys 0.006s
I20260709 13:18:58.308554  4294 rpcz_store.cc:276] 0709 13:18:56.789347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.306747 (+1517400us) service_pool.cc:224] Handling call
0709 13:18:58.307090 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.307295 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.307321 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.307365 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:58.307402 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.307474 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.307907 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.313692  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:58.314538  5649 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.322999  5649 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.288002  5947 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.323559  5649 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.322404  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1566) took 1572 ms. Trace:
W20260709 13:18:58.294667  6132 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.544s	user 0.025s	sys 0.025s
I20260709 13:18:58.327381  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:58.329298  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:58.328480  4186 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:58.286532  5756 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.320299  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1568) took 1569 ms. Trace:
I20260709 13:18:58.219133  5757 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.344074  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.301007  4289 rpcz_store.cc:276] 0709 13:18:56.709854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.263354 (+1553500us) service_pool.cc:224] Handling call
0709 13:18:58.284748 (+ 21394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.284949 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.284973 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.285010 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.285052 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.285110 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.285225 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.291863  5909 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.322304  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1578) took 1532 ms. Trace:
I20260709 13:18:58.362090  4294 rpcz_store.cc:276] 0709 13:18:56.789843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.321423 (+1531580us) service_pool.cc:224] Handling call
0709 13:18:58.321726 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.321946 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.321978 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.322023 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.322066 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.322121 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.322242 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.324442  4290 rpcz_store.cc:276] 0709 13:18:56.749730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.264328 (+1514598us) service_pool.cc:224] Handling call
0709 13:18:58.321688 (+ 57360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.321956 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.322000 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.322061 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:58.322109 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.322185 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.322328 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.359128  4293 rpcz_store.cc:276] 0709 13:18:56.750890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.264012 (+1513122us) service_pool.cc:224] Handling call
0709 13:18:58.319489 (+ 55477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.319789 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.319831 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.319891 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.319952 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.320029 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.320204 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.268839  6199 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.316828  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1562) took 1617 ms. Trace:
I20260709 13:18:58.365628  4291 rpcz_store.cc:276] 0709 13:18:56.699919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.262995 (+1563076us) service_pool.cc:224] Handling call
0709 13:18:58.315968 (+ 52973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.316277 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.316315 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.316436 (+   121us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:58.316500 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.316578 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.316742 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.284487  6207 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:58.358179  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:18:58.361302  6147 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:58.324692  6243 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:58.325078  6238 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:58.388708  6238 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.389525  6238 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.287361  5881 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.370649  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:58.285388  6045 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.338996  5947 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.275170  4217 rpcz_store.cc:276] 0709 13:18:56.998596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.273977 (+1275381us) service_pool.cc:224] Handling call
0709 13:18:58.274302 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.274499 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.274524 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.274567 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.274605 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.274657 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.274769 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.401621  4217 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:58.338591  6218 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.315131  6241 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.289470  6176 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.294574  6252 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:18:58.399581  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.380002  6126 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:58.380847  6147 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:58.326493  6047 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.330335  6132 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.372138  6082 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:18:58.411280  4220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1562) took 2005 ms (client timeout 1965 ms). Trace:
I20260709 13:18:58.379189  6231 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.418964  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:58.379622  6243 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:58.421588  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:58.430979  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.378558  6207 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.426853  4216 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:58.447482  4927 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:18:58.433063  4928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 314) took 1720 ms. Trace:
I20260709 13:18:58.452996  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:18:58.452777  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.405190  5879 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:58.454599  4892 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:58.453981  4928 rpcz_store.cc:276] 0709 13:18:56.712924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.713072 (+   148us) service_pool.cc:224] Handling call
0709 13:18:58.432087 (+1719015us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:18:58.432322 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.432557 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.432583 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.432645 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.432706 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.432787 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.432939 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732928}
I20260709 13:18:58.436069  5649 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.379873  6199 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.407709  5757 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.452682  4293 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:58.484592  4214 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:58.455207  4220 rpcz_store.cc:269] 0709 13:18:56.394017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.394087 (+    70us) service_pool.cc:224] Handling call
0709 13:18:58.398865 (+2004778us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54002ee354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:58.399014 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998785408}
I20260709 13:18:58.461133  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:58.417799  6247 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.415495  6126 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.422297  6139 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.530117  4222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:18:58.493768  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:58.426203  6252 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.537333  6252 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:58.537448  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43835.4us
I20260709 13:18:58.427451  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.538329  4222 raft_consensus.cc:606] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:18:58.283624  4921 rpcz_store.cc:276] 0709 13:18:56.802541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.847350 (+ 44809us) service_pool.cc:224] Handling call
0709 13:18:56.936826 (+ 89476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.531264 (+594438us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:57.756331 (+225067us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.281198 (+524867us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b1800206980. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3e88a4bc 00007fee3bbd848b 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a
0709 13:18:58.281454 (+   256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.281515 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.281589 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.282626 (+  1037us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54006e0354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.282687 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.282868 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":195308,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":3227,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":95,"spinlock_wait_cycles":1294617600,"thread_start_us":159500,"threads_started":2,"wal-append.queue_time_us":187250}
I20260709 13:18:58.539465  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44140 (request call id 73) took 1857 ms. Trace:
I20260709 13:18:58.519574  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1404) took 4100 ms. Trace:
I20260709 13:18:58.540872  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.542037  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.540017  4222 rpcz_store.cc:276] 0709 13:18:56.682121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.529965 (+1847844us) service_pool.cc:224] Handling call
0709 13:18:58.539359 (+  9394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.488895  6201 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:58.537472  6224 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:58.544409  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.540092  4141 rpcz_store.cc:276] 0709 13:18:54.396534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.396729 (+   195us) service_pool.cc:224] Handling call
0709 13:18:56.521446 (+2124717us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b5800001298. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:18:56.521770 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.911550 (+389780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.496620 (+1585070us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400396cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.496841 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712173568}
I20260709 13:18:58.519759  6241 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.545953  6176 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.495188  5947 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:58.457010  6243 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.543527  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.547430  6163 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.547848  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.548642  4141 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:18:58.548112  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.521606  6132 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.521549  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:18:58.523320  4927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42928 (request call id 164) took 1622 ms (client timeout 1821 ms). Trace:
I20260709 13:18:58.526360  6199 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.527000  6126 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.475026  5909 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.490207  6082 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.529726  6047 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:58.502969  6166 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.017s
I20260709 13:18:58.530383  6139 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.423982  6086 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.426999  6147 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.588590  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.530956  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1646) took 2063 ms. Trace:
I20260709 13:18:58.478915  6218 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.532492  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.595772  4287 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.590813  4216 rpcz_store.cc:276] 0709 13:18:56.467743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.743496 (+1275753us) service_pool.cc:224] Handling call
0709 13:18:57.743784 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.453191 (+709407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.530675 (+ 77484us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54002f5154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.530865 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570307840}
I20260709 13:18:58.596989  6153 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.478173  6231 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.499248  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.518565  4926 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:58.538622  4291 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:58.520522  4924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 304) took 1675 ms. Trace:
W20260709 13:18:58.553596  4927 rpcz_store.cc:269] 0709 13:18:56.900583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.921780 (+ 21197us) service_pool.cc:224] Handling call
0709 13:18:58.523057 (+1601277us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540062cfd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:58.523220 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3469422336}
W20260709 13:18:58.477890  6219 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.672s	user 0.006s	sys 0.007s
I20260709 13:18:58.544301  6201 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:18:58.479532  6234 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.866s	user 0.007s	sys 0.007s
I20260709 13:18:58.475456  5756 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.573091  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.575306  5909 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.573863  5649 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.487918  6207 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.488119  5757 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:58.577035  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:58.621098  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 232) took 1816 ms. Trace:
I20260709 13:18:58.577441  6062 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.628916  5881 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.584755  6166 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.630127  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1581) took 1174 ms. Trace:
I20260709 13:18:58.630927  6062 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.631372  6166 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.608165  4924 rpcz_store.cc:276] 0709 13:18:56.826033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.900009 (+ 73976us) service_pool.cc:224] Handling call
0709 13:18:58.425795 (+1525786us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbdeee 0000000000375939 00007fee43c311e0 00007fee43cfa0c4 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:18:58.426085 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.426424 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.430364 (+  3940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.434292 (+  3928us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:58.452953 (+ 18661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.477705 (+ 24752us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.495092 (+ 17387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21340032}
I20260709 13:18:58.578663  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.636993  6226 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:18:58.607718  4219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1656) took 1610 ms (client timeout 1755 ms). Trace:
W20260709 13:18:58.638155  4219 rpcz_store.cc:269] 0709 13:18:56.996994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.399752 (+402758us) service_pool.cc:224] Handling call
0709 13:18:58.607498 (+1207746us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400181854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:58.607646 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537380736}
I20260709 13:18:58.608855  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1665) took 1119 ms. Trace:
W20260709 13:18:58.639998  4187 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.029s
I20260709 13:18:58.616184  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1579) took 1826 ms. Trace:
I20260709 13:18:58.640535  4289 rpcz_store.cc:276] 0709 13:18:56.790199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.360522 (+1570323us) service_pool.cc:224] Handling call
0709 13:18:58.393293 (+ 32771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.529228 (+135935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.529264 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.529311 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.529359 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.615842 (+ 86483us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400278dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.615912 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.616106 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311994112}
I20260709 13:18:58.642096  6082 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.642294  4287 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:58.620545  6234 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.609586  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.644788  6133 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.645192  6234 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.645473  6133 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:58.645536  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.646507  4215 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:58.647051  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.647897  4291 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:58.648288  4216 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:58.648594  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1573) took 1238 ms. Trace:
I20260709 13:18:58.647063  6133 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.621656  4221 rpcz_store.cc:276] 0709 13:18:56.804498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.762687 (+958189us) service_pool.cc:224] Handling call
0709 13:18:58.613481 (+850794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.613741 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.613773 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.613822 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.613862 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.613918 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.620832 (+  6914us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400181850. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:58.621012 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955696000}
I20260709 13:18:58.630520  4294 rpcz_store.cc:276] 0709 13:18:57.455316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.629191 (+1173875us) service_pool.cc:224] Handling call
0709 13:18:58.629540 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.629757 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.629796 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.629841 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:58.629888 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.629956 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.630068 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.650065  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:58.625059  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:58.587631  6139 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.619998  5909 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.626683  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1571) took 1216 ms. Trace:
W20260709 13:18:58.653774  4187 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.014s	sys 0.030s
I20260709 13:18:58.624788  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:58.653968  4290 rpcz_store.cc:276] 0709 13:18:57.409931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.615284 (+1205353us) service_pool.cc:224] Handling call
0709 13:18:58.626121 (+ 10837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.626331 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.626356 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.626399 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:58.626427 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.626482 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.626620 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:58.627130  6195 consensus_meta.cc:287] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.816s	user 0.018s	sys 0.030s
I20260709 13:18:58.617322  6219 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.627923  6045 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.615126  5756 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:58.639488  4214 rpcz_store.cc:276] 0709 13:18:57.489373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.339458 (+850085us) service_pool.cc:224] Handling call
0709 13:18:58.372898 (+ 33440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.485275 (+112377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.608605 (+123330us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002f0654. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.608793 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256119680}
I20260709 13:18:58.598345  4293 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:18:58.660034  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:58.648653  6226 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:58.649150  4291 rpcz_store.cc:276] 0709 13:18:57.410402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.614711 (+1204309us) service_pool.cc:224] Handling call
0709 13:18:58.647706 (+ 32995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.648297 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.648531 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.617503  6201 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:58.654271  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 539624us
I20260709 13:18:58.627066  5757 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.674430  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:58.672874  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1664) took 1259 ms. Trace:
I20260709 13:18:58.675938  4215 rpcz_store.cc:276] 0709 13:18:57.413860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.302789 (+888929us) service_pool.cc:224] Handling call
0709 13:18:58.327556 (+ 24767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.646933 (+319377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.672507 (+ 25574us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54000271d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.672778 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732994944}
W20260709 13:18:58.678470  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 200122us
W20260709 13:18:58.685532  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 188334us
I20260709 13:18:58.648311  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:58.687484  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1573) took 1925 ms. Trace:
I20260709 13:18:58.691638  4295 rpcz_store.cc:276] 0709 13:18:56.761945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.279600 (+1517655us) service_pool.cc:224] Handling call
0709 13:18:58.279951 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.280384 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.280411 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.281008 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.565210 (+284202us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:58.686745 (+121535us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.687148 (+   403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.687229 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.687269 (+    40us) raft_consensus.cc:1685] finished
0709 13:18:58.687280 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.687417 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":840,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":404805,"threads_started":2,"wal-append.queue_time_us":284177}
I20260709 13:18:58.664752  5756 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.690378  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:58.700449  6066 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.700855  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.691042  4892 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:58.702941  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.669685  6226 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.704478  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.670779  6082 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.707958  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:58.679050  6062 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.712411  4145 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:58.709914  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.717129  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:18:58.717689  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:58.710482  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:58.714337  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.719646  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.721580  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:58.723724  4139 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:58.725373  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:58.725710  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.725859  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.664165  6195 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.729976  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:18:58.733759  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:58.736140  4295 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:58.738739  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.667974  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:58.739872  4295 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.694801  6133 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.712690  6199 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.710656  6226 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.749022  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.756618  4293 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.716476  6221 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.716400  6045 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:58.753630  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 114099us
I20260709 13:18:58.716677  6104 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:58.757577  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:58.727347  6116 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.762182  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:58.763026  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:58.763808  4292 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:58.767356  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:58.732249  6224 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:58.736776  6228 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.769053  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.773998  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:58.778659  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:58.752974  6245 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:58.716825  6082 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.759871  6163 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:58.723172  6062 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.756059  6199 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.787776  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.773218  6243 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.790239  6104 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:58.790884  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.791779  6219 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.794071  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1564) took 2082 ms. Trace:
I20260709 13:18:58.799290  6082 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:58.790930  6066 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.760545  6045 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:58.809156  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.759721  6194 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:58.838054  4288 rpcz_store.cc:276] 0709 13:18:56.711899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.272139 (+1560240us) service_pool.cc:224] Handling call
0709 13:18:58.291560 (+ 19421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.291880 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.291908 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.318340 (+ 26432us) log.cc:844] Serialized 556 byte log entry
0709 13:18:58.703881 (+385541us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:58.703942 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.704023 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.793728 (+ 89705us) raft_consensus.cc:1685] finished
0709 13:18:58.793762 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.793982 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":361886,"threads_started":1,"wal-append.queue_time_us":415100}
W20260709 13:18:58.813532  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83652.5us
I20260709 13:18:58.813539  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.815968  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.769102  6116 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:58.821230  4295 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:58.821794  4926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 305) took 1969 ms. Trace:
I20260709 13:18:58.821909  5881 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:58.823410  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.824613  6062 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.828632  6195 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.830090  6245 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:58.835552  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 81651.2us
I20260709 13:18:58.835877  6163 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:58.837133  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:58.858928  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 92580.2us
W20260709 13:18:58.834404  6253 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.001s
I20260709 13:18:58.846863  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.847400  4143 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:58.842554  6231 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:58.827922  6207 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.876387  6238 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.880582  4138 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:58.880142  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.881108  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.848809  6116 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.852234  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:58.853633  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:58.838975  6104 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:18:58.892900  6104 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.793267  6176 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.896541  6176 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:58.897038  6176 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.899186  6139 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.900523  4145 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:58.902904  5756 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.906088  5756 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.817972  6199 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.848592  6045 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.865749  6253 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.934345  4146 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:58.936717  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:58.938701  4922 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:58.867138  6243 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.870154  6245 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:58.841188  6126 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.850621  4926 rpcz_store.cc:276] 0709 13:18:56.848864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.917247 (+ 68383us) service_pool.cc:224] Handling call
0709 13:18:57.378482 (+461235us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:18:57.378783 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.619659 (+1240876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.817236 (+197577us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002b2354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.817511 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512319104}
I20260709 13:18:58.844475  6252 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:18:58.971076  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.972031  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1593) took 1217 ms. Trace:
I20260709 13:18:58.945703  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:58.973028  4138 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:58.972617  4289 rpcz_store.cc:276] 0709 13:18:57.754792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.643164 (+888372us) service_pool.cc:224] Handling call
0709 13:18:58.666259 (+ 23095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.666652 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:58.760609 (+ 93957us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.928283 (+167674us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b1800183d00. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3e88a4bc 00007fee3bbd848b 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a
0709 13:18:58.928552 (+   269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.930028 (+  1476us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.930082 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.930151 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.971861 (+ 41710us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b540042b8d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:18:58.971973 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10812,"prepare.queue_time_us":122598,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1062,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":62243584,"thread_start_us":135017,"threads_started":2,"wal-append.queue_time_us":113556}
I20260709 13:18:58.875667  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1590) took 1128 ms. Trace:
I20260709 13:18:58.884562  4045 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 82) took 5875 ms. Trace:
I20260709 13:18:58.886379  5941 raft_consensus.cc:1064] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:18:58.887593  6163 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.888478  6066 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:58.875101  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:58.905615  4041 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.907064  5909 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:18:58.909184  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55654.3us
I20260709 13:18:58.912632  6228 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.058501  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.055375  6207 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.905833  6116 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:58.915316  6176 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:59.060153  4147 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:59.062372  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.062652  6176 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.917191  6238 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.918756  6239 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.063354  6116 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.918572  6147 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.065645  6147 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:18:58.919641  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67557.4us
W20260709 13:18:58.859922  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 141832us
I20260709 13:18:59.067932  6139 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:59.068940  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.070773  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:18:59.071216  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.072587  6239 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:59.073063  6239 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:18:59.073572  6239 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.072590  4213 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:59.076861  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1674) took 1274 ms. Trace:
I20260709 13:18:59.077260  4213 rpcz_store.cc:276] 0709 13:18:57.802396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.522658 (+720262us) service_pool.cc:224] Handling call
0709 13:18:58.523004 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.075808 (+552804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.076532 (+   724us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540010a254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:59.076774 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263386368}
I20260709 13:18:59.079546  6253 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:58.976560  4296 rpcz_store.cc:276] 0709 13:18:57.747064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.622068 (+875004us) service_pool.cc:224] Handling call
0709 13:18:58.622347 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.655765 (+ 33418us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:58.716481 (+ 60716us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.850695 (+134214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.850757 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:58.851232 (+   475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.875331 (+ 24099us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b54000affd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.875392 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.875593 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122529,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":1085,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5772,"spinlock_wait_cycles":76141312,"thread_start_us":178878,"threads_started":2,"wal-append.queue_time_us":258003}
I20260709 13:18:59.080785  6086 consensus_queue.cc:1059] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:59.083290  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:59.057870  5941 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:59.088897  6116 raft_consensus.cc:3055] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:58.924048  4293 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:58.926021  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:59.089507  6116 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:58.926782  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:18:58.926020  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.091840  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.093165  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.093955  4145 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:18:59.090543  6116 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.984156  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.095147  6116 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.097203  5757 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:58.933087  6104 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.101900  6104 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:18:59.050966  6243 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:59.104260  6243 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.105609  6243 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.107172  6243 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.051646  6226 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.064020  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.000867  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:58.978118  4045 rpcz_store.cc:276] 0709 13:18:53.010004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.010279 (+   275us) service_pool.cc:224] Handling call
0709 13:18:53.177295 (+167016us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:18:58.884453 (+5707158us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:54.308983 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:54.309636 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:54.309678 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:18:54.309697 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:54.310213 (+   516us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:54.310290 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:54.310337 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:54.310848 (+   511us) tablet.cc:701] Row locks acquired
0709 13:18:54.310865 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:18:54.311055 (+   190us) write_op.cc:270] Start()
0709 13:18:54.311186 (+   131us) write_op.cc:276] Timestamp: P: 1783603134310998 usec, L: 0
0709 13:18:54.311204 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:18:54.474477 (+163273us) log.cc:844] Serialized 974 byte log entry
0709 13:18:56.569013 (+2094536us) op_driver.cc:464] REPLICATION: finished
0709 13:18:56.705143 (+136130us) write_op.cc:301] APPLY: starting
0709 13:18:56.711213 (+  6070us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:56.728906 (+ 17693us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:56.805566 (+ 76660us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:56.841131 (+ 35565us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:56.885878 (+ 44747us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:56.901297 (+ 15419us) write_op.cc:312] APPLY: finished
0709 13:18:56.922313 (+ 21016us) log.cc:844] Serialized 28 byte log entry
0709 13:18:56.937727 (+ 15414us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:56.964524 (+ 26797us) write_op.cc:454] Released schema lock
0709 13:18:56.971701 (+  7177us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:57.016387 (+ 44686us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:57.019240 (+  2853us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":431815,"reported_tablets":7,"spinlock_wait_cycles":273756544,"child_traces":[["op",{"apply.queue_time_us":102460,"apply.run_cpu_time_us":4687,"apply.run_wall_time_us":311708,"num_ops":2,"prepare.queue_time_us":320869,"prepare.run_cpu_time_us":63629,"prepare.run_wall_time_us":1224124,"raft.queue_time_us":329801,"raft.run_cpu_time_us":4391,"raft.run_wall_time_us":132633,"replication_time_us":2197912,"thread_start_us":1343795,"threads_started":4,"wal-append.queue_time_us":899164,"wal-append.run_cpu_time_us":59997,"wal-append.run_wall_time_us":2528322}]]}
I20260709 13:18:59.113588  4927 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.052996  6201 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:59.115305  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:59.115684  6201 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:58.970813  6245 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.053475  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:18:59.054683  6126 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:59.116079  6147 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:59.027107  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.117286  4138 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:59.117087  6245 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.117301  6147 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:59.118307  6147 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:59.118391  6245 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.119150  4921 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:59.119884  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49211.1us
I20260709 13:18:59.055371  5909 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:59.055482  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:59.034499  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 169657us
I20260709 13:18:59.056140  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.128918  4139 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:59.056524  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.057209  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.058475  4144 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:59.057687  4041 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 4 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:59.059056  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:59.050459  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 57372.7us
I20260709 13:18:59.109406  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.110092  6273 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:58.987634  6066 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.134298  6260 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.110417  6226 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:59.135090  6066 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:59.136526  6066 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.138566  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.111230  6262 raft_consensus.cc:993] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: : Instructing follower b81584b21ed144698954548303f1e507 to start an election
W20260709 13:18:59.120265  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 66887us
I20260709 13:18:59.141063  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:59.142359  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:59.142416  6228 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.143334  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:59.144136  6262 raft_consensus.cc:1081] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Signalling peer b81584b21ed144698954548303f1e507 to start an election
I20260709 13:18:59.146677  6231 raft_consensus.cc:2764] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:59.147485  6231 raft_consensus.cc:2764] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:59.149025  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:59.122126  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.148808  6274 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:18:59.151685  6226 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.152602  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:59.155004  6262 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:59.122911  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57061us
I20260709 13:18:59.119438  6147 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:59.155738  6262 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:59.124728  6126 consensus_queue.cc:1059] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:59.125496  6253 consensus_queue.cc:1059] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:59.158249  6262 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.160640  4140 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:59.129732  4141 raft_consensus.cc:2376] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:18:59.127559  4146 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:59.163172  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.163838  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.163579  4041 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 2 to 4, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:18:59.164880  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.166909  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.169571  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.170840  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.173697  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.174264  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.174952  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.176800  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.177582  4214 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:59.177681  4139 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.180328  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.181229  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.181921  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.180747  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.182835  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.183058  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.184809  4213 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:59.185221  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.173431  6218 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:18:59.188768  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.189013  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.189889  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.190089  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.190446  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.190845  4217 raft_consensus.cc:2368] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6.
I20260709 13:18:59.192634  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:18:59.193226  4926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "b81584b21ed144698954548303f1e507"
 from {username='slave'} at 127.0.0.1:42908
I20260709 13:18:59.193866  4926 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:59.194247  4926 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.194336  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.178057  6252 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:59.213976  4215 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:59.161038  6104 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:59.216178  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.168206  5757 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:59.198781  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.201519  6045 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.221613  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:59.221710  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.222453  6045 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:59.223429  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.176266  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.205735  6209 raft_consensus.cc:3055] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:59.206609  6147 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.206655  6126 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:59.208775  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.210036  6218 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:59.233870  6218 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.234831  6218 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.236136  6218 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.210388  4216 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.211230  6199 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.196257  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:59.247505  6228 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:59.247709  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 51544.3us
I20260709 13:18:59.224239  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.248756  4144 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:18:59.249688  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.279476  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.280450  4143 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:59.283877  4214 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:18:59.275061  5757 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:59.289409  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:59.198407  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4088650920000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:18:59.290402  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3598143459998937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 13:18:59.290783  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3044650920001004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 13:18:59.290853  4921 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:59.291181  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1024254859999019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:18:59.291550  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0826254859998699s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 13:18:59.195400  6238 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:18:59.227900  6243 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.160790  6163 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:18:59.237545  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61412.1us
I20260709 13:18:59.294219  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.295367  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.295604  4143 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.238346  6176 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.296300  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.226069  6209 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.239537  6207 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:59.240031  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.242173  4141 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:59.305748  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.244278  4926 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:59.245034  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.245611  4139 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:18:59.245851  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.246672  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.289830  6199 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:18:59.232004  6126 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.297683  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.298401  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.300417  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.294368  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.227047  4112 leader_election.cc:400] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6.
I20260709 13:18:59.301815  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.226589  6239 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:59.471695  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.362970  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.315021  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.479636  4215 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:59.310065  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:18:59.342157  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.331019  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.378798  4213 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.477855  4112 leader_election.cc:403] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:59.460310  4214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:18:59.481451  4292 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.482197  4214 raft_consensus.cc:606] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.335062  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.335353  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.486413  4147 raft_consensus.cc:2376] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7. Re-sending same reply.
W20260709 13:18:59.427044  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.307739  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.489909  4296 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.456046  4287 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:59.482672  4214 raft_consensus.cc:614] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:59.492770  4295 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:18:59.415985  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.498049  4145 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:18:59.497888  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 270932us
I20260709 13:18:59.498659  4215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44140
W20260709 13:18:59.499130  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 189157us
I20260709 13:18:59.357694  4143 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:59.500536  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:18:59.501036  4146 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.504084  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.504154  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.509644  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.510802  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.511289  4139 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:18:59.511886  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.514293  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.515815  4145 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.516749  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.518306  4144 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.519330  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.300875  6238 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:59.520416  6238 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.520846  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.521723  6238 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.522596  6126 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.523764  6238 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:59.542279  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.294773  5757 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:59.375926  6147 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:59.423041  4921 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:59.550616  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.305032  6207 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.524202  6126 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.557734  4142 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:18:59.349613  4291 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:18:59.564965  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.528911  6243 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6.
I20260709 13:18:59.570643  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.570873  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.571246  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.571724  4139 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:59.572007  4145 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:59.504267  6226 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.504480  6104 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.576324  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.576838  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.578454  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.579370  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.580112  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.559402  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.571851  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.573251  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.574424  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.574919  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.576014  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.309669  6245 consensus_queue.cc:1059] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.254s
I20260709 13:18:59.580753  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.584159  4289 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:59.582401  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.585668  4141 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:59.585534  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.553190  6147 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:59.588119  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.524601  6262 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:18:59.598644  4288 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.602205  6139 consensus_queue.cc:1059] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:59.592156  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.609154  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.611438  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.624292  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.625064  4290 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:59.628904  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.630018  4296 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:18:59.634637  4140 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:18:59.638759  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.640141  4293 raft_consensus.cc:2368] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6.
I20260709 13:18:59.643540  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.643688  4141 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:59.579180  6170 consensus_queue.cc:1059] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:18:59.645581  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.651497  4142 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.658972  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.660243  4142 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:18:59.664927  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:18:59.667168  4926 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:18:59.669771  4292 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:59.658699  6147 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:18:59.673455  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.674117  6147 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:59.685580  6279 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:18:59.688748  6245 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:59.689337  6245 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:18:59.690336  6245 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.692948  6239 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:18:59.662454  5757 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.699465  4146 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:18:59.703366  4138 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:18:59.633708  6207 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.707350  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:18:59.710211  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 208118us
I20260709 13:18:59.722527  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.735500  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:18:59.723798  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 179617us
I20260709 13:18:59.725639  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.728988  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.747563  4289 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.729780  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.732033  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:18:59.751288  4292 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:59.739147  4215 raft_consensus.cc:606] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:18:59.740110  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.758231  4295 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:59.773363  4146 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.775310  6209 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:59.777223  6209 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:59.783515  6234 raft_consensus.cc:3055] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:59.784235  6234 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:59.785506  6234 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.787469  6234 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.741974  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.742449  4145 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:18:59.814818  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 77575.9us
I20260709 13:18:59.820557  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.822377  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:18:59.820557  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:59.828655  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.832119  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 267157us
I20260709 13:18:59.836418  4927 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:59.760514  6281 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:59.840409  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 325477us
W20260709 13:18:59.835029  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 258171us
I20260709 13:18:59.844338  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:18:59.848670  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.850260  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.850028  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.841647  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:18:59.859663  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.864741  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:59.869853  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:18:59.871317  4145 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:18:59.873674  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:18:59.842136  6207 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.876931  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:59.843720  6281 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:18:59.887122  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.861037  6241 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.893769  4111 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.884929  6274 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:18:59.899883  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.877728  6163 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.901201  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.889087  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:59.875785  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:18:59.909359  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:18:59.911725  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:18:59.913270  5909 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:59.914068  5909 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:59.914635  6271 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.917173  6274 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:59.917615  6274 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:59.918684  6274 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.887349  6281 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.919952  6274 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.920663  6286 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.921451  6286 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:59.924643  4215 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.885600  6045 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:18:59.895871  6170 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.936467  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:18:59.937232  4214 raft_consensus.cc:3055] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:59.937564  4214 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:18:59.903303  6287 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.910027  6285 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:59.946940  4187 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:18:59.915419  5909 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:18:59.892565  6201 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:59.896622  5757 consensus_queue.cc:1059] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:59.938376  4214 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:18:59.960004  4214 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.943989  6116 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:59.972970  6116 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:18:59.973567  6116 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:59.980712  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 159566us
W20260709 13:18:59.986075  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 74475.1us
I20260709 13:18:59.989850  4294 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:59.986385  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 66653.6us
I20260709 13:18:59.992911  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:18:59.981748  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.605s (SENT) [suppressed 28 similar messages]
I20260709 13:18:59.998489  6271 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.999522  6262 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:59.930861  5756 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:19:00.004734  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.009327  4288 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:00.009685  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.014294  5879 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.016254  6262 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:00.026320  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 125284us
W20260709 13:19:00.038911  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.024420  4927 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:00.046970  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.052691  6243 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.047955  4214 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:00.054232  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:00.058012  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53646.4us
I20260709 13:19:00.058945  4187 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.058952  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.012394  6132 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:19:00.067546  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:00.068259  5879 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.073357  6241 consensus_queue.cc:1059] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:00.074815  6176 raft_consensus.cc:3055] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.075429  6176 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:00.080879  6283 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.082476  6283 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:00.082775  6176 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.087078  4145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ca04a09529497898d86f573a0e1189"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:00.087980  4145 raft_consensus.cc:606] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.088402  4145 raft_consensus.cc:614] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.096071  6298 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:00.096390  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 57912.4us
I20260709 13:19:00.098426  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:00.099398  4031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 106894us
I20260709 13:19:00.061581  6243 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.108610  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.103905  6252 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.083740  6283 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.069597  6163 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.129040  6284 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:00.130019  6284 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.125507  6132 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:00.132929  6132 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:00.134302  6132 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.148528  6283 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.152613  6132 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.151898  6284 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:00.098199  6045 raft_consensus.cc:2764] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Leader election decision vote started in defunct term 5: won
W20260709 13:19:00.190420  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 81919.8us
I20260709 13:19:00.068640  5757 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:19:00.202277  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.097005  6298 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:00.208587  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 152355us
W20260709 13:19:00.210642  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.211292  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.212615  4145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:00.213382  4145 raft_consensus.cc:606] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.187922  6139 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:00.101006  6273 consensus_queue.cc:1175] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:19:00.219403  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:00.216467  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 118170us
I20260709 13:19:00.206107  6296 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:00.229017  4187 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.210744  6243 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:00.215016  6045 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.215914  5879 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.238643  6066 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.227908  6086 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:19:00.237170  6273 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:19:00.251478  4145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:00.265563  4145 raft_consensus.cc:606] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:00.265705  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.263880  6238 consensus_meta.cc:287] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.719s	user 0.015s	sys 0.000s
W20260709 13:19:00.304551  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.282243  6245 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.283535  6289 raft_consensus.cc:3055] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.314462  6289 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:00.239508  6296 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.315459  6298 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:00.289778  4145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:00.319634  4145 raft_consensus.cc:606] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.327566  6170 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:00.328147  6170 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:00.329128  6170 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.330716  6170 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.332808  6287 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:19:00.334563  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.337033  6309 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:19:00.340371  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 107024us
I20260709 13:19:00.341845  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.347847  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:00.350492  5941 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:00.351030  5941 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:00.352011  5941 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:00.353037  6234 consensus_meta.cc:287] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.003s
I20260709 13:19:00.353154  4140 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:00.353386  5941 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.350811  4926 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.355202  5757 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.357378  6281 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.358036  4145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:00.360456  6176 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:00.362239  6209 consensus_meta.cc:287] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.584s	user 0.016s	sys 0.000s
I20260709 13:19:00.364063  6163 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.215013  6262 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.368456  6260 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.368959  6260 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:00.246628  6243 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.355726  5757 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:00.377146  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 159599us
I20260709 13:19:00.331760  6116 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:00.379406  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 138613us
I20260709 13:19:00.380167  4292 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:00.387794  4143 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:00.383438  4289 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:00.389380  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47654.7us
I20260709 13:19:00.394207  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:00.395350  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 166488us
I20260709 13:19:00.398727  4145 raft_consensus.cc:606] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.399290  4145 raft_consensus.cc:614] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.401374  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.384776  6285 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.406942  4111 leader_election.cc:400] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6.
I20260709 13:19:00.408810  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.395263  6207 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:00.414808  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:00.411685  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a767a88581024d12b14e9f965193d404"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:19:00.417089  4219 raft_consensus.cc:606] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:19:00.417511  4219 raft_consensus.cc:614] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.401809  6238 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.419651  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.410688  6285 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.369978  6260 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.407146  6253 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.432577  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.426486  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1490) took 1134 ms. Trace:
I20260709 13:19:00.429742  6252 raft_consensus.cc:993] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:00.434022  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.434248  4143 rpcz_store.cc:276] 0709 13:18:59.293825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.513448 (+219623us) service_pool.cc:224] Handling call
0709 13:19:00.426259 (+912811us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b540038ed54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:00.426386 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742151936}
I20260709 13:19:00.435725  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:00.442003  6311 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:00.442688  6311 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:00.443377  6311 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.444432  6296 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:00.447389  6243 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:00.422621  6286 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.409272  6289 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.449908  6289 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.453792  5757 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:00.455278  6260 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.456449  6209 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.457711  6298 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:00.458067  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.459084  6298 raft_consensus.cc:3055] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.459503  6298 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:00.459990  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.460580  5879 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.461509  5879 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.462893  5879 raft_consensus.cc:993] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:00.462742  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.463492  5879 raft_consensus.cc:1081] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:00.464939  6315 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.466739  6116 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:00.467375  6253 raft_consensus.cc:993] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:00.467887  6253 raft_consensus.cc:1081] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:00.471390  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:00.471817  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:00.472609  4928 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:00.489743  4213 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:00.496516  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:00.468540  6126 raft_consensus.cc:1081] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
W20260709 13:19:00.499296  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 62251us
I20260709 13:19:00.501745  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:00.504415  6045 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:00.504700  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 70773.8us
I20260709 13:19:00.505374  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.505692  6045 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:00.506155  6262 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.506711  6262 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.506944  4187 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.507130  6262 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.509032  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.510835  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.508098  6287 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.514452  6116 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.508030  6306 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.521751  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:00.533875  4292 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:00.515688  6170 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:19:00.485324  6298 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.530799  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:00.524000  6311 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.540408  6298 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.533015  6320 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:19:00.541603  6320 consensus_queue.cc:1243] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:00.533794  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.515247  6287 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:00.508445  6310 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:00.549796  4219 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:00.550650  4215 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:00.551026  4213 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.552748  4214 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:00.553742  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:00.544173  6287 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.565012  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:00.564877  6226 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:00.542533  6126 consensus_queue.cc:1175] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b81584b21ed144698954548303f1e507" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:19:00.548699  6320 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:00.581979  6320 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:00.583091  6320 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.558220  6282 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:19:00.584599  6320 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.590473  4219 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:00.590093  6284 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:00.590130  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.648s (SENT)
I20260709 13:19:00.543347  6252 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.598685  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:00.600320  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 66624.7us
I20260709 13:19:00.603281  4222 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:00.607519  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:00.613751  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:00.617205  4093 auto_rebalancer.cc:893] Removing replace marker failed: Replica 34e6205f3c1d434193126fef20d73800 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:19:00.617961  4093 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:19:00.627751  6239 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:00.627964  4093 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:19:00.598518  6284 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:00.622696  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.632249  6284 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.634689  6245 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.635752  6311 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:00.636869  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.637329  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.637995  4138 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:00.639094  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:00.639439  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.640744  4143 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:00.642547  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.658445  4145 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
I20260709 13:19:00.644066  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.645113  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:00.660144  4140 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.661255  4045 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 83) took 1350 ms. Trace:
I20260709 13:19:00.661901  4045 rpcz_store.cc:276] 0709 13:18:59.310668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.335182 (+ 24514us) service_pool.cc:224] Handling call
0709 13:18:59.898658 (+563476us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:00.652309 (+753651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":230928,"reported_tablets":2,"spinlock_wait_cycles":802145024}
I20260709 13:19:00.667990  4141 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
W20260709 13:19:00.669554  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 115123us
I20260709 13:19:00.606616  6321 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.653038  4142 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.673825  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:00.675889  4041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 159) took 6734 ms. Trace:
I20260709 13:19:00.679282  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.680086  4143 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:00.682212  4187 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:00.683677  4140 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:00.684305  4187 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.686270  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.686264  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:00.606141  6273 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.608037  6282 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:00.690527  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:00.688808  6309 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:00.696950  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.691114  6322 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:00.675518  6281 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:00.699569  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:00.689707  6311 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.702502  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:00.702910  4926 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:00.701149  6290 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:00.706825  6290 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:00.707213  6290 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.694181  6312 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:00.676296  4041 rpcz_store.cc:276] 0709 13:18:53.941912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.942896 (+   984us) service_pool.cc:224] Handling call
0709 13:19:00.675818 (+6732922us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:59.377427 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:59.409586 (+ 32159us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:59.409635 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:18:59.409665 (+    30us) tablet.cc:662] Decoding operations
0709 13:18:59.410457 (+   792us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:59.410568 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:59.410609 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:59.411075 (+   466us) tablet.cc:701] Row locks acquired
0709 13:18:59.411104 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:18:59.411325 (+   221us) write_op.cc:270] Start()
0709 13:18:59.411504 (+   179us) write_op.cc:276] Timestamp: P: 1783603139411251 usec, L: 0
0709 13:18:59.411539 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:18:59.560051 (+148512us) log.cc:844] Serialized 1307 byte log entry
0709 13:18:59.994209 (+434158us) op_driver.cc:464] REPLICATION: finished
0709 13:19:00.193860 (+199651us) write_op.cc:301] APPLY: starting
0709 13:19:00.205148 (+ 11288us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:00.219891 (+ 14743us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:00.234277 (+ 14386us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:00.248413 (+ 14136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:00.248763 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:19:00.248844 (+    81us) write_op.cc:312] APPLY: finished
0709 13:19:00.249241 (+   397us) log.cc:844] Serialized 34 byte log entry
0709 13:19:00.249492 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:00.249602 (+   110us) write_op.cc:454] Released schema lock
0709 13:19:00.249655 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:00.250069 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:00.250120 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":48627,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":197418,"apply.run_cpu_time_us":4135,"apply.run_wall_time_us":58097,"num_ops":3,"prepare.queue_time_us":175756,"prepare.run_cpu_time_us":72952,"prepare.run_wall_time_us":475466,"raft.queue_time_us":79511,"raft.run_cpu_time_us":28882,"raft.run_wall_time_us":102963,"replication_time_us":582470,"thread_start_us":541363,"threads_started":4,"wal-append.queue_time_us":349516}]]}
I20260709 13:19:00.694001  6282 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:00.698037  6045 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.697940  6309 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:00.709702  6170 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.732908  6312 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:00.741075  6309 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.750748  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:00.765744  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.768399  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:00.770153  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:00.771461  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:00.772248  4293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:00.772846  4293 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.773306  4293 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.776140  4296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:00.776834  4296 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.777173  4296 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.777959  4145 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:00.780107  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:00.780735  4143 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:00.781178  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:00.781965  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.782737  4139 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:00.782570  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.784402  4143 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:00.783558  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.786453  4140 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:00.767135  4893 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.787171  4141 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:00.787395  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.787566  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.788663  4142 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:00.789105  4142 pending_rounds.cc:85] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 2
W20260709 13:19:00.789426  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 87004.7us
I20260709 13:19:00.789431  4142 pending_rounds.cc:107] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:00.791749  4142 raft_consensus.cc:2889] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:00.791882  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.792781  4147 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:00.793694  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.793936  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.794811  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.795007  4147 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:00.795487  4144 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:00.796092  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.796401  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.792934  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.796751  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.799677  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.798547  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.800534  4142 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:00.801069  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:00.802987  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 46324.6us
I20260709 13:19:00.803633  4141 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:00.714018  6289 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:19:00.805934  4187 leader_election.cc:336] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.805s (SENT)
I20260709 13:19:00.806392  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.806694  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:00.810093  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.799894  4147 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:00.810632  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.811532  4140 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:00.785239  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:00.812074  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.812543  4143 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:00.812740  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.724007  6281 consensus_queue.cc:1059] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:19:00.804872  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:00.813606  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.824484  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.826828  4139 raft_consensus.cc:2376] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2. Re-sending same reply.
I20260709 13:19:00.824512  4288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:00.823989  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.824154  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.819379  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:00.827869  4288 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.835790  4288 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.829321  4142 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:00.837818  4893 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:00.841720  4296 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.805738  6245 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.805127  6239 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.847532  4296 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:00.876627  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.805022  5909 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:00.823622  6147 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.786585  6321 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:00.813683  6273 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.815048  6260 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.862129  4293 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.832664  6274 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:00.816608  6285 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:00.813328  6316 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:00.904239  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 62554.8us
I20260709 13:19:00.904371  4293 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:00.897302  6126 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:00.919018  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 114304us
I20260709 13:19:00.890560  6327 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:00.843086  6305 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:19:00.880395  6245 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.914842  6283 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:00.917198  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:00.893853  5909 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.815933  6282 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.934816  4926 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.929946  6329 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:00.921232  6126 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.933418  6283 raft_consensus.cc:697] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:00.902191  6312 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:00.944120  6323 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:19:00.954010  6324 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:00.955542  6334 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:00.975283  6334 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.977160  6126 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:00.903342  6321 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.951262  6329 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.957717  6322 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.979751  6287 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:00.990993  6321 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:00.982719  6262 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:00.987099  6284 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.003669  6283 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.004383  6334 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:00.992122  6329 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:01.009008  6327 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:19:01.049513  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 143759us
W20260709 13:19:01.061906  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.093223  5909 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.094523  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:01.099179  6126 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:01.100651  4921 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:01.100996  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:01.102064  4216 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:01.104491  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:01.136207  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 213055us
I20260709 13:19:01.137773  6338 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:01.143800  6338 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.145244  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:01.140480  6329 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:01.150194  6329 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.155493  6329 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:01.148885  6338 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:01.174665  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 122846us
I20260709 13:19:01.176450  4218 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:01.180735  6287 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:01.190729  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 68025.8us
I20260709 13:19:00.999161  6260 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.193307  6282 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.200702  4110 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:01.194069  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 356116us
I20260709 13:19:01.195458  6325 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:01.195755  6245 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:01.196029  6218 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:01.197203  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:01.198199  6066 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.204931  6262 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:01.209159  6325 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:01.237574  6116 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:01.238056  6325 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.238562  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:01.000994  6274 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:01.205529  6126 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.241230  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:01.242828  4924 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:01.242384  6274 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.243613  6126 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.223516  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:01.224943  6066 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.223697  6339 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.214725  6218 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:01.227138  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:01.226589  5941 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:01.230193  6132 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:01.231984  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:01.234746  6340 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:01.243860  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:01.250485  4927 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:01.230237  6346 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:01.246758  6218 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.245445  6325 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:01.257519  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 57336.2us
I20260709 13:19:01.261536  6314 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:01.275111  4288 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.276249  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:01.276664  6299 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:19:01.262710  4921 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:01.264755  6245 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:01.267256  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:01.270622  6289 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.252539  6132 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:01.302587  4926 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:01.303828  4928 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.303735  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:01.306818  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:01.307750  4289 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.308873  6321 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:01.309468  6321 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.309962  6321 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.313403  6132 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.315394  6132 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.317175  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.317531  6315 consensus_queue.cc:1059] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:01.318369  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 91372.9us
I20260709 13:19:01.319555  6298 raft_consensus.cc:3055] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:01.319727  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:01.320209  6298 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:01.325901  4288 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:01.285032  6245 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.330080  6308 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.331212  6226 raft_consensus.cc:3055] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:01.331074  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:01.333185  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:01.335752  6289 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:01.341410  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65447.1us
I20260709 13:19:01.343420  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:01.344194  6347 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:01.338305  6226 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:01.360242  6226 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.361213  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:01.361589  6226 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.363479  6348 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:01.364101  6348 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:01.336458  6245 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:01.366451  6290 consensus_meta.cc:287] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.011s
I20260709 13:19:01.367129  6290 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.350500  4215 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:01.368778  6347 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:01.369514  6347 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.350771  6260 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:01.373363  6260 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:01.322108  6298 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.351183  6066 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.358821  6346 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:01.350241  6327 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.346853  6262 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:01.378991  6273 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.379812  6273 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.374788  6260 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:01.396641  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 164868us
W20260709 13:19:01.398231  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.399606  5756 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:01.399694  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 56638us
I20260709 13:19:01.410137  6331 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.411049  6331 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.368276  6348 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.431494  6260 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.431439  5909 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.459187  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 139632us
I20260709 13:19:01.445569  6298 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:01.462448  6170 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.703s	user 0.017s	sys 0.008s
I20260709 13:19:01.464175  6331 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:01.464393  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.466585  6343 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:01.450397  4893 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:01.471000  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.471565  5909 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:01.472699  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.482184  6170 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:01.487675  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57228.4us
I20260709 13:19:01.494102  6348 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.498843  6116 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.499557  6289 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.499763  6116 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.507594  6116 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.508665  6283 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:01.510087  6283 raft_consensus.cc:697] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:01.476644  6273 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.481041  6343 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:01.536127  6343 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.543181  6283 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.574827  4289 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:01.591347  4288 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:01.598424  6207 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.597512  4294 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:01.599145  6207 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.602988  6207 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.609488  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:01.623232  6343 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.626618  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:01.579133  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:01.631760  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:01.570581  6339 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:01.634806  4216 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:01.595573  6218 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.638051  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:01.616106  4042 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 4, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:01.658120  6241 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:01.661280  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 116204us
I20260709 13:19:01.663033  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:01.671387  6245 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.674285  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.674669  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:01.641696  6290 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.642562  6282 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:19:01.690340  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.696883  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.656563  6315 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.701675  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:01.705760  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 142261us
W20260709 13:19:01.713784  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.733649  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:01.761068  4216 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:01.754447  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.704322  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:01.739877  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 55285.5us
I20260709 13:19:01.722378  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.714839  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.716826  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.782867  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:01.785662  4290 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:01.728619  6273 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.704447  5909 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:01.705426  6351 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:01.713922  6239 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:01.791239  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:01.754422  6218 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.734778  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:01.731861  6245 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:01.706486  6343 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.727615  6339 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.722827  6282 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:01.752372  6252 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:01.812363  4295 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:01.739353  6347 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:01.816473  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 112289us
I20260709 13:19:01.714362  6315 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.739329  6321 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.809607  6239 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.820726  4287 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:01.829248  4289 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:01.814286  6325 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.835778  4293 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:01.817060  4924 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.829069  4042 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 3 to 4, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 4 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:01.831461  6299 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:01.832445  6239 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.854183  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:01.842113  5941 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:01.877516  4296 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.881131  6274 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:01.877477  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:01.883424  4142 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.883205  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:01.885517  4145 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:01.886727  4215 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:01.890785  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:01.891710  4138 raft_consensus.cc:2376] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:01.895510  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:01.874634  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:01.896533  4219 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:01.888978  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:01.891081  6315 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.903033  4142 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:01.901894  4146 raft_consensus.cc:2376] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6. Re-sending same reply.
I20260709 13:19:01.904542  6325 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:01.900115  6241 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.906040  6325 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:01.906474  6241 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.826684  6273 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:01.910807  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69774.6us
I20260709 13:19:01.868701  5941 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:01.867486  6252 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.915344  4139 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:01.863552  6299 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.935237  6252 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.936316  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:01.937131  6176 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.937757  4924 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:01.937865  6176 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.939430  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:01.940955  6176 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.941690  6273 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.942246  5941 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:01.943904  5941 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:01.946987  6260 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.000s
I20260709 13:19:01.956045  4216 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:01.957818  4110 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:01.959494  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.907598  6325 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:01.966503  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.969928  4289 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:19:01.975405  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:01.976308  4146 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:01.961908  6282 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:01.979140  6241 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:01.986367  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.987092  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:01.989331  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:01.989521  4288 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:19:01.991039  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:01.991873  6241 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:01.992274  6241 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.992658  6241 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.992865  6321 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:01.993973  6347 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:01.995492  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:01.962203  6348 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.001983  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.003365  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:01.970371  6298 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:02.004534  4219 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:02.004993  6298 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:02.005878  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:02.006116  6298 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.008560  6312 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.009613  6312 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.011500  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.012326  4289 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:02.006727  4926 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.013217  6347 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:02.013624  6312 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.014096  4294 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:02.014012  6347 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.013060  4290 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:02.000607  6252 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:02.017524  6252 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:02.018743  6252 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.020064  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:02.012511  6343 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:02.024709  6343 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.025460  6343 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.012544  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.028635  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:02.043087  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.047663  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.048548  4293 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:02.053469  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.056596  6321 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.057282  6321 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.057921  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.058712  4290 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:02.059127  6239 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.060710  6312 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:02.060770  6321 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.061739  6312 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:02.061846  4141 raft_consensus.cc:2368] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:19:02.054277  4295 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
W20260709 13:19:02.053752  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 175024us
I20260709 13:19:02.053531  4292 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:02.065060  4296 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:01.974175  6299 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.068903  4289 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:02.065217  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 125912us
I20260709 13:19:02.046918  6347 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.070096  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:02.078891  6359 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:19:02.079461  6132 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:02.078684  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:02.080724  4928 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.080016  6132 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.089258  4288 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:02.060262  4926 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
W20260709 13:19:02.091014  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.083827  4186 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:02.095364  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.090416  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:02.086374  6132 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.094079  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:02.101027  5756 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:02.101867  5756 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.102293  5756 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.101006  4924 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:02.098464  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.113801  6066 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:02.114581  6066 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:02.118156  4138 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:19:02.118799  6312 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.120934  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:02.094481  5909 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:02.122961  4259 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:02.115790  6066 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.130889  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.131760  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:02.131245  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:02.091866  6362 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:19:02.138094  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:02.143250  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:02.145711  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.146792  4216 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:02.128794  5909 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.137018  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:02.150395  4893 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:02.152926  4921 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:02.154254  6299 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:02.154747  6299 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.155284  6299 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.136307  6347 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:02.157042  6347 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:02.157676  6347 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:02.145519  4924 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:02.161654  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.162523  4218 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:02.152755  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.165452  6241 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.166898  4926 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:02.139017  6289 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:19:02.169525  6289 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:02.169768  4288 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.169945  6289 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:02.175052  6132 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.175556  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:02.176155  4292 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.176498  5909 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.180709  6325 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:02.181010  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 82654.7us
I20260709 13:19:02.181831  6274 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.182889  6274 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.184993  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:02.181986  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.185854  4141 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:02.186925  6282 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:02.187757  6282 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:02.188800  6282 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.190600  6315 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:02.190600  5879 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:02.191217  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:02.191546  6315 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.192056  4213 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:02.191627  5879 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.194229  6315 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.195034  5879 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.197661  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:02.198065  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:02.187992  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.201612  6239 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.202471  6274 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:02.204941  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 68027.5us
I20260709 13:19:02.218600  4928 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:02.187649  6339 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.220680  4289 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:02.223701  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.224499  4291 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:02.226568  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.226475  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.227963  4294 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:02.228574  4213 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
W20260709 13:19:02.233108  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 45236.2us
I20260709 13:19:02.215953  6170 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:19:02.233788  4295 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:02.234158  6316 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:02.220253  6325 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.234120  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.234757  6316 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.235244  6316 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.236522  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.230594  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:02.245500  4144 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:02.215060  6241 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.248106  6274 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.252985  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:02.261525  6321 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:02.265249  6347 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.267863  6347 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.269125  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:02.269953  4144 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:02.271905  4143 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:02.272274  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:02.273066  4139 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.273686  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:02.274789  4142 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:02.274727  4140 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:02.257326  6170 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.288686  6170 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.290217  6132 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.292194  4139 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:02.305088  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 48717.7us
I20260709 13:19:02.292940  6343 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.294020  6289 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.306568  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.271934  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:02.291313  6170 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.312054  4292 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
W20260709 13:19:02.308177  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.259606  6066 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:02.280050  6348 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:02.318691  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.307482  6290 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.324095  6312 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:02.326256  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.327441  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.332290  6325 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:02.317063  6289 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.340480  4288 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:02.350862  4927 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:02.351838  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:02.356272  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:02.357740  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:02.346611  6218 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:02.356536  6241 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:19:02.367512  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 95721.9us
I20260709 13:19:02.363077  6290 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.354007  6066 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:02.369057  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:02.369688  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.370504  6290 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.370604  4290 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:02.370375  6066 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.371615  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:02.367504  6284 raft_consensus.cc:2764] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:02.372221  4295 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.365751  6283 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:02.351315  6327 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:02.327881  6274 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.355993  6315 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:02.349884  6347 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:02.356679  6362 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:02.379555  6207 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:02.372957  6348 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:02.351974  6299 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.494117  6321 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.491637  6283 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.372186  6290 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
W20260709 13:19:02.523844  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 196500us
I20260709 13:19:02.524996  4928 raft_consensus.cc:2368] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
W20260709 13:19:02.525086  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.530123  4295 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:02.511039  6339 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.516669  5879 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.520431  6283 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.535967  6207 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.531487  6348 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.516886  6315 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.580869  5879 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.581812  6371 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:02.582291  6371 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:02.583076  6315 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.514335  5756 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.546258  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.568487  6207 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:02.579322  6369 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:19:02.580535  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.542721  5941 consensus_meta.cc:287] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.593s	user 0.012s	sys 0.002s
I20260709 13:19:02.525764  6347 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.583797  5879 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.544082  6239 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.595736  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.597263  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:02.545746  6325 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.601107  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.534718  6321 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.604439  4222 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 2: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:02.608538  4218 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:02.605587  4219 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:02.615406  4215 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:02.621146  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 275919us
I20260709 13:19:02.622210  4186 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:02.658322  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 68454.5us
I20260709 13:19:02.616780  6325 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.619818  6282 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.607659  6315 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.548053  6339 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.670446  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:02.583280  6371 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.594290  6348 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.603142  6374 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:02.613732  6373 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.678118  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:02.746625  4218 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.680557  4216 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:02.623044  6218 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.681471  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59368.1us
I20260709 13:19:02.617025  6343 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:02.683553  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 137474us
I20260709 13:19:02.608546  5909 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.686492  6207 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.686681  6298 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.687844  6370 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:19:02.688732  6365 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:19:02.691033  6366 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
W20260709 13:19:02.691335  6368 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:02.681052  6380 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:02.723824  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47029.9us
I20260709 13:19:02.672400  6239 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.788820  6274 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.789306  6239 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.759975  6331 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:19:02.789749  4924 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:02.733547  4213 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:02.777041  6218 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:19:02.721473  6252 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.793341  6218 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.793496  6252 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.795864  6321 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.754516  4928 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:02.728574  6299 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.759131  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:02.798205  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:02.798966  4217 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.803236  6339 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.753502  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:02.805816  5909 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:02.806605  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 53289us
I20260709 13:19:02.808089  6282 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:02.809063  6348 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:02.778746  6371 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.772461  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:02.811515  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49351.8us
I20260709 13:19:02.812666  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.783200  4259 leader_election.cc:400] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:02.783668  6343 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:02.785283  6325 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:02.829062  6325 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.829131  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:02.831013  6132 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:02.831424  6132 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.831779  6132 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:02.832451  6316 consensus_meta.cc:287] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.004s
I20260709 13:19:02.832954  6316 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.781339  6380 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.834244  6380 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:02.835337  6316 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.814774  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.815671  4259 leader_election.cc:403] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:19:02.819038  4218 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:02.766395  6373 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.824043  6298 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.757393  6315 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:19:02.825645  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.795892  6252 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.827008  6382 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.827495  6274 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:02.836781  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:02.841714  4893 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:02.841348  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 106654us
I20260709 13:19:02.843989  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:02.851734  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:02.859432  4296 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.852756  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:02.861228  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:02.861991  4928 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:02.843146  6343 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.825719  6347 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:02.880208  6315 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:02.880801  6315 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:02.848912  6282 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.869210  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.887138  4295 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:02.874466  6299 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:02.845804  6066 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:02.876230  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:02.890684  4292 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.876603  5756 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:02.876791  6298 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:02.877096  6384 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.861071  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:02.857753  6348 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:02.840031  6362 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:19:02.887671  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43784.7us
I20260709 13:19:02.887637  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:02.977437  4289 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:02.841738  5909 raft_consensus.cc:2764] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:19:02.911378  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 85843.5us
W20260709 13:19:02.916404  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.921484  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:02.923923  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.924299  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.926134  6378 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.925855  6283 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:02.926662  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:02.927946  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.981065  4213 raft_consensus.cc:2410] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:02.928668  5941 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:02.980193  4214 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:02.885912  6343 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:02.931950  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.932463  6316 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.934532  6373 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:02.934492  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.999436  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.934500  6384 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:02.895789  6066 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:02.938261  4292 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:02.940203  6299 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:02.921514  6386 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:02.943104  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:02.944389  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:02.865435  6331 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:02.954324  6382 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:02.950254  4217 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:02.930416  4221 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:02.985134  4296 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:02.997524  4293 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:03.012445  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:03.070628  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.071347  4296 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:03.013370  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:03.013713  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:03.062132  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 117862us
I20260709 13:19:03.072289  4292 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:03.064873  4928 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:03.082345  4215 raft_consensus.cc:2410] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:03.093564  4893 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:03.099602  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:03.077310  6386 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.007583  6066 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:03.134424  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 122144us
I20260709 13:19:02.885607  6315 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.004138  6327 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.142287  4290 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.141084  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:03.147056  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 57883.3us
I20260709 13:19:03.022522  5879 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.111441  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:03.139043  6386 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.153786  6387 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:19:02.997509  6239 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:19:03.179251  4294 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:03.181595  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.182734  4296 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:03.111502  6241 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:03.189736  4213 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:03.004974  6378 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.189785  6241 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:03.193512  6241 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.025322  6316 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.195482  4216 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:03.196847  6362 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.112761  6331 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:03.200079  6331 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.191867  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:03.203655  4217 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:03.136262  6348 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:03.220153  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 147355us
I20260709 13:19:03.176219  4221 raft_consensus.cc:606] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:19:03.176709  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.224048  4221 raft_consensus.cc:614] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:03.156241  5756 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:03.237155  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 172966us
I20260709 13:19:03.228674  4290 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
W20260709 13:19:03.219337  4187 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.604s (SENT)
I20260709 13:19:03.150332  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:03.239288  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.241005  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.241870  4292 raft_consensus.cc:2410] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:19:03.242201  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 205079us
I20260709 13:19:03.243428  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.246333  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:03.249854  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:03.270387  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:03.241428  6289 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.887s	user 0.016s	sys 0.001s
I20260709 13:19:03.281018  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.283092  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.284373  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:03.209278  6389 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:03.285216  4292 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.023696  5941 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.231529  6382 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.237965  6327 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:03.293110  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 53997.9us
I20260709 13:19:03.245865  6347 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.294399  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44624.4us
I20260709 13:19:03.296010  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.245724  6284 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.218295  5879 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.281754  6312 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.318774  6402 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:03.317451  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.322912  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.330283  4293 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:03.330888  4294 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
W20260709 13:19:03.326378  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 151427us
I20260709 13:19:03.295253  6389 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.320003  6327 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:03.294149  6207 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.202376  6299 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.308779  6239 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:03.327404  6312 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.361186  4292 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
W20260709 13:19:03.354353  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 100940us
I20260709 13:19:03.347431  6389 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.351377  6298 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.324536  6347 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:03.386514  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53948.8us
I20260709 13:19:03.382419  6395 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.390064  6400 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:03.390544  6395 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.393265  6347 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:03.393417  6387 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.394050  6387 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.394698  6343 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:03.396103  6316 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:03.399251  6392 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:19:03.400902  6132 consensus_meta.cc:287] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.004s
I20260709 13:19:03.401378  6132 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.403661  6132 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.387576  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:03.321995  6382 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.405606  6207 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.407215  6382 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:03.407687  6384 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.407853  6394 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:19:03.327591  6284 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.409979  4295 raft_consensus.cc:2410] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:19:03.391220  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 45546.6us
I20260709 13:19:03.366295  6312 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.416141  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:03.384779  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:03.417065  4928 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:03.361299  6239 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:03.408018  6207 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.390182  6283 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.383543  6298 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.427186  4296 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:03.425747  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:03.433228  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52383.7us
I20260709 13:19:03.431963  4187 leader_election.cc:400] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:19:03.434163  4187 leader_election.cc:403] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:19:03.434573  4186 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:03.415266  6316 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.420759  6289 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:19:03.430111  6298 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:03.454687  6325 consensus_meta.cc:287] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.002s
I20260709 13:19:03.455327  6325 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.448160  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:03.451995  6289 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:03.420332  6282 consensus_meta.cc:287] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.522s	user 0.002s	sys 0.011s
I20260709 13:19:03.443403  6066 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:03.424647  6398 log.cc:927] Time spent T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:19:03.461752  4218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.018s
I20260709 13:19:03.445803  5941 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:03.468530  4259 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:03.448727  6316 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:03.431034  6284 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:03.484443  4218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.019s
I20260709 13:19:03.474089  5879 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.457507  6382 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:03.505154  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 184623us
W20260709 13:19:03.510025  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 61963.1us
I20260709 13:19:03.506482  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:03.480162  6347 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:03.511862  6132 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3.
I20260709 13:19:03.507349  6402 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:03.519105  6402 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.519550  6066 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.521286  6387 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:03.521804  6402 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.522352  6378 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.522524  6402 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.522352  5879 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:03.523159  6402 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.523356  5879 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.502874  6289 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:03.495061  6282 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:03.550786  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:03.526005  6316 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:03.554711  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 132460us
I20260709 13:19:03.502799  6404 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.503188  6327 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:03.555764  6289 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.556550  6327 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.557018  6327 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.524446  6401 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:03.558337  5879 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.558534  6401 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.554546  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:03.563374  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:03.526177  6371 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.004s
I20260709 13:19:03.568138  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:03.564260  4217 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:03.515817  6394 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:03.553604  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 119112us
I20260709 13:19:03.570887  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:03.572621  6401 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:03.573796  4221 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:03.576607  4139 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:03.577235  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:03.577432  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:03.577955  5879 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:03.578543  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:03.580950  6218 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:03.523576  6402 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.586737  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:03.602314  4146 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:03.587585  4213 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:03.595583  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:03.606132  4144 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:03.606081  4217 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:03.596282  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:03.603473  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:03.609973  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:03.549724  6239 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.909926  4141 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:03.696781  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 146125us
I20260709 13:19:03.682484  4145 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:03.911203  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.911687  4138 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:03.684319  4295 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:03.647186  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:03.904059  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.567970  6382 raft_consensus.cc:2764] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:19:03.914188  4146 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:03.777482  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:03.844975  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:03.811659  4288 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:03.914227  4294 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:03.674130  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:03.920825  4213 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:03.912312  4290 raft_consensus.cc:2410] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:03.597342  6387 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:03.714476  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:03.750769  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.692732  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 114339us
I20260709 13:19:03.937553  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.938423  4295 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:03.650399  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:03.939417  4217 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.584501  4921 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:03.588199  6381 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.923774  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 328533us
W20260709 13:19:03.904088  6409 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:19:03.752867  6395 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:03.831127  6371 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.966171  6387 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.966851  6371 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:03.690850  6408 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:03.945930  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:03.943058  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:03.946830  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:03.949157  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 345778us
I20260709 13:19:03.950914  4214 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:19:03.885355  6347 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.649266  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:03.892089  6407 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:19:03.960917  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.689558  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:03.815794  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:03.964864  6380 consensus_meta.cc:287] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.118s	user 0.014s	sys 0.005s
I20260709 13:19:03.636303  6394 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.965128  6413 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.964962  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.689810  6412 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:03.816044  6406 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:03.799502  6282 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:03.946751  6386 consensus_meta.cc:287] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.004s
I20260709 13:19:04.013310  6406 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.013664  6386 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:03.693068  6401 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:03.983861  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.983071  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:03.983552  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:03.605439  6290 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.371s
I20260709 13:19:04.026222  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:04.027046  4144 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:04.027750  5756 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.002s
I20260709 13:19:03.995654  4296 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:03.636520  5879 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.689878  6218 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.807188  6389 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.002872  4923 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:04.003048  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 80629.3us
I20260709 13:19:04.004561  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:03.982066  6419 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:03.991873  6347 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.046342  6419 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.046923  6419 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.007123  6066 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:19:04.048707  6347 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:03.976318  6381 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:04.001313  6380 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:04.053231  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.050559  6312 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.005s
I20260709 13:19:04.063522  6312 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.019644  6413 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:04.065722  4143 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:04.068883  6389 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:04.070957  6399 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.655s	user 0.009s	sys 0.002s
I20260709 13:19:04.071854  6381 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:04.072490  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1702) took 1711 ms. Trace:
I20260709 13:19:04.072954  4287 rpcz_store.cc:276] 0709 13:19:02.361102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.361258 (+   156us) service_pool.cc:224] Handling call
0709 13:19:02.361646 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.742042 (+380396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.742080 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.843203 (+101123us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.302444 (+459241us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:03.302512 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.302665 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.070254 (+767589us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:04.072086 (+  1832us) raft_consensus.cc:1685] finished
0709 13:19:04.072110 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.072399 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9561,"raft.queue_time_us":118279,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":9490,"spinlock_wait_cycles":8867200,"thread_start_us":760496,"threads_started":2,"wal-append.queue_time_us":491530}
I20260709 13:19:04.074856  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 265) took 1233 ms. Trace:
I20260709 13:19:04.075289  4218 rpcz_store.cc:276] 0709 13:19:02.841863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.842227 (+   364us) service_pool.cc:224] Handling call
0709 13:19:02.856164 (+ 13937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.878820 (+ 22656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.878882 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.879576 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.499456 (+619880us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:03.499509 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.499595 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.074571 (+574976us) raft_consensus.cc:1685] finished
0709 13:19:04.074597 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.074742 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11400,"raft.queue_time_us":115,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":6975,"thread_start_us":619386,"threads_started":1,"wal-append.queue_time_us":629494}
W20260709 13:19:04.081602  6327 consensus_meta.cc:287] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.002s
I20260709 13:19:04.081959  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:04.082683  4147 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.977662  6373 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:03.990434  6239 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.018865  4292 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
W20260709 13:19:04.016784  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.013363  6282 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.089953  6419 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:04.091063  6298 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.003s
I20260709 13:19:04.091549  6282 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.017592  6382 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.018215  6401 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.016008  6412 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.000543  4922 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:04.061872  5879 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:04.053908  6417 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:04.058835  6395 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.059096  6387 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.082243  6327 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:03.999048  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:04.028285  5756 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:04.093710  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 110832us
I20260709 13:19:04.116710  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:04.006016  4217 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
W20260709 13:19:04.125690  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.170253  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 498232us
W20260709 13:19:04.093971  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 111524us
I20260709 13:19:04.092185  6282 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:04.068961  6413 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:04.092324  6218 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:04.091562  6298 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.399572  6395 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:04.400233  6395 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.123273  6382 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.124861  6401 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.392481  4296 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:19:04.404474  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 420966us
W20260709 13:19:04.411866  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 412832us
I20260709 13:19:04.411159  4147 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:04.412860  4112 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:04.060530  6406 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.092756  6419 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.126905  6386 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.060421  6394 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.429251  4217 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:04.412863  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.413694  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:04.238518  6402 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.008s
I20260709 13:19:04.126555  6371 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.432209  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:04.442405  6402 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.372478  6347 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.431151  6413 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.397294  4144 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:04.374095  6312 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.440698  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:04.401388  6412 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.450920  4294 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:04.455369  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:04.414821  6423 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.426503  6387 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.460072  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.461251  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:04.463660  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 61812.2us
I20260709 13:19:04.465075  4142 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:04.436143  6406 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.452792  6413 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.480182  6387 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.464038  6412 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:04.484069  6387 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.464179  6386 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:04.484915  6413 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.485320  6386 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.485702  6382 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.488438  5941 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.488766  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.490042  6327 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:04.491139  6406 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.491384  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:04.492054  4922 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.492569  6412 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.458392  6347 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.485754  6386 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:04.494325  6312 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:04.495425  6380 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.494616  6347 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.480734  6371 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:19:04.483968  6434 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.499032  6434 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.501693  6434 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.501547  6347 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.502455  6434 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.502493  6347 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:04.504602  4288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47710 (request call id 239) took 1670 ms (client timeout 1650 ms). Trace:
W20260709 13:19:04.505134  4288 rpcz_store.cc:269] 0709 13:19:02.833920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.837970 (+  4050us) service_pool.cc:224] Handling call
0709 13:19:04.504305 (+1666335us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54003f1e54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:04.504461 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624744320}
I20260709 13:19:04.490768  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:04.489470  5941 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:04.519043  6315 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.520246  6298 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.520737  6412 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:04.523164  6283 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:04.519212  6402 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.427601  6282 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:04.488101  6382 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.505142  6347 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.529315  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:04.529415  6347 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.530216  4926 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:04.530280  6347 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.533584  6347 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.533257  6382 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:04.535358  6378 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:04.536168  6170 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.512022  6327 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.537065  6434 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.537777  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:04.539371  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:04.539749  6401 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.541114  4218 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:04.547256  4219 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.558377  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.560797  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.561666  4217 raft_consensus.cc:2368] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:04.564858  6218 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.565320  6432 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:04.565536  6218 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.566005  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:04.566902  5879 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.567303  5879 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.567378  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.567884  5879 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.568368  6432 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:04.558820  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145206us
I20260709 13:19:04.567905  6218 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:04.577836  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.576557  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.580478  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.581305  4217 raft_consensus.cc:2368] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:04.581476  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.583745  4218 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:04.584244  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.595942  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.597343  4296 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:04.544812  6402 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.592304  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:04.599906  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 168278us
I20260709 13:19:04.603802  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:04.604745  4926 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:04.605053  6402 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.607784  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.608831  4288 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:04.609905  6402 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.588814  6298 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.610644  6402 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:04.541822  6387 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:04.611383  6402 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:04.588795  6218 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:04.613400  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.578807  6371 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:04.614349  4292 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:04.582697  6347 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.613435  6387 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:04.577862  6406 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:04.614276  6371 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:04.618355  4218 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:04.618916  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:04.620210  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:04.626680  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:04.626986  4290 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.627413  4296 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.620311  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:04.628024  4217 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.628429  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:04.596204  6434 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.592974  6432 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.546900  6327 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.546576  6170 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.648708  6170 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.546198  6378 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.649488  4141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:04.649048  6402 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.650190  4141 raft_consensus.cc:606] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.650606  4141 raft_consensus.cc:614] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:04.651049  6378 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.632625  4289 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:04.652529  4289 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:04.653420  4289 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.653817  5879 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.654474  4289 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.589258  6395 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.657825  4218 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:04.509215  6423 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:04.640952  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:04.602520  6382 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:04.641749  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.668761  4288 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:04.644212  4296 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:04.621203  6347 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.646000  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:04.649760  4216 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:04.633064  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.665933  4292 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.656286  5879 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.666815  6283 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.694350  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:04.697890  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1548) took 1098 ms. Trace:
W20260709 13:19:04.699674  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 107588us
I20260709 13:19:04.700696  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:04.669386  6434 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.716208  6347 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.698438  4142 rpcz_store.cc:276] 0709 13:19:03.589865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.598523 (+  8658us) service_pool.cc:224] Handling call
0709 13:19:04.687492 (+1088969us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b540044aa54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:04.687681 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116298624}
I20260709 13:19:04.725162  6434 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:04.725750  4927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 338) took 1989 ms (client timeout 2104 ms). Trace:
I20260709 13:19:04.698441  6283 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.726511  6283 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.727451  6434 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.728292  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.706018  6315 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.729646  6413 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.730433  6315 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.730903  6315 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.706664  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.705510  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.709235  4222 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:04.737995  4215 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:04.709707  4141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:04.738565  4141 raft_consensus.cc:606] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:04.738982  4141 raft_consensus.cc:614] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:04.707703  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:04.712235  6386 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.744952  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.745786  4291 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:04.716176  6327 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:04.717244  6371 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.717981  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:04.719292  5941 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:04.719539  6395 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.720642  6401 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.637630  6441 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:19:04.720999  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.723508  6282 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:04.773237  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.724287  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:04.726205  4927 rpcz_store.cc:269] 0709 13:19:02.736136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.744988 (+  8852us) service_pool.cc:224] Handling call
0709 13:19:04.725513 (+1980525us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54006e0354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:04.725660 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4085723904}
W20260709 13:19:04.710616  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 419667us
I20260709 13:19:04.727972  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.773151  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:04.740638  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.698136  6381 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.747532  4221 raft_consensus.cc:2368] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:04.732128  6413 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.753854  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:04.755426  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 61485.9us
I20260709 13:19:04.666558  6438 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.786216  4922 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:04.786125  6438 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.786664  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.787354  4214 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:04.788318  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:04.751691  6396 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.757994  4290 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:04.758208  4217 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:04.758339  4289 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:04.758476  6386 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:04.676275  6435 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.768184  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.770095  4216 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:04.772482  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.723973  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.774266  4288 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:04.742714  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46120.4us
I20260709 13:19:04.776146  4287 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:04.779510  4292 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:05.405121  4214 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:05.034952  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.816119  4220 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:04.831597  4219 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:05.407882  4296 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:04.796908  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.409900  4144 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:05.410148  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:04.796461  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:04.795646  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:05.413213  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:04.884644  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 78096.5us
W20260709 13:19:04.843346  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 47660us
I20260709 13:19:05.415258  4110 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:04.819072  4186 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:04.788491  4041 catalog_manager.cc:5697] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 3 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:05.143291  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 302766us
I20260709 13:19:04.888703  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:05.153456  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.795450  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.796360  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.412569  4294 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:05.430622  4143 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:05.445644  4142 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:05.450454  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.451665  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:05.451859  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:05.452564  4289 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.452893  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.453555  4219 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:05.454488  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.455181  4220 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:05.452323  4296 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:05.458636  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:05.459697  4290 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.462980  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.465351  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.466691  4217 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:05.473129  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.450875  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:05.430142  4221 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:05.474742  4287 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:05.482054  4288 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:05.453223  4222 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:05.483368  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.483704  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:05.298659  6289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.004s	sys 0.015s
I20260709 13:19:05.493858  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:05.484127  4219 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:05.496533  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:05.496773  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:05.484894  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:05.496565  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.497485  4292 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:05.497805  4295 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:05.498003  4144 raft_consensus.cc:2368] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
W20260709 13:19:05.382140  6446 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
W20260709 13:19:05.484086  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51360.1us
W20260709 13:19:05.493990  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 674984us
I20260709 13:19:05.497403  4219 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:05.494930  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 79768.7us
I20260709 13:19:05.499585  4217 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:05.499083  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:05.498528  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.517469  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:05.518252  4215 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.795667  5879 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:04.841142  6239 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:05.179214  6438 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:05.548010  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.522369  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:05.554388  4294 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:04.886596  6443 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.795850  6401 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.795141  6387 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:05.419258  6432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.004s
I20260709 13:19:05.517191  6331 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:05.622380  6331 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.082338  6441 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:05.531698  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.626149  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.626739  6316 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:05.627377  4217 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:05.530066  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.627735  6316 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:05.629971  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:05.630775  6432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.009s	sys 0.004s
I20260709 13:19:05.532912  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:04.792482  6381 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.633579  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.635319  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.636624  6443 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.639787  6443 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:05.392135  4044 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 6, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 6 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.530279  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.540374  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.555409  4290 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:05.488787  6282 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.563544  4213 raft_consensus.cc:2410] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:19:05.564163  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64841.9us
I20260709 13:19:05.483239  6444 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:05.589174  6423 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:05.589793  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.518007  6273 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:05.670373  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.590626  6401 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.597693  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.600945  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1618) took 1062 ms. Trace:
I20260709 13:19:05.601043  6362 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:05.450315  6435 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.610929  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.516851  6402 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:05.623109  6331 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.529995  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:05.705057  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.058713  6315 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:04.998008  6283 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:05.640573  6438 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:05.643108  6404 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:05.533325  4296 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:05.653971  4142 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:05.632036  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.661085  4215 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:05.722489  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1739) took 1089 ms. Trace:
I20260709 13:19:05.662201  4294 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:05.568300  6239 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.665561  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.729406  4140 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:05.730638  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.731565  4142 raft_consensus.cc:2368] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:05.666072  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:05.668244  4289 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:05.732410  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 66450.7us
I20260709 13:19:05.663453  4044 catalog_manager.cc:5697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.669560  4292 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:05.653317  6429 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:05.681839  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:05.684271  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.739461  4139 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:05.483556  6396 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.696069  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:05.687803  4216 rpcz_store.cc:276] 0709 13:19:04.538804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.538999 (+   195us) service_pool.cc:224] Handling call
0709 13:19:05.600556 (+1061557us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000262d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:05.600791 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235096832}
I20260709 13:19:05.705866  4221 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:05.739452  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.740813  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.713376  4222 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:05.551967  5879 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.666154  6443 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:05.725154  4144 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.725412  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 252) took 1022 ms. Trace:
I20260709 13:19:05.664746  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.723085  4296 rpcz_store.cc:276] 0709 13:19:04.633181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.484212 (+851031us) service_pool.cc:224] Handling call
0709 13:19:05.532977 (+ 48765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.722043 (+189066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.722400 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.732666  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.748636  5941 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:05.734187  4288 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:05.773168  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.736097  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:05.706193  6449 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
I20260709 13:19:05.661785  6387 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.787582  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:05.788554  4219 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:05.704916  6402 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.747354  4044 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 3, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.748602  4217 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.790309  4215 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:05.751080  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:05.791769  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:05.668071  6282 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:05.716511  4187 connection.cc:256] RPC call timeout handler was delayed by -1.0889914080000835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:19:05.759057  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.795152  4140 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:05.761026  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.761996  4141 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:05.763818  4214 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:05.764429  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:05.674119  6444 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.769364  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.733783  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1663) took 1027 ms. Trace:
I20260709 13:19:05.770758  4294 rpcz_store.cc:276] 0709 13:19:04.702920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.555601 (+852681us) service_pool.cc:224] Handling call
0709 13:19:05.661655 (+106054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.724770 (+ 63115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.725301 (+   531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.693135  6273 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:05.774386  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:05.782351  4042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 172) took 12549 ms (client timeout 15000 ms). Trace:
I20260709 13:19:05.798225  4142 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:05.727468  6438 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:05.791817  6402 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.816069  4143 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.734861  6404 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:05.801803  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1790) took 1018 ms. Trace:
I20260709 13:19:05.806262  4292 rpcz_store.cc:276] 0709 13:19:04.706858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.563589 (+856731us) service_pool.cc:224] Handling call
0709 13:19:05.663954 (+100365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.733404 (+ 69450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.733704 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.809026  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:05.798357  4187 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.558s (SENT) [suppressed 28 similar messages]
W20260709 13:19:05.827764  4187 connection.cc:256] RPC call timeout handler was delayed by -1.0173166180002227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 13:19:05.773852  6316 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:05.788913  5941 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.822402  4214 rpcz_store.cc:276] 0709 13:19:04.783596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.788017 (+  4421us) service_pool.cc:224] Handling call
0709 13:19:05.801722 (+1013705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.838789  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.853459  4144 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:05.870577  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.875661  4291 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:05.752279  6429 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:05.865414  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.879771  4141 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:05.802958  6289 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.802801  4215 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:19:05.880888  4215 pending_rounds.cc:85] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 7
I20260709 13:19:05.886535  4217 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:05.887418  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1796) took 1035 ms. Trace:
I20260709 13:19:05.887880  4217 rpcz_store.cc:276] 0709 13:19:04.851918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.666600 (+814682us) service_pool.cc:224] Handling call
0709 13:19:05.887300 (+220700us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.881238  4215 pending_rounds.cc:107] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:19:05.890633  4215 raft_consensus.cc:2889] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:05.890435  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.891534  4139 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:05.900837  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.901736  4142 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:05.902974  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:05.903713  4142 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:05.905719  4044 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.877018  5941 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.916105  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1793) took 1065 ms. Trace:
I20260709 13:19:05.792650  6443 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:05.915680  4044 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 1 to 2, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.878909  6316 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:05.923151  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:05.940856  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1743) took 1306 ms. Trace:
W20260709 13:19:05.920360  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 420275us
I20260709 13:19:05.925241  4215 rpcz_store.cc:276] 0709 13:19:04.850830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.792901 (+942071us) service_pool.cc:224] Handling call
0709 13:19:05.798892 (+  5991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.892168 (+ 93276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.916031 (+ 23863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.937134  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.941459  4288 rpcz_store.cc:276] 0709 13:19:04.634077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.540768 (+906691us) service_pool.cc:224] Handling call
0709 13:19:05.733959 (+193191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.777701 (+ 43742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.940522 (+162821us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b5400276fd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:05.940763 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184208128}
I20260709 13:19:05.943675  4140 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:05.943946  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:05.948895  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 535635us
I20260709 13:19:05.907747  6283 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:05.972712  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1563) took 1172 ms. Trace:
I20260709 13:19:05.979132  4140 rpcz_store.cc:276] 0709 13:19:04.800097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.905809 (+1105712us) service_pool.cc:224] Handling call
0709 13:19:05.972609 (+ 66800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.981828  4140 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:05.983271  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1731) took 1381 ms. Trace:
I20260709 13:19:05.982831  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1565) took 1182 ms. Trace:
I20260709 13:19:05.991751  4140 rpcz_store.cc:276] 0709 13:19:04.800726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.980588 (+1179862us) service_pool.cc:224] Handling call
0709 13:19:05.981152 (+   564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.982472 (+  1320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.982753 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.939457  6316 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.006953  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1564) took 1206 ms. Trace:
W20260709 13:19:06.011817  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.978868  4112 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:06.013418  4144 rpcz_store.cc:276] 0709 13:19:04.800421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.532483 (+732062us) service_pool.cc:224] Handling call
0709 13:19:06.006697 (+474214us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b540017fa54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:06.006850 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123607296}
I20260709 13:19:05.948812  6423 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:06.018788  4142 raft_consensus.cc:606] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:06.030421  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1560) took 1225 ms. Trace:
I20260709 13:19:06.032539  4142 raft_consensus.cc:614] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:05.943190  6413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.016s	sys 0.027s
W20260709 13:19:05.807548  4042 rpcz_store.cc:269] 0709 13:18:53.216633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.217152 (+   519us) service_pool.cc:224] Handling call
0709 13:19:05.765898 (+12548746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:02.378007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:02.723064 (+345057us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:02.730763 (+  7699us) write_op.cc:435] Acquired schema lock
0709 13:19:02.741918 (+ 11155us) tablet.cc:662] Decoding operations
0709 13:19:02.824068 (+ 82150us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:02.824164 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:02.824202 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:02.826238 (+  2036us) tablet.cc:701] Row locks acquired
0709 13:19:02.826294 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:19:02.826496 (+   202us) write_op.cc:270] Start()
0709 13:19:02.826678 (+   182us) write_op.cc:276] Timestamp: P: 1783603142826420 usec, L: 0
0709 13:19:02.826704 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:19:02.827541 (+   837us) log.cc:844] Serialized 922 byte log entry
0709 13:19:03.348368 (+520827us) op_driver.cc:464] REPLICATION: finished
0709 13:19:03.869372 (+521004us) write_op.cc:301] APPLY: starting
0709 13:19:03.878826 (+  9454us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:03.905537 (+ 26711us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:03.951696 (+ 46159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:04.003050 (+ 51354us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:04.003480 (+   430us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:19:04.003531 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:04.003853 (+   322us) log.cc:844] Serialized 28 byte log entry
0709 13:19:04.004080 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.004183 (+   103us) write_op.cc:454] Released schema lock
0709 13:19:04.004255 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:04.011157 (+  6902us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.011197 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":163832,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":444226,"apply.run_cpu_time_us":3817,"apply.run_wall_time_us":169159,"num_ops":2,"prepare.queue_time_us":210830,"prepare.run_cpu_time_us":38236,"prepare.run_wall_time_us":503987,"raft.queue_time_us":300602,"raft.run_cpu_time_us":21541,"raft.run_wall_time_us":252071,"replication_time_us":487059,"thread_start_us":482941,"threads_started":4,"wal-append.queue_time_us":127288,"wal-append.run_cpu_time_us":119482,"wal-append.run_wall_time_us":2055085}]]}
I20260709 13:19:05.983788  4293 rpcz_store.cc:276] 0709 13:19:04.602341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.603173 (+   832us) service_pool.cc:224] Handling call
0709 13:19:04.603540 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.670562 (+ 67022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.670604 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.721744 (+ 51140us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b2c00138c78. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:19:04.722309 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.072312 (+350003us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:05.072401 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.072513 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.949735 (+877222us) raft_consensus.cc:1685] finished
0709 13:19:05.949777 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.983196 (+ 33419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29807,"raft.queue_time_us":69024,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":13788,"spinlock_wait_cycles":2889984,"thread_start_us":399210,"threads_started":2,"wal-append.queue_time_us":886117}
I20260709 13:19:06.034107  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:05.983356  6395 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:06.018028  6316 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.031358  4146 rpcz_store.cc:276] 0709 13:19:04.797674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.797812 (+   138us) service_pool.cc:224] Handling call
0709 13:19:05.412636 (+614824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.412936 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:05.496304 (+ 83368us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.016033 (+519729us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.016107 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.016176 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.016274 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.022545 (+  6271us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":233993,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":70,"thread_start_us":491424,"threads_started":1}
W20260709 13:19:06.036677  6413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.017s	sys 0.028s
I20260709 13:19:06.017649  6401 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.068449  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:06.070797  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 268032us
I20260709 13:19:06.035264  6283 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:06.039745  6423 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:06.060624  6343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.017s
I20260709 13:19:06.040220  6396 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.097710  4146 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:06.082612  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 131798us
I20260709 13:19:06.055032  6362 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:06.071030  6435 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:06.087191  6451 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:19:06.110400  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1546) took 1141 ms. Trace:
I20260709 13:19:06.070278  6239 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.119994  4146 rpcz_store.cc:276] 0709 13:19:04.968930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.097175 (+1128245us) service_pool.cc:224] Handling call
0709 13:19:06.097569 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.110064 (+ 12495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.110331 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.092499  6413 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:06.101644  6343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.000s	sys 0.019s
I20260709 13:19:06.125672  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.126467  4140 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:06.125048  4146 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:06.126523  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 183413us
I20260709 13:19:06.136480  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.078632  6395 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.109491  5879 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.151279  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.213653  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35142 (request call id 15) took 1245 ms. Trace:
I20260709 13:19:06.115269  6471 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.221264  4142 rpcz_store.cc:276] 0709 13:19:04.905522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.922962 (+1017440us) service_pool.cc:224] Handling call
0709 13:19:06.150662 (+227700us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b54003da754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ecdc853 00007fee43caa60a 00007fee3d2307d4 00007fee3d230762 00007fee3d230691 00007fee3d23060c 00007fee3d22f8c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:06.150820 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180735872}
W20260709 13:19:06.226962  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 248441us
I20260709 13:19:06.099157  6283 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.122630  6282 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:06.122401  6387 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:06.219468  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 137316us
I20260709 13:19:06.128067  6413 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.123101  6435 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:06.149595  4140 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:06.221434  4146 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
W20260709 13:19:06.149722  6452 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.328s	user 0.000s	sys 0.002s
I20260709 13:19:06.241168  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1741) took 1607 ms. Trace:
I20260709 13:19:06.247666  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.303258  4142 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:06.302518  4287 rpcz_store.cc:276] 0709 13:19:04.633742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.485029 (+851287us) service_pool.cc:224] Handling call
0709 13:19:05.485360 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.490042 (+  4682us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:05.918798 (+428756us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.240000 (+321202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.240459 (+   459us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:06.240554 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.240708 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.241054 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":428483,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":157036,"spinlock_wait_cycles":22272,"thread_start_us":740409,"threads_started":3}
I20260709 13:19:06.144770  6464 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.149065  6438 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:06.270951  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 154442us
W20260709 13:19:06.325572  4259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.032s	sys 0.063s
I20260709 13:19:06.213786  6458 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:06.326152  4259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.033s	sys 0.063s
I20260709 13:19:06.329895  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:06.148465  6381 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.385924  4144 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:06.477569  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1566) took 1676 ms. Trace:
I20260709 13:19:06.478056  4144 rpcz_store.cc:276] 0709 13:19:04.800978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.049668 (+1248690us) service_pool.cc:224] Handling call
0709 13:19:06.385540 (+335872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.477230 (+ 91690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.477498 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:06.479972  4138 consensus_meta.cc:287] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
I20260709 13:19:06.480500  4138 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
W20260709 13:19:06.392848  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.481133  4138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1540) took 1679 ms (client timeout 2025 ms). Trace:
I20260709 13:19:06.383811  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:06.384867  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.352078  6362 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:06.379508  4041 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.000s	sys 0.025s
W20260709 13:19:06.487142  4041 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.000s	sys 0.032s
I20260709 13:19:06.488821  6458 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.318928  6435 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.498365  6435 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:06.326231  6343 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:06.249014  6413 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:06.482012  4214 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:06.499527  6343 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.490876  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.279563  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:06.475263  4259 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:06.505231  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.506321  4144 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:06.508275  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.509047  4144 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:06.509766  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.510404  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.511250  4142 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
W20260709 13:19:06.512492  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.512681  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.512792  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.513362  6488 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:06.513684  4142 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:06.514009  6488 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:06.514881  6435 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:06.515537  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.515303  6488 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.515811  6435 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.516578  4142 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:06.518078  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.518952  4142 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:06.502148  6343 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.522089  4141 raft_consensus.cc:2393] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:19:06.481675  4138 rpcz_store.cc:269] 0709 13:19:04.802051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.712744 (+910693us) service_pool.cc:224] Handling call
0709 13:19:06.481068 (+768324us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:06.522921  4143 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.003s
I20260709 13:19:06.523375  4143 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:06.527560  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.528402  4292 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:06.499414  4145 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.000s
I20260709 13:19:06.532620  4145 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
W20260709 13:19:06.533303  4145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1544) took 1612 ms (client timeout 2145 ms). Trace:
I20260709 13:19:06.533996  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:06.229008  6465 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:06.227133  6480 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:06.538067  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1541) took 1695 ms. Trace:
I20260709 13:19:06.539932  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1797) took 1687 ms. Trace:
I20260709 13:19:06.536690  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:06.533820  4145 rpcz_store.cc:269] 0709 13:19:04.921083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.717913 (+796830us) service_pool.cc:224] Handling call
0709 13:19:06.533233 (+815320us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:06.467726  6441 consensus_meta.cc:287] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.003s
W20260709 13:19:06.373323  6456 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.458s	user 0.000s	sys 0.000s
W20260709 13:19:06.522368  6452 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:19:06.416774  6476 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.551044  4287 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:06.372563  6469 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:19:06.551003  4288 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.580706  6489 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.581521  6489 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.336613  6464 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.585119  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.585898  4924 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:06.336262  6404 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:06.552075  4216 rpcz_store.cc:276] 0709 13:19:04.852239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.791393 (+939154us) service_pool.cc:224] Handling call
0709 13:19:05.791740 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.792467 (+   727us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:06.078292 (+285825us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.539407 (+461115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.539505 (+    98us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:06.539575 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.539675 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.539837 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57965,"prepare.queue_time_us":582409,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":34812,"thread_start_us":648020,"threads_started":2,"wal-append.queue_time_us":406626}
I20260709 13:19:06.549276  4141 rpcz_store.cc:276] 0709 13:19:04.842424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.896310 (+1053886us) service_pool.cc:224] Handling call
0709 13:19:06.537967 (+641657us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:06.561748  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 282298us
I20260709 13:19:06.531932  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:19:06.589779  4891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.007s	sys 0.006s
I20260709 13:19:06.468897  6395 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.326056  6444 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:06.587175  6435 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:06.594713  6458 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:06.595933  6315 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.597316  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:06.598429  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:06.598860  4143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1545) took 1633 ms (client timeout 1541 ms). Trace:
W20260709 13:19:06.599251  4143 rpcz_store.cc:269] 0709 13:19:04.965740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.493078 (+527338us) service_pool.cc:224] Handling call
0709 13:19:06.598659 (+1105581us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400396cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:06.598779 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363345664}
W20260709 13:19:06.568923  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 71320.8us
I20260709 13:19:06.549404  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:06.343538  6438 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:06.572737  6429 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:06.567639  5879 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:06.600788  6395 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.465162  6475 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:06.602679  4140 raft_consensus.cc:606] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:06.604218  6475 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.600301  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:06.605898  6497 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:19:06.606321  6395 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.606866  6395 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:06.608099  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1557) took 1811 ms. Trace:
I20260709 13:19:06.249850  6459 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.328s
I20260709 13:19:06.607813  6395 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.608851  4147 rpcz_store.cc:276] 0709 13:19:04.796722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.797077 (+   355us) service_pool.cc:224] Handling call
0709 13:19:04.797502 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.797933 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.797963 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.798646 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.278814 (+480168us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:05.307635 (+ 28821us) log.cc:844] Serialized 14 byte log entry
0709 13:19:05.483806 (+176171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.483895 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.644012 (+160117us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b1800118240. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:19:05.646880 (+  2868us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b1800118240. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee42bb658f 00007fee3bbf5571 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd
0709 13:19:06.607828 (+960948us) raft_consensus.cc:1685] finished
0709 13:19:06.607855 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.608032 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180764,"prepare.queue_time_us":28481,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":177202,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":262,"spinlock_wait_cycles":67877120,"thread_start_us":479566,"threads_started":1,"wal-append.queue_time_us":963899}
I20260709 13:19:06.612742  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:06.613624  6387 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:06.614168  6448 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.862s	user 0.002s	sys 0.011s
W20260709 13:19:06.615273  6402 consensus_meta.cc:287] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.000s
I20260709 13:19:06.376384  6443 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:06.602813  6438 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.619388  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:06.619830  6438 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:06.620200  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.252085  6471 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.621223  4923 raft_consensus.cc:2410] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:06.621259  6475 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.621631  6371 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:06.620095  4287 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.603667  5879 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:06.320820  6423 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.623150  5879 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:06.624289  5879 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.515553  6413 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.589983  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:06.626959  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:06.590225  4891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.007s	sys 0.006s
I20260709 13:19:06.352483  6463 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:06.612640  6454 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.806s	user 0.001s	sys 0.004s
I20260709 13:19:06.614192  6387 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:06.630429  6387 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.562971  6465 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.628193  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.633704  4922 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
W20260709 13:19:06.569036  6455 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.585s	user 0.002s	sys 0.000s
I20260709 13:19:06.622252  6371 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:06.637367  4261 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.503s (SENT)
W20260709 13:19:06.639246  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 107338us
I20260709 13:19:06.646904  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:06.643679  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.648144  4928 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:06.642210  4288 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:06.651604  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.652807  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.661949  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.662253  6465 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:06.662976  4296 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:06.678382  4147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eff857a690104e20896367b8755773e0"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:06.679452  4147 raft_consensus.cc:606] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:06.680051  4147 raft_consensus.cc:614] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:06.682719  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:06.685081  4928 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:06.682585  4293 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:06.687124  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.662111  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.635409  6464 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:06.615764  6402 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.699726  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:06.712316  4292 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:06.657279  6239 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.703436  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 45198.6us
W20260709 13:19:06.704188  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66869us
I20260709 13:19:06.705044  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.663295  6467 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:06.714187  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.663079  6413 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:06.656971  6381 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:06.723968  4293 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:06.681842  6489 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:06.728720  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:06.728852  4111 connection.cc:256] RPC call timeout handler was delayed by -1.0613929900000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:19:06.750406  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1787) took 1977 ms. Trace:
I20260709 13:19:06.750921  4218 rpcz_store.cc:276] 0709 13:19:04.772928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.054020 (+281092us) service_pool.cc:224] Handling call
0709 13:19:05.054642 (+   622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.055276 (+   634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.055329 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.107720 (+ 52391us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.661216 (+553496us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:05.661272 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.661351 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.750133 (+1088782us) raft_consensus.cc:1685] finished
0709 13:19:06.750162 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.750325 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15642,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":28067,"thread_start_us":451063,"threads_started":1,"wal-append.queue_time_us":699046}
I20260709 13:19:06.752677  4287 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:06.753782  4139 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:06.728756  4288 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:06.568917  6480 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.657366  6315 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:19:06.747691  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.759811  4292 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:06.663182  6429 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:19:06.744227  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.764989  4296 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:06.591348  6476 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.757905  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.752737  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.761586  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:06.761204  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 217895us
I20260709 13:19:06.768021  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.768618  4140 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:06.769874  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.766963  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:06.771015  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:06.774436  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:06.774852  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:06.762007  6486 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.650398  6463 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.763480  6273 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:06.731770  6239 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.799886  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:06.815452  4138 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 1.
W20260709 13:19:06.793715  6331 consensus_meta.cc:287] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.060s	user 0.016s	sys 0.000s
I20260709 13:19:06.822252  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1555) took 1106 ms. Trace:
I20260709 13:19:06.823196  4139 rpcz_store.cc:276] 0709 13:19:05.715597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.909524 (+193927us) service_pool.cc:224] Handling call
0709 13:19:06.821855 (+912331us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54003d9854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:06.822140 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846610176}
I20260709 13:19:06.776811  6489 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.830842  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 251) took 2155 ms. Trace:
I20260709 13:19:06.817453  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:06.777050  6404 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:06.845678  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.839877  4892 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:06.796253  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:06.758385  6381 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.836302  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:06.831408  4295 rpcz_store.cc:276] 0709 13:19:04.675755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.526378 (+850623us) service_pool.cc:224] Handling call
0709 13:19:05.526899 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.928171 (+401272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.928214 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.964145 (+ 35931us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.189859 (+225714us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:06.189923 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.190046 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.830577 (+640531us) raft_consensus.cc:1685] finished
0709 13:19:06.830608 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.830771 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5924,"raft.queue_time_us":543515,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":18393,"thread_start_us":532322,"threads_started":2,"wal-append.queue_time_us":698454}
I20260709 13:19:06.851496  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:06.851989  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 126758us
I20260709 13:19:06.858673  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.859434  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.859920  4215 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:06.738641  6467 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:06.866190  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.866612  4287 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:06.868952  4287 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.814535  6413 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.892606  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.895006  4217 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
W20260709 13:19:06.894726  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 119969us
W20260709 13:19:06.895084  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55388.8us
I20260709 13:19:06.882750  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.897126  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:06.893129  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:06.912966  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:06.914077  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:06.915406  6508 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:06.916827  6371 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:06.899523  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.835227  6489 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:06.891253  4261 leader_election.cc:400] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:06.814810  6486 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.891746  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.874153  4923 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:06.934744  4261 leader_election.cc:403] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:06.935395  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.938133  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:06.941345  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:06.880255  6470 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:06.826498  6331 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:06.956636  4216 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:06.879988  6484 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.897083  6413 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:06.936028  5941 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.989s	user 0.012s	sys 0.008s
I20260709 13:19:06.864810  6404 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:06.942510  6496 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:19:06.942083  6489 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:06.990724  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 93684us
I20260709 13:19:07.178347  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:07.180190  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:07.074566  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.137079  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 246074us
W20260709 13:19:07.128456  6509 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:07.046949  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:07.091506  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:19:07.013310  6501 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:07.191149  4928 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:07.152292  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 353352us
W20260709 13:19:07.131228  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 190001us
I20260709 13:19:07.192416  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:07.131114  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:07.129403  6239 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:07.199623  4213 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:07.002751  6438 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.182420  4261 leader_election.cc:400] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:07.200541  4261 leader_election.cc:403] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:07.185403  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:06.997488  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:07.109961  6505 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:19:07.138691  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 201847us
I20260709 13:19:07.017484  6289 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:07.060920  6315 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.132120  6487 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:06.998494  6283 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:07.137166  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.201328  4220 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.187242  5879 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:07.223249  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 176450us
I20260709 13:19:07.017789  6386 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:07.081632  6402 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:07.135567  6471 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:07.214265  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:07.201260  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:07.178567  6464 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:07.236232  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:07.167559  6413 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.005236  6472 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:07.177428  5941 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:07.234473  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:07.229228  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:07.238636  6386 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:07.250900  6500 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:19:07.251341  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:07.253093  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:07.255182  4186 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:07.177031  6484 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:07.209057  6289 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:07.207440  6524 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:07.262832  4220 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:07.265470  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:07.257014  6516 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.300141  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 107993us
I20260709 13:19:07.235289  6476 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:07.233803  6521 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.306110  4217 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.309062  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:07.310410  6493 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:07.311190  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 56121.1us
I20260709 13:19:07.311859  6371 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:07.319463  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 136762us
I20260709 13:19:07.322126  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:07.330111  4928 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:07.339566  4927 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:07.256196  6395 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.345551  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:07.346102  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80779.4us
I20260709 13:19:07.357995  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:07.359500  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:07.299522  6239 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:07.269649  6524 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:07.306210  6386 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:07.300238  6517 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:07.370008  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:07.240907  6464 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:07.299865  6463 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:07.307806  6480 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:07.267635  6471 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:19:07.331926  6402 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.355983  6476 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.361348  6387 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.308593  6516 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:07.369537  6239 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.356694  6395 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:07.386999  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1803) took 2007 ms. Trace:
W20260709 13:19:07.434819  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 92859us
I20260709 13:19:07.369918  6524 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.440701  4213 rpcz_store.cc:276] 0709 13:19:05.379783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.681268 (+301485us) service_pool.cc:224] Handling call
0709 13:19:07.386672 (+1705404us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400215f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:07.386908 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3354742144}
I20260709 13:19:07.364488  6371 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:07.418188  6387 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.438341  6239 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:07.382506  6532 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:07.437852  6402 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:07.434191  6476 raft_consensus.cc:697] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:07.444481  6395 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:07.490160  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 255500us
W20260709 13:19:07.500694  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 130772us
I20260709 13:19:07.444175  6517 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.396641  6386 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:19:07.456887  4926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.015s	sys 0.029s
I20260709 13:19:07.427023  6463 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:19:07.491448  6518 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:19:07.457609  6315 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:19:07.522583  4926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.018s	sys 0.032s
W20260709 13:19:07.485801  6316 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.405s	user 0.007s	sys 0.009s
I20260709 13:19:07.396636  6289 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:07.525944  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:07.485351  6387 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:07.524737  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 83108.1us
I20260709 13:19:07.486425  6331 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:07.445151  6486 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:07.518385  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:07.504926  6402 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:07.519733  5879 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.518337  6404 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:07.580776  6483 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.589708  6483 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:07.593339  6529 log.cc:927] Time spent T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:07.593930  6371 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:07.595826  6519 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:19:07.596323  6516 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:07.596927  6507 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.372s	user 0.002s	sys 0.000s
W20260709 13:19:07.599149  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80872.2us
W20260709 13:19:07.554006  6473 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.416s	user 0.001s	sys 0.001s
I20260709 13:19:07.600056  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:07.604045  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:07.601680  4186 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:07.601696  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:07.554181  6503 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:07.616009  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.604885  4928 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:07.593933  6483 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:07.618662  4185 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:07.576107  6402 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:07.637904  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:07.577832  5941 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:07.580909  6289 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:07.624565  6521 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:07.570127  6515 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:07.640127  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:07.553647  6316 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:07.607699  6315 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:07.603387  6486 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:07.669773  4893 leader_election.cc:336] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.553s (SENT)
W20260709 13:19:07.661072  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 175211us
I20260709 13:19:07.598783  6331 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:19:07.525605  6517 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:07.690160  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.600415  5879 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:07.760636  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 155770us
I20260709 13:19:07.662173  6515 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.688840  4893 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:07.774899  4219 raft_consensus.cc:2368] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7.
W20260709 13:19:07.781061  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 111364us
W20260709 13:19:07.774107  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 412674us
I20260709 13:19:07.777074  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:07.784689  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:19:07.686697  6485 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:07.660986  6534 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:07.825426  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 191270us
W20260709 13:19:07.828861  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 155643us
I20260709 13:19:07.775691  6315 raft_consensus.cc:697] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:07.688459  6386 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:19:07.799435  6343 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.832731  6475 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:07.845291  4187 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.558s (SENT)
I20260709 13:19:07.787957  6515 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:07.801378  6552 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:07.787802  6484 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:07.827279  6532 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.859033  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:07.840557  6522 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:19:07.932627  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 81928.6us
I20260709 13:19:07.929941  6464 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:07.940150  6464 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:07.941238  6464 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:07.945382  6536 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:19:07.946358  6552 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.948663  6520 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.349s	user 0.002s	sys 0.000s
I20260709 13:19:07.948894  6484 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:07.949460  6484 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:07.950448  6517 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:07.950825  6484 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:07.952442  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1675) took 2922 ms. Trace:
I20260709 13:19:07.952890  4290 rpcz_store.cc:276] 0709 13:19:04.973085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.664596 (+691511us) service_pool.cc:224] Handling call
0709 13:19:05.664943 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.696777 (+ 31834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.696852 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.706612 (+  9760us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.030758 (+324146us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:06.030820 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.030911 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.895281 (+1864370us) raft_consensus.cc:1685] finished
0709 13:19:07.895311 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.895520 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":819,"raft.queue_time_us":444808,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":6744,"thread_start_us":275095,"threads_started":1,"wal-append.queue_time_us":1037007}
W20260709 13:19:07.955060  6506 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:19:07.957705  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:07.672260  6476 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:07.962211  4215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.061s	sys 0.081s
W20260709 13:19:07.962668  4215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.061s	sys 0.081s
W20260709 13:19:07.967994  4893 leader_election.cc:336] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.842s (SENT)
I20260709 13:19:07.968565  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:07.861217  6500 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
I20260709 13:19:07.947113  6552 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:07.931624  6475 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.032418  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:08.044732  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:08.033694  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:07.931072  6478 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:07.854952  6546 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.981694  6484 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:08.055382  4892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.004s	sys 0.003s
W20260709 13:19:08.055576  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 121313us
I20260709 13:19:08.071179  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:08.078015  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 476337us
I20260709 13:19:08.067157  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:08.116319  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:08.116166  4892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.008s	sys 0.004s
W20260709 13:19:08.120322  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 801662us
W20260709 13:19:07.851790  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 233256us
I20260709 13:19:08.003283  6465 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:08.018875  6443 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:08.137454  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:08.140897  4187 leader_election.cc:336] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.878s (SENT)
I20260709 13:19:08.152143  6553 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.151952  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 280) took 1252 ms. Trace:
I20260709 13:19:08.151376  4220 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:08.153529  4218 rpcz_store.cc:276] 0709 13:19:06.899870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.940953 (+ 41083us) service_pool.cc:224] Handling call
0709 13:19:06.941374 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.941640 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.941665 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.954512 (+ 12847us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.307969 (+353457us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:07.308009 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.308087 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.151729 (+843642us) raft_consensus.cc:1685] finished
0709 13:19:08.151760 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.151893 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":245871,"threads_started":1,"wal-append.queue_time_us":1139436}
I20260709 13:19:08.153558  6553 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:08.155642  6239 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.000s
I20260709 13:19:08.156183  6239 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.156818  6553 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:08.158254  4220 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:08.158802  6239 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:08.162300  4923 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.146s	user 0.013s	sys 0.002s
I20260709 13:19:08.162823  4923 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:08.163506  4923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 374) took 1424 ms. Trace:
I20260709 13:19:08.166901  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 278) took 1292 ms. Trace:
W20260709 13:19:08.169020  6525 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.525s	user 0.002s	sys 0.000s
W20260709 13:19:08.170441  6535 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.516s	user 0.002s	sys 0.000s
I20260709 13:19:08.028359  6521 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:08.177215  6542 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:19:08.179205  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1821) took 1221 ms. Trace:
W20260709 13:19:08.180466  6544 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:19:08.181216  6513 raft_consensus.cc:993] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
W20260709 13:19:08.189738  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 73747.3us
I20260709 13:19:08.189726  6471 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:19:08.190718  6528 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.530s	user 0.002s	sys 0.000s
I20260709 13:19:08.190656  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:08.191618  6516 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:08.192728  6471 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.193325  6516 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:08.193393  6471 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:08.194064  6387 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.001s
I20260709 13:19:08.196548  6387 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.197449  6331 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:08.198518  6331 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:08.198887  6331 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:08.199688  6331 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.200572  6387 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:08.201620  6331 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.208685  6471 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:08.004730  6532 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.211366  6532 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:08.215826  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:08.179699  4216 rpcz_store.cc:276] 0709 13:19:06.957777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.134563 (+176786us) service_pool.cc:224] Handling call
0709 13:19:07.190323 (+ 55760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.269076 (+ 78753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.269118 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.269668 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.490509 (+220841us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:07.612962 (+122453us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.619205 (+  6243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.619326 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.178909 (+559583us) raft_consensus.cc:1685] finished
0709 13:19:08.178935 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.179128 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96801,"prepare.queue_time_us":464072,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":235152,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":27785,"thread_start_us":226139,"threads_started":2,"wal-append.queue_time_us":374782}
I20260709 13:19:08.167423  4215 rpcz_store.cc:276] 0709 13:19:06.874469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.875306 (+   837us) service_pool.cc:224] Handling call
0709 13:19:06.875744 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.955852 (+ 80108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.955895 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.969270 (+ 13375us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.963050 (+993780us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:07.963104 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.963200 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.166638 (+203438us) raft_consensus.cc:1685] finished
0709 13:19:08.166664 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.166830 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110053,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":62041,"thread_start_us":876841,"threads_started":2,"wal-append.queue_time_us":1104813}
I20260709 13:19:08.216533  4220 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:08.227967  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:08.228868  4215 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:08.230262  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 398934us
W20260709 13:19:08.232089  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 115844us
I20260709 13:19:08.234815  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:08.133014  6316 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:08.233292  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:08.243902  4261 leader_election.cc:400] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:08.244354  4261 leader_election.cc:403] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.143404  6404 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:08.249792  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 264833us
I20260709 13:19:08.175757  6530 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.272s
I20260709 13:19:08.253420  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:08.285457  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:08.057377  6475 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.266536  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:08.291195  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 52359us
I20260709 13:19:08.163982  4923 rpcz_store.cc:276] 0709 13:19:06.739605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.744134 (+  4529us) service_pool.cc:224] Handling call
0709 13:19:08.163430 (+1419296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.293025  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:08.304136  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:08.241973  6239 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:08.257723  6503 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:08.283739  6553 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:08.290114  6387 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.283887  6532 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:08.142843  6315 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.311373  4218 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:08.314188  6486 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:19:08.315199  6554 raft_consensus.cc:1081] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
W20260709 13:19:08.296952  6524 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.003s
I20260709 13:19:08.316831  4110 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:08.313859  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 79166.9us
I20260709 13:19:08.332937  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:08.321029  4213 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.009s	sys 0.043s
I20260709 13:19:08.325492  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:08.330935  4215 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
W20260709 13:19:08.313339  6493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.000s	sys 0.021s
W20260709 13:19:08.310810  6489 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.120s	user 0.010s	sys 0.005s
W20260709 13:19:08.333619  4213 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.009s	sys 0.043s
I20260709 13:19:08.404786  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:08.337947  6552 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:08.338184  6472 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:08.339459  6289 consensus_meta.cc:287] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:19:08.318562  6532 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.340322  6503 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.342244  6565 raft_consensus.cc:2764] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:08.342878  6563 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:08.343415  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:08.344292  6386 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:08.345999  6513 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:08.344062  6567 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:08.348748  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:08.318380  6483 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.315443  6546 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:08.358526  6343 consensus_meta.cc:287] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.000s
I20260709 13:19:08.306998  6517 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:19:08.367606  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 258) took 1758 ms. Trace:
W20260709 13:19:08.367770  6413 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.111s	user 0.013s	sys 0.000s
I20260709 13:19:08.324416  6387 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:08.330837  6553 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:08.375371  6524 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:08.376065  6402 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.000s
I20260709 13:19:08.376307  5879 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:08.323613  6404 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.324080  6239 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:08.404541  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 213975us
W20260709 13:19:08.415268  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 127515us
W20260709 13:19:08.403870  6493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.000s	sys 0.021s
W20260709 13:19:08.423458  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80127.7us
I20260709 13:19:08.412281  6472 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.416105  6532 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:08.413437  6531 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:08.484803  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:08.417564  6552 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:08.491346  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 187273us
I20260709 13:19:08.427426  6513 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.492429  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:08.410288  6489 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:08.479519  4288 rpcz_store.cc:276] 0709 13:19:06.609494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.770497 (+161003us) service_pool.cc:224] Handling call
0709 13:19:06.770872 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.788329 (+ 17457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.788429 (+   100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.535181 (+746752us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b18000a8ac0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbc32a6 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a
0709 13:19:07.642908 (+107727us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.005118 (+362210us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:08.005197 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.005337 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.367310 (+361973us) raft_consensus.cc:1685] finished
0709 13:19:08.367330 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.367541 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10415,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":31898,"spinlock_wait_cycles":18826368,"thread_start_us":184864,"threads_started":1,"wal-append.queue_time_us":621500}
W20260709 13:19:08.493553  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.489828  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:08.498364  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:08.499193  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:08.500926  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:08.500970  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:08.501742  4292 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:08.501580  4295 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.477514  6546 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:08.509281  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:08.439829  6534 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:08.424479  6564 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:08.484153  6563 raft_consensus.cc:697] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:08.486496  4924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 372) took 1781 ms. Trace:
I20260709 13:19:08.517710  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1823) took 1363 ms. Trace:
I20260709 13:19:08.526168  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:08.526546  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:08.528180  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:08.545269  4289 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.545384  4287 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:08.484884  6404 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:08.493978  6515 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:19:08.531531  4295 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:08.484292  6567 raft_consensus.cc:697] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:08.536804  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.537165  4140 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:08.540320  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.483095  6343 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:08.556129  4213 rpcz_store.cc:276] 0709 13:19:07.153950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.447579 (+293629us) service_pool.cc:224] Handling call
0709 13:19:07.448028 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.448375 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:08.404924 (+956549us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.517201 (+112277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.517264 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:08.517339 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.517439 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.517625 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":355973,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":6653,"thread_start_us":1032560,"threads_started":2}
I20260709 13:19:08.569831  4222 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:08.493614  6531 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:08.501005  6513 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.579803  4289 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:08.486706  6371 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:19:08.488039  6413 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.488219  6402 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.731755  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:08.636114  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 143806us
I20260709 13:19:08.653141  6553 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:19:08.752092  6395 consensus_meta.cc:287] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.221s	user 0.003s	sys 0.009s
W20260709 13:19:08.736488  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 312208us
I20260709 13:19:08.581269  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.746174  6546 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.775660  6531 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.775776  6567 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:08.532254  6556 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.525327  6564 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.500958  6552 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:08.648125  6515 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:08.780462  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.781380  6471 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:08.496454  5879 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:08.781436  6476 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.783212  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.507073  6483 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:08.666556  6484 consensus_meta.cc:287] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.559s	user 0.004s	sys 0.008s
I20260709 13:19:08.784283  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:08.751389  6239 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.791807  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:08.799813  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.794377  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.751087  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 373) took 1790 ms. Trace:
I20260709 13:19:08.789799  6578 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:08.870091  6578 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:08.870636  6578 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.812462  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.871382  4138 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:08.872489  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.872967  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:08.718672  6381 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:08.543670  4924 rpcz_store.cc:276] 0709 13:19:06.695012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.710701 (+ 15689us) service_pool.cc:224] Handling call
0709 13:19:06.873648 (+162947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.929182 (+ 55534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.933664 (+  4482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.950325 (+ 16661us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:06.954512 (+  4187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.968074 (+ 13562us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.422780 (+1454706us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400560ed0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:08.475974 (+ 53194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327627136}
I20260709 13:19:08.802084  6395 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.823100  6471 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:08.733800  6565 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:08.815992  6563 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:08.825186  4141 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
W20260709 13:19:08.830974  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46775.9us
I20260709 13:19:08.908492  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:08.842293  4288 raft_consensus.cc:2410] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:08.805613  6564 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.819291  5879 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:08.852233  6515 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:08.852485  6573 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:19:08.843426  6331 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:08.918897  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.919242  6331 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:08.919744  6331 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:08.920523  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.917166  6553 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.922714  6404 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:08.826785  6476 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.866614  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.873234  4138 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:08.876629  6395 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:08.818445  4289 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:08.817472  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:08.881098  6565 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:08.883577  6471 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:08.880043  6489 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:08.893635  4219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1813) took 2009 ms (client timeout 1751 ms). Trace:
I20260709 13:19:08.894866  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1818) took 1938 ms. Trace:
I20260709 13:19:08.901873  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 181) took 2150 ms. Trace:
I20260709 13:19:08.904824  6541 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:08.914630  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:08.888072  6475 consensus_meta.cc:287] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:19:09.054126  4139 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:09.035142  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.109907  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:09.134218  4147 raft_consensus.cc:2376] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3. Re-sending same reply.
I20260709 13:19:08.994500  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:09.160813  4220 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 2.
I20260709 13:19:09.055182  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:09.173691  4142 raft_consensus.cc:2376] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6. Re-sending same reply.
W20260709 13:19:09.138350  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 223777us
I20260709 13:19:09.175459  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:09.058317  4927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42928 (request call id 183) took 2915 ms. Trace:
I20260709 13:19:09.179075  4927 rpcz_store.cc:276] 0709 13:19:06.143269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.143488 (+   219us) service_pool.cc:224] Handling call
0709 13:19:06.218431 (+ 74943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.352034 (+1133603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.057990 (+1705956us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002b2354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:09.058210 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558049024}
I20260709 13:19:08.927830  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1825) took 1613 ms. Trace:
I20260709 13:19:09.182898  4218 rpcz_store.cc:276] 0709 13:19:07.314223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.155054 (+840831us) service_pool.cc:224] Handling call
0709 13:19:08.155362 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.322293 (+166931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.927534 (+605241us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400181854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:08.927757 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358009600}
I20260709 13:19:09.189231  4292 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:19:09.134907  4219 rpcz_store.cc:269] 0709 13:19:06.884033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.899117 (+ 15084us) service_pool.cc:224] Handling call
0709 13:19:08.893333 (+1994216us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b5400025dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:08.893532 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931320704}
I20260709 13:19:09.181396  4221 rpcz_store.cc:276] 0709 13:19:06.956811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.956950 (+   139us) service_pool.cc:224] Handling call
0709 13:19:06.989699 (+ 32749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.197939 (+208240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.197979 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.198034 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:07.198067 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.894565 (+1696498us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400215554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:08.894624 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.894795 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478261632}
W20260709 13:19:09.027966  6579 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
W20260709 13:19:09.002597  6575 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
I20260709 13:19:09.219568  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:08.926570  6476 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:08.919255  6413 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:09.133347  6541 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:08.918007  5879 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:08.828857  6556 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.057907  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:09.260248  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:08.917327  6423 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:08.936414  6467 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:08.925276  6513 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:09.232853  6472 consensus_meta.cc:287] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.745s	user 0.003s	sys 0.007s
I20260709 13:19:09.262503  4140 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:09.262223  6472 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:09.263420  6513 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:09.234750  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:09.264657  4141 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.133322  4143 rpcz_store.cc:276] 0709 13:19:06.751112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.760031 (+  8919us) service_pool.cc:224] Handling call
0709 13:19:06.762948 (+  2917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.863496 (+100548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.863543 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.880761 (+ 17218us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.192837 (+312076us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:07.348300 (+155463us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.370517 (+ 22217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.901287 (+1530770us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54002a0654. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:08.901365 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.901437 (+    72us) raft_consensus.cc:1685] finished
0709 13:19:08.901556 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.901767 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23501,"prepare.queue_time_us":286209,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":7216,"raft.queue_time_us":183080,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":24255,"spinlock_wait_cycles":229950720,"thread_start_us":352576,"threads_started":2,"wal-append.queue_time_us":443308,"wal-append.run_cpu_time_us":4019,"wal-append.run_wall_time_us":1270469}
W20260709 13:19:09.220033  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 95768.8us
I20260709 13:19:08.988919  6483 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:09.236013  6541 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.196555  6521 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:09.232581  6478 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:09.269279  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:09.287209  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:09.298967  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:09.299774  4296 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:09.271906  4218 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:09.301540  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:09.267830  6524 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:09.164299  6402 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:09.305866  4144 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:09.290669  6471 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:19:09.298748  6423 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:19:09.306284  6467 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.306870  6480 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:09.307085  6521 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:09.307266  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:09.307830  6541 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.307886  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:09.167984  6475 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:09.303354  6478 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.232589  6570 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.293097  4292 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:19:09.315203  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.333197  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.287573  6483 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:09.304718  6532 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.810s	user 0.012s	sys 0.000s
I20260709 13:19:09.290370  6463 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:09.326531  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:09.254753  6565 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:09.325387  6480 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:09.330514  4147 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:09.336098  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:09.351056  4927 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:09.325438  6467 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:09.325410  6472 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:09.363965  4112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.014s
W20260709 13:19:09.364428  4112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.004s	sys 0.014s
I20260709 13:19:09.334672  6532 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.377174  6480 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.378607  4296 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:09.378768  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:09.373713  4141 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:09.324173  6331 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.397403  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:09.363881  6580 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:19:09.348829  6524 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:09.363171  6467 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.363507  6570 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:09.350399  6283 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:19:09.462318  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 282) took 2228 ms. Trace:
I20260709 13:19:09.378188  6532 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:09.379164  6395 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:09.462893  4217 rpcz_store.cc:276] 0709 13:19:07.233711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.224309 (+990598us) service_pool.cc:224] Handling call
0709 13:19:08.232886 (+  8577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.233193 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.233230 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.292724 (+ 59494us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.494108 (+201384us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:08.494157 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.494239 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.003877 (+509638us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:09.334778 (+330901us) raft_consensus.cc:1685] finished
0709 13:19:09.334799 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.462218 (+127419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132298624,"thread_start_us":165772,"threads_started":1,"wal-append.queue_time_us":341034}
I20260709 13:19:08.867287  4920 rpcz_store.cc:276] 0709 13:19:06.698595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.766008 (+ 67413us) service_pool.cc:224] Handling call
0709 13:19:06.879795 (+113787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.953452 (+ 73657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.961015 (+  7563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.973550 (+ 12535us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:06.986564 (+ 13014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.427788 (+1441224us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b540061f154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:08.439337 (+ 11549us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.486871 (+ 47534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95728384}
I20260709 13:19:09.350644  6463 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.414162  6480 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.436897  6524 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:09.529512  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:09.533607  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:09.534533  4146 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 2.
I20260709 13:19:09.470258  6552 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:09.594393  4928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 379) took 1449 ms. Trace:
I20260709 13:19:09.611610  4928 rpcz_store.cc:276] 0709 13:19:08.144937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.145089 (+   152us) service_pool.cc:224] Handling call
0709 13:19:08.145408 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.145769 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.145794 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.146245 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.504173 (+357928us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:08.504272 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.504390 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.594117 (+1089727us) raft_consensus.cc:1685] finished
0709 13:19:09.594142 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.594312 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61019,"raft.queue_time_us":98,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":213191,"threads_started":1,"wal-append.queue_time_us":1066784}
W20260709 13:19:09.623191  4295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.068s	sys 0.103s
W20260709 13:19:09.625428  4295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.068s	sys 0.103s
I20260709 13:19:09.670465  4928 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:09.670758  4113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.060s	sys 0.128s
W20260709 13:19:09.672583  4113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.060s	sys 0.128s
I20260709 13:19:09.490664  6395 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.749193  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:09.750129  4146 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
W20260709 13:19:09.754164  4290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.005s	sys 0.020s
W20260709 13:19:09.780519  4290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.006s	sys 0.020s
I20260709 13:19:09.542210  6381 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
W20260709 13:19:09.785211  6577 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
W20260709 13:19:09.858582  4261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.025s	sys 0.074s
I20260709 13:19:09.551961  6524 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:09.678484  6486 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.861651  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:09.872891  4142 raft_consensus.cc:606] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:09.872618  4291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.234s	user 0.010s	sys 0.021s
I20260709 13:19:09.873369  4142 raft_consensus.cc:614] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:09.873512  4291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.010s	sys 0.021s
I20260709 13:19:09.864457  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:09.879805  4146 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:09.882344  6381 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.866223  4261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.025s	sys 0.074s
W20260709 13:19:09.870013  6531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.012s	sys 0.018s
W20260709 13:19:09.860853  6503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.014s	sys 0.014s
W20260709 13:19:09.886126  4293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.067s	sys 0.063s
W20260709 13:19:09.877658  6239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.023s	sys 0.080s
W20260709 13:19:09.889495  4293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.067s	sys 0.063s
W20260709 13:19:09.886066  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 1.09427e+06us
I20260709 13:19:09.673548  6570 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.878044  6556 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:09.862164  6467 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:09.895831  4142 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:09.900887  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1585) took 1354 ms. Trace:
W20260709 13:19:09.889149  6531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.012s	sys 0.018s
W20260709 13:19:09.890061  6503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.014s	sys 0.015s
I20260709 13:19:09.882978  6381 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.493410  6521 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:09.890193  6239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.023s	sys 0.081s
I20260709 13:19:09.906960  4142 rpcz_store.cc:276] 0709 13:19:08.554488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.885168 (+1330680us) service_pool.cc:224] Handling call
0709 13:19:09.893266 (+  8098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.900608 (+  7342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.900820 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:09.892048  6331 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:09.916762  4142 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:09.917510  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1588) took 1362 ms. Trace:
I20260709 13:19:09.917909  4142 rpcz_store.cc:276] 0709 13:19:08.555300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.909707 (+1354407us) service_pool.cc:224] Handling call
0709 13:19:09.916456 (+  6749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.917263 (+   807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.917458 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:09.879381  6486 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.921108  4142 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:09.921844  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1589) took 1366 ms. Trace:
I20260709 13:19:09.922308  4142 rpcz_store.cc:276] 0709 13:19:08.555513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.918759 (+1363246us) service_pool.cc:224] Handling call
0709 13:19:09.920781 (+  2022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.921614 (+   833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.921792 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:09.920203  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:09.919960  6475 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:09.924625  6534 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.044s	sys 0.101s
W20260709 13:19:09.927588  6534 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.044s	sys 0.102s
I20260709 13:19:09.927942  6534 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:09.929032  6534 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.932561  6395 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:09.933326  6467 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:09.935230  6486 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:09.935473  6578 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.064s	user 0.009s	sys 0.003s
I20260709 13:19:09.935905  6578 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.936790  6381 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:09.938036  6578 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:09.913131  6556 consensus_queue.cc:1059] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:19:09.918592  6463 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
W20260709 13:19:09.923163  6564 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.003s
I20260709 13:19:09.970180  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:09.969153  4215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.000s	sys 0.048s
W20260709 13:19:09.971114  4215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.000s	sys 0.049s
I20260709 13:19:09.971014  4142 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
W20260709 13:19:09.979781  6541 consensus_meta.cc:287] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.002s
W20260709 13:19:09.982043  5879 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.004s
I20260709 13:19:09.982647  5879 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:09.975454  6564 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:09.990437  6582 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.242s	user 0.001s	sys 0.009s
I20260709 13:19:09.991012  6564 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:09.992190  4287 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:09.994334  4144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1573) took 1458 ms (client timeout 1933 ms). Trace:
W20260709 13:19:09.994884  4144 rpcz_store.cc:269] 0709 13:19:08.536379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.536495 (+   116us) service_pool.cc:224] Handling call
0709 13:19:09.994071 (+1457576us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400378554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:09.994252 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221110016}
I20260709 13:19:09.996452  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:09.998014  6483 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:09.999589  6593 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:19:10.004894  4146 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:10.009943  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1837) took 1644 ms. Trace:
I20260709 13:19:10.013284  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:10.014133  4144 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.010490  4216 rpcz_store.cc:276] 0709 13:19:08.365616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.365751 (+   135us) service_pool.cc:224] Handling call
0709 13:19:08.366098 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.366438 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.366465 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.366884 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.485748 (+118864us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:08.485800 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.485885 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.989636 (+1503751us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:10.001282 (+ 11646us) raft_consensus.cc:1685] finished
0709 13:19:10.001313 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.009846 (+  8533us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1645,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":270599552,"thread_start_us":118469,"threads_started":1,"wal-append.queue_time_us":159680}
I20260709 13:19:10.017365  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.018501  4142 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:09.971900  6381 raft_consensus.cc:3055] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:10.030737  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1777) took 1523 ms. Trace:
I20260709 13:19:10.031219  4295 rpcz_store.cc:276] 0709 13:19:08.507553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.571478 (+ 63925us) service_pool.cc:224] Handling call
0709 13:19:08.758713 (+187235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.773992 (+ 15279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.774022 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.774560 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.627663 (+853103us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:09.627721 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.627817 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.998849 (+371032us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:10.030378 (+ 31529us) raft_consensus.cc:1685] finished
0709 13:19:10.030407 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.030661 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7130,"raft.queue_time_us":95528,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":5007,"spinlock_wait_cycles":2713344,"thread_start_us":852614,"threads_started":1,"wal-append.queue_time_us":1111158}
I20260709 13:19:10.033615  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.034653  4295 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
W20260709 13:19:10.037627  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 119602us
I20260709 13:19:10.044518  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.020115  6483 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:10.056164  6362 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.056391  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.073877  4142 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:10.075078  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.056854  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.022323  6381 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:10.078540  6381 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.077486  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:10.065349  6480 consensus_meta.cc:287] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.003s
W20260709 13:19:10.066872  6478 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.000s
I20260709 13:19:10.086270  4144 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:10.080883  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.083801  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.039865  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:10.055441  6564 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:10.091969  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:10.082808  6537 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.051s	sys 0.121s
W20260709 13:19:10.094566  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 54780us
W20260709 13:19:10.095157  6537 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.051s	sys 0.121s
I20260709 13:19:10.098367  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1578) took 1553 ms. Trace:
I20260709 13:19:10.095508  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:10.096140  6463 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:10.264988  6315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.911s	user 0.003s	sys 0.031s
W20260709 13:19:10.265463  6517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.448s	user 0.004s	sys 0.008s
I20260709 13:19:10.092216  6564 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:10.079962  6483 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:10.159775  5879 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:10.092404  6480 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:10.280018  4287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 1781) took 1708 ms (client timeout 2160 ms). Trace:
W20260709 13:19:10.280974  6592 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.427s	user 0.003s	sys 0.002s
I20260709 13:19:10.282639  6404 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:10.288925  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 263) took 2029 ms. Trace:
I20260709 13:19:10.292922  6387 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:10.410776  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:10.399087  6517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.585s	user 0.005s	sys 0.008s
W20260709 13:19:10.289526  4222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 277) took 3424 ms (client timeout 1832 ms). Trace:
I20260709 13:19:10.292224  4145 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:10.291112  4288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 1763) took 1793 ms (client timeout 2206 ms). Trace:
I20260709 13:19:10.414486  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:10.340440  4143 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.014s	sys 0.026s
W20260709 13:19:10.414755  4288 rpcz_store.cc:269] 0709 13:19:08.497807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.498039 (+   232us) service_pool.cc:224] Handling call
0709 13:19:10.167568 (+1669529us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54003f1e54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:10.291037 (+123469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787895168}
W20260709 13:19:10.415259  4143 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.014s	sys 0.026s
W20260709 13:19:10.284688  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.397574  6463 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.289588  4214 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:10.417243  6618 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:10.419168  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1807) took 3565 ms. Trace:
W20260709 13:19:10.419710  6613 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:19:10.427850  6483 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:10.408681  6508 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.428823  6508 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.404186  6564 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.431505  6508 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:10.404862  6570 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.433224  6570 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.434787  4216 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:10.435281  6570 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:10.287165  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.293354  4140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1594) took 1494 ms (client timeout 1621 ms). Trace:
I20260709 13:19:10.297377  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1838) took 1501 ms. Trace:
W20260709 13:19:10.438536  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.284569  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:10.413842  4222 rpcz_store.cc:269] 0709 13:19:06.865523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.865771 (+   248us) service_pool.cc:224] Handling call
0709 13:19:10.178978 (+3313207us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54002f3ad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:10.289422 (+110444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3831964544}
I20260709 13:19:10.438817  4215 rpcz_store.cc:276] 0709 13:19:08.795758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.796497 (+   739us) service_pool.cc:224] Handling call
0709 13:19:08.798446 (+  1949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.989778 (+191332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.989805 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.129562 (+139757us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.973832 (+844270us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:09.973881 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.189087 (+215206us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54001f7054. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:10.189147 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.297010 (+107863us) raft_consensus.cc:1685] finished
0709 13:19:10.297036 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.297297 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":999,"raft.queue_time_us":1303,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":109193,"spinlock_wait_cycles":338583936,"thread_start_us":719354,"threads_started":1,"wal-append.queue_time_us":1079753}
I20260709 13:19:10.355175  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1582) took 1809 ms. Trace:
I20260709 13:19:10.356078  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.440618  4146 rpcz_store.cc:276] 0709 13:19:08.545763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.881933 (+1336170us) service_pool.cc:224] Handling call
0709 13:19:09.882349 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.005523 (+123174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.188631 (+183108us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003dac54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:10.355110 (+166479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276781312}
I20260709 13:19:10.441327  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.419543  4214 rpcz_store.cc:276] 0709 13:19:06.853935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.857504 (+  3569us) service_pool.cc:224] Handling call
0709 13:19:10.289402 (+3431898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.417175 (+127773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.418946 (+  1771us) spinlock_profiling.cc:243] Waited 3.4 s on lock 0x7b54002f3ad0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:10.419090 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7812594944}
I20260709 13:19:10.441896  4292 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.349001  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:10.438470  4140 rpcz_store.cc:269] 0709 13:19:08.798460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.866345 (+ 67885us) service_pool.cc:224] Handling call
0709 13:19:10.185441 (+1319096us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400018bd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:10.293292 (+107851us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776054528}
I20260709 13:19:10.442919  4138 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 2: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:10.443327  4138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1607) took 1522 ms (client timeout 1933 ms). Trace:
W20260709 13:19:10.443718  4138 rpcz_store.cc:269] 0709 13:19:08.921269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.348655 (+1427386us) service_pool.cc:224] Handling call
0709 13:19:10.443264 (+ 94609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.444983  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.286257  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.446961  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.447960  4296 raft_consensus.cc:2410] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:19:10.355681  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.279338  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.448624  4139 raft_consensus.cc:2376] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7. Re-sending same reply.
W20260709 13:19:10.449095  4139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1579) took 1904 ms (client timeout 2202 ms). Trace:
W20260709 13:19:10.449498  4139 rpcz_store.cc:269] 0709 13:19:08.545079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.155060 (+1609981us) service_pool.cc:224] Handling call
0709 13:19:10.449044 (+293984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.086014  6362 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.090670  6478 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.102821  4141 rpcz_store.cc:276] 0709 13:19:08.544856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.387775 (+842919us) service_pool.cc:224] Handling call
0709 13:19:09.401383 (+ 13608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.857665 (+456282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.857701 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.857756 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:09.857809 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.098036 (+240227us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540038f254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:10.098102 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.098289 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048869248}
W20260709 13:19:10.390924  4113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.008s	sys 0.006s
W20260709 13:19:10.457544  4113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.008s	sys 0.006s
I20260709 13:19:10.457983  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:10.391173  4294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.537s	user 0.000s	sys 0.015s
W20260709 13:19:10.391475  4110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.011s	sys 0.003s
W20260709 13:19:10.459393  4294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.605s	user 0.000s	sys 0.015s
W20260709 13:19:10.459451  4110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.011s	sys 0.003s
W20260709 13:19:10.459863  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 651238us
I20260709 13:19:10.460209  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1775) took 1955 ms. Trace:
I20260709 13:19:10.460614  4294 rpcz_store.cc:276] 0709 13:19:08.504494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.544848 (+ 40354us) service_pool.cc:224] Handling call
0709 13:19:08.797133 (+252285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.805020 (+  7887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.805054 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.812133 (+  7079us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.459888 (+1647755us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:10.459928 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.459993 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.460033 (+    40us) raft_consensus.cc:1685] finished
0709 13:19:10.460043 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.460158 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80822,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":11455,"thread_start_us":1605308,"threads_started":1,"wal-append.queue_time_us":1508878}
I20260709 13:19:10.397801  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:10.403036  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.867s (SENT)
I20260709 13:19:10.462381  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:10.463267  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 60270.2us
I20260709 13:19:10.301438  6546 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:10.406656  4287 rpcz_store.cc:269] 0709 13:19:08.572026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.659364 (+ 87338us) service_pool.cc:224] Handling call
0709 13:19:10.162121 (+1502757us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002d5fd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:10.279952 (+117831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2758688128}
W20260709 13:19:10.391398  6563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.010s	sys 0.004s
W20260709 13:19:10.398895  6315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.043s	user 0.003s	sys 0.032s
W20260709 13:19:10.384078  6590 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.010s
I20260709 13:19:10.346652  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:10.388562  6481 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.411976  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 316521us
I20260709 13:19:10.409394  4290 rpcz_store.cc:276] 0709 13:19:08.259867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.260062 (+   195us) service_pool.cc:224] Handling call
0709 13:19:08.303966 (+ 43904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.799836 (+1495870us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:09.799891 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.799968 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:09.800023 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.167197 (+367174us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400278dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:10.288718 (+121521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.288856 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69596,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":24685,"spinlock_wait_cycles":1224983424,"thread_start_us":944718,"threads_started":1}
W20260709 13:19:10.438071  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 489947us
I20260709 13:19:10.451067  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:10.451627  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.488251  4296 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:10.452878  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.453490  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:10.490054  4295 raft_consensus.cc:2410] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:10.453763  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1567) took 1945 ms. Trace:
I20260709 13:19:10.491274  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:10.454710  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:10.455448  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.441576  6463 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:10.465456  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:10.466409  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:10.491055  4145 rpcz_store.cc:276] 0709 13:19:08.507972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.508177 (+   205us) service_pool.cc:224] Handling call
0709 13:19:08.581807 (+ 73630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.414456 (+1832649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.453540 (+ 39084us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400286254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:10.453708 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3740379392}
I20260709 13:19:10.470158  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:10.494338  4927 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 1.
W20260709 13:19:10.494627  4187 connection.cc:256] RPC call timeout handler was delayed by -1.081073361000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260709 13:19:10.471809  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:10.495476  4187 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.562s (SENT)
I20260709 13:19:10.495770  4217 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:10.464555  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.473083  4292 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:10.474956  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.449294  6472 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:10.472506  6563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.011s	sys 0.005s
I20260709 13:19:10.482347  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1774) took 1978 ms. Trace:
I20260709 13:19:10.487546  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.511718  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 1795) took 1216 ms. Trace:
I20260709 13:19:10.511950  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:10.464440  6538 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.523504  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:10.490366  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.524382  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:10.524611  4287 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:10.501647  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:10.503153  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:10.480927  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.413383  6480 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.506624  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:10.478322  6590 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.011s
I20260709 13:19:10.505580  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.514560  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:10.491931  4216 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:10.518005  4892 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:10.509799  4291 rpcz_store.cc:276] 0709 13:19:08.504212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.527729 (+ 23517us) service_pool.cc:224] Handling call
0709 13:19:08.638099 (+110370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.998343 (+360244us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b48002001d8. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:19:09.877802 (+879459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.877836 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.883622 (+  5786us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.198297 (+314675us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:10.198353 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.198455 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.459536 (+261081us) raft_consensus.cc:1685] finished
0709 13:19:10.459560 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.482261 (+ 22701us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202057,"raft.run_cpu_time_us":1505,"raft.run_wall_time_us":155180,"spinlock_wait_cycles":5514496,"thread_start_us":1522128,"threads_started":2,"wal-append.queue_time_us":454972}
W20260709 13:19:10.519168  6602 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:10.519080  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.537214  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.537608  4141 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:10.519908  6478 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:10.512053  4289 rpcz_store.cc:276] 0709 13:19:09.295089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.458976 (+1163887us) service_pool.cc:224] Handling call
0709 13:19:10.511665 (+ 52689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.520717  6362 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:10.549801  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.550395  4290 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:10.551054  4217 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:10.508325  6404 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.520931  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:10.523670  4296 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:10.563330  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.564814  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.565461  4296 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.504624  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.523175  4218 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:19:10.567128  4218 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:10.523168  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:10.526465  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:10.531754  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:10.568482  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:10.533807  4214 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:10.536743  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:10.570080  4221 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.538349  4295 raft_consensus.cc:2410] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:10.544927  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.571744  4287 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:10.492364  6609 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:10.555989  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1580) took 2010 ms. Trace:
W20260709 13:19:10.557058  4261 connection.cc:256] RPC call timeout handler was delayed by -4.1566541870001856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:19:10.576107  4261 connection.cc:256] RPC call timeout handler was delayed by -4.1458541870001682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 13:19:10.560468  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:10.576057  4143 rpcz_store.cc:276] 0709 13:19:08.545314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.388432 (+843118us) service_pool.cc:224] Handling call
0709 13:19:09.420436 (+ 32004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.420721 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:10.433093 (+1012372us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.555648 (+122555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.555696 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:10.555754 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.555816 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.555933 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":929787,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":4792,"thread_start_us":1041929,"threads_started":2}
I20260709 13:19:10.560829  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:10.508103  6508 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:10.569123  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 46045.8us
I20260709 13:19:10.541430  6567 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:10.574491  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:10.568971  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1793) took 1275 ms. Trace:
I20260709 13:19:10.593466  4294 rpcz_store.cc:276] 0709 13:19:09.293674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.536799 (+1243125us) service_pool.cc:224] Handling call
0709 13:19:10.568457 (+ 31658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.568658 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.568682 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.568722 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.568780 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.568832 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.568924 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.587088  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.594833  4289 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:10.536872  6599 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:10.591742  4893 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.832s (SENT)
I20260709 13:19:10.598798  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:10.600087  4893 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.947s (SENT)
I20260709 13:19:10.574450  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.601231  4141 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:10.603039  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:10.597221  4287 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:10.609925  4216 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:10.617753  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:10.618629  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.620934  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:10.560545  6464 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.626791  4294 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:10.627182  4294 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:10.513159  6472 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.571269  6538 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:10.622903  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.623909  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.560316  6521 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.569218  6541 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.503005  6481 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.631574  4296 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:10.633131  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.587736  6478 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:10.636690  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.592756  6567 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:10.642021  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88411.4us
I20260709 13:19:10.649941  4138 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:10.641064  4146 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
I20260709 13:19:10.651000  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:10.658923  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 133471us
I20260709 13:19:10.670071  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.570932  6404 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:10.680240  4296 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:10.643523  4294 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:10.684867  4294 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:10.622077  6566 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:10.686883  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.680905  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:10.687857  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 87725us
W20260709 13:19:10.681157  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 104475us
I20260709 13:19:10.634265  6610 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:10.688900  4110 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:10.689265  4928 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.690479  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.693501  4143 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:10.694872  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.696221  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:10.681319  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:10.699168  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:10.699853  4922 raft_consensus.cc:1240] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:10.700232  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49319.8us
I20260709 13:19:10.598802  6508 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:10.701447  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:10.701654  4261 connection.cc:256] RPC call timeout handler was delayed by -4.110700190000216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:19:10.713094  4261 connection.cc:256] RPC call timeout handler was delayed by -4.1017001900002015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:19:10.713719  4261 connection.cc:256] RPC call timeout handler was delayed by -4.0855541870000707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
I20260709 13:19:10.709699  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:10.592097  6609 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:10.717900  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
W20260709 13:19:10.751394  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 70563.9us
I20260709 13:19:10.753969  4141 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:10.754561  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1596) took 1899 ms. Trace:
I20260709 13:19:10.754868  4141 rpcz_store.cc:276] 0709 13:19:08.855098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.709233 (+1854135us) service_pool.cc:224] Handling call
0709 13:19:10.753667 (+ 44434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.754332 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.754511 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.678282  6601 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.645306  6554 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:19:10.634327  6464 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:10.683449  6567 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.656788  6530 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 13:19:10.757946  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 56569.3us
I20260709 13:19:10.761361  4146 raft_consensus.cc:606] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:10.757978  4143 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:10.718604  6563 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:10.716398  6589 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:10.679322  6541 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:10.763275  4261 connection.cc:256] RPC call timeout handler was delayed by -4.0462537809999048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2703s for a response
W20260709 13:19:10.786422  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.773967  4928 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:10.683264  6521 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:10.779047  4138 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:10.774940  4146 raft_consensus.cc:614] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:10.749351  6413 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.787356  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.759181  4296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:10.787782  4294 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:19:10.757110  6588 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:19:10.759433  6538 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:10.858675  6589 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:11.556102  6609 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:11.778172  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1796) took 2446 ms. Trace:
I20260709 13:19:11.779284  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35142 (request call id 19) took 1276 ms. Trace:
I20260709 13:19:11.779920  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1597) took 2886 ms. Trace:
W20260709 13:19:11.325065  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 540047us
W20260709 13:19:10.800949  4261 connection.cc:256] RPC call timeout handler was delayed by -3.8677001900000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 13:19:11.781183  4261 connection.cc:256] RPC call timeout handler was delayed by -3.8605541870001616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
W20260709 13:19:11.781533  4261 connection.cc:256] RPC call timeout handler was delayed by -3.8353541870001209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
W20260709 13:19:11.781883  4261 connection.cc:256] RPC call timeout handler was delayed by -3.81015418700008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
W20260709 13:19:11.782259  4261 connection.cc:256] RPC call timeout handler was delayed by -3.7660001900001134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 13:19:11.782622  4261 connection.cc:256] RPC call timeout handler was delayed by -3.7474537809998765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30350000000000005s for a response
W20260709 13:19:11.782969  4261 connection.cc:256] RPC call timeout handler was delayed by -3.09173612099994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:19:11.783319  4261 connection.cc:256] RPC call timeout handler was delayed by -3.0649541870002395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3073s for a response
W20260709 13:19:11.783717  4261 connection.cc:256] RPC call timeout handler was delayed by -2.9269454790000964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:19:11.784097  4261 connection.cc:256] RPC call timeout handler was delayed by -2.8459454789999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:19:11.795862  6609 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.444125  6623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.004s	sys 0.022s
I20260709 13:19:11.563050  4926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 362) took 1042 ms. Trace:
I20260709 13:19:11.796483  6609 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:11.780539  4138 rpcz_store.cc:276] 0709 13:19:08.893552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.727224 (+1833672us) service_pool.cc:224] Handling call
0709 13:19:10.775679 (+ 48455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.779670 (+1003991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.779868 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.919292  4217 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:19:11.434926  6564 consensus_meta.cc:287] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.004s	user 0.003s	sys 0.006s
I20260709 13:19:11.315927  6541 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:11.502240  6637 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:19:11.546274  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1595) took 2718 ms. Trace:
I20260709 13:19:11.852113  4143 rpcz_store.cc:276] 0709 13:19:08.828390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.714832 (+1886442us) service_pool.cc:224] Handling call
0709 13:19:10.757825 (+ 42993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.774689 (+ 16864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.546192 (+771503us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:11.189944  6463 consensus_meta.cc:287] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.000s
I20260709 13:19:11.016460  6630 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.853s
I20260709 13:19:11.786348  6413 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:11.189250  6481 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:11.787123  4296 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:19:10.922794  6614 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.433s	user 0.002s	sys 0.000s
I20260709 13:19:10.917526  6570 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.923s
W20260709 13:19:11.854223  4893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.006s	sys 0.009s
W20260709 13:19:11.329861  4186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.012s
I20260709 13:19:11.547688  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1600) took 2653 ms. Trace:
W20260709 13:19:11.858000  4186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.000s	sys 0.021s
W20260709 13:19:11.858340  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 1.14104e+06us
I20260709 13:19:11.858084  4141 rpcz_store.cc:276] 0709 13:19:08.894757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.755527 (+1860770us) service_pool.cc:224] Handling call
0709 13:19:11.546986 (+791459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.547230 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.547268 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.547325 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.547391 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.547470 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.547615 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:11.854262  4113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.007s	sys 0.007s
W20260709 13:19:11.857870  4893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.006s	sys 0.009s
W20260709 13:19:11.860011  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 1.10699e+06us
W20260709 13:19:11.752679  4213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.000s	sys 0.020s
W20260709 13:19:11.861364  4213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.000s	sys 0.022s
I20260709 13:19:10.802913  6563 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:10.858527  6530 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:10.773808  6610 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:11.348560  6513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.017s	sys 0.002s
I20260709 13:19:11.779680  4146 rpcz_store.cc:276] 0709 13:19:10.502957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.686418 (+183461us) service_pool.cc:224] Handling call
0709 13:19:11.779192 (+1092774us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:11.444252  4262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.010s
W20260709 13:19:11.876196  4262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.008s	sys 0.018s
I20260709 13:19:11.793097  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:11.774602  4144 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:11.778579  4291 rpcz_store.cc:276] 0709 13:19:09.332156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.539533 (+1207377us) service_pool.cc:224] Handling call
0709 13:19:10.568278 (+ 28745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.568648 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.568678 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.620097 (+ 51419us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.761108 (+141011us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:10.761162 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.761260 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.777941 (+1016681us) raft_consensus.cc:1685] finished
0709 13:19:11.777962 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.778109 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6671,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":35993,"thread_start_us":80902,"threads_started":1,"wal-append.queue_time_us":161141}
W20260709 13:19:11.796557  6623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.010s	sys 0.024s
I20260709 13:19:11.882812  6413 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:11.885226  6563 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:11.888513  6513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.020s	sys 0.003s
W20260709 13:19:11.796149  4261 connection.cc:256] RPC call timeout handler was delayed by -2.5345454789999167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
I20260709 13:19:11.796825  4926 rpcz_store.cc:276] 0709 13:19:10.520414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.524051 (+  3637us) service_pool.cc:224] Handling call
0709 13:19:11.561917 (+1037866us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbde9c 00007fee3bbbda5b 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:19:11.562217 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.562532 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.562573 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.562639 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:11.562713 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.562796 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.562965 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34310144}
W20260709 13:19:11.889166  4261 connection.cc:256] RPC call timeout handler was delayed by -2.5138454790001106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:19:11.889488  4261 connection.cc:256] RPC call timeout handler was delayed by -2.4463454790000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:19:11.889775  4261 connection.cc:256] RPC call timeout handler was delayed by -2.4166454789999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 13:19:11.890329  4261 connection.cc:256] RPC call timeout handler was delayed by -2.4130454789999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 13:19:11.851095  6521 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:11.854534  4296 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:11.875655  6538 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:10.771581  6534 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:10.859884  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.892678  6609 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:11.893582  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.876533  6610 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.894258  6610 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:11.790095  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.862280  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 294) took 1383 ms. Trace:
I20260709 13:19:11.895470  4213 rpcz_store.cc:276] 0709 13:19:10.478714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.479359 (+   645us) service_pool.cc:224] Handling call
0709 13:19:10.479724 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.480008 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:10.848297 (+368289us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18003ac5a0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3e88a4bc 00007fee3bbd848b 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf2455 00007fee426da3c7 00007fee3ecec9a7 00007fee3ecfc0bf
0709 13:19:10.848533 (+   236us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.861933 (+1013400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.861984 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:11.862038 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.862101 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.862212 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221153,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":26486,"raft.queue_time_us":6004,"spinlock_wait_cycles":9197824,"thread_start_us":1200221,"threads_started":2,"wal-append.queue_time_us":904257}
I20260709 13:19:11.799683  6564 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:11.899286  6563 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:11.899672  4287 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.899838  6563 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:11.854179  6641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.008s
W20260709 13:19:11.901084  6641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.001s	sys 0.009s
W20260709 13:19:11.184396  6625 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.468s	user 0.004s	sys 0.000s
W20260709 13:19:10.930186  6617 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.377s	user 0.001s	sys 0.001s
W20260709 13:19:11.191154  6628 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
W20260709 13:19:11.443936  6595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.004s	sys 0.014s
W20260709 13:19:11.191856  6626 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 13:19:11.507755  6508 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:11.789002  6590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.000s	sys 0.019s
W20260709 13:19:11.185046  6627 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.407s	user 0.000s	sys 0.000s
I20260709 13:19:10.929912  6480 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:11.862468  6567 consensus_meta.cc:287] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.069s	user 0.011s	sys 0.000s
I20260709 13:19:11.871734  6530 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:11.857620  6463 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:11.309264  6517 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.580s
I20260709 13:19:11.342729  6464 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:11.914351  6590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.339s	user 0.001s	sys 0.023s
W20260709 13:19:11.924820  6546 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.453s	user 0.008s	sys 0.003s
I20260709 13:19:11.925542  6563 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:11.853415  4110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.007s	sys 0.007s
W20260709 13:19:11.956298  4110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.209s	user 0.008s	sys 0.008s
W20260709 13:19:11.957522  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 1.26855e+06us
I20260709 13:19:11.957932  4138 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:11.959661  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 190) took 1973 ms. Trace:
W20260709 13:19:11.797190  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.871857  4141 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:11.960166  4146 rpcz_store.cc:276] 0709 13:19:09.985619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.956904 (+1971285us) service_pool.cc:224] Handling call
0709 13:19:11.958039 (+  1135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.958663 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.958754 (+    91us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.958871 (+   117us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:11.958975 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.959102 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.959380 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.961596  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1614) took 2114 ms. Trace:
I20260709 13:19:11.962181  4141 rpcz_store.cc:276] 0709 13:19:09.847292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.871172 (+2023880us) service_pool.cc:224] Handling call
0709 13:19:11.871579 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.960923 (+ 89344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.961393 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:11.794301  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.964754  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1619) took 1952 ms. Trace:
W20260709 13:19:11.859635  4113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.008s	sys 0.007s
I20260709 13:19:11.965219  4141 rpcz_store.cc:276] 0709 13:19:10.012313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.963195 (+1950882us) service_pool.cc:224] Handling call
0709 13:19:11.963737 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.964325 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.964378 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.964443 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:11.964491 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.964554 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.964674 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.964246  4146 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:11.871735  4143 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:11.968389  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1613) took 2291 ms. Trace:
I20260709 13:19:11.968905  4143 rpcz_store.cc:276] 0709 13:19:09.676484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.853200 (+2176716us) service_pool.cc:224] Handling call
0709 13:19:11.871426 (+ 18226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.967686 (+ 96260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.968173 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.877015  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1602) took 2981 ms. Trace:
I20260709 13:19:11.970177  4144 rpcz_store.cc:276] 0709 13:19:08.895465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.773933 (+2878468us) service_pool.cc:224] Handling call
0709 13:19:11.774360 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.876801 (+102441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.876965 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.973438  4147 raft_consensus.cc:2410] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:11.979403  4187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.280s	user 0.005s	sys 0.037s
W20260709 13:19:11.979910  4187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.006s	sys 0.037s
W20260709 13:19:11.870716  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.980314  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 1.28074e+06us
W20260709 13:19:11.890625  4261 connection.cc:256] RPC call timeout handler was delayed by -2.3293454790000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 13:19:11.878958  4291 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:11.981645  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9234454790000655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2625s for a response
W20260709 13:19:11.982191  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7227454789999683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2848s for a response
I20260709 13:19:11.982647  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1712) took 1916 ms. Trace:
I20260709 13:19:11.876272  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1769) took 3376 ms. Trace:
I20260709 13:19:11.983444  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:11.065109  4221 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:11.983887  4293 rpcz_store.cc:276] 0709 13:19:08.499865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.499968 (+   103us) service_pool.cc:224] Handling call
0709 13:19:08.526100 (+ 26132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.890955 (+1364855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.890984 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.894073 (+  3089us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.401421 (+507348us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:10.401475 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.401572 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.876069 (+1474497us) raft_consensus.cc:1685] finished
0709 13:19:11.876103 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.876215 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":303692,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":17721,"thread_start_us":1739522,"threads_started":2,"wal-append.queue_time_us":580087}
I20260709 13:19:11.985776  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 296) took 1460 ms. Trace:
I20260709 13:19:11.986196  4221 rpcz_store.cc:276] 0709 13:19:10.525184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.525750 (+   566us) service_pool.cc:224] Handling call
0709 13:19:11.985489 (+1459739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.987567  4293 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:11.988323  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1714) took 1921 ms. Trace:
I20260709 13:19:11.988718  4293 rpcz_store.cc:276] 0709 13:19:10.067009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.986399 (+1919390us) service_pool.cc:224] Handling call
0709 13:19:11.987160 (+   761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.988008 (+   848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.988243 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.785006  4294 pending_rounds.cc:85] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 1
I20260709 13:19:11.910669  4296 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:11.789251  6404 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.020871  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:12.022770  6480 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.023319  6480 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.023870  6480 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.920799  6513 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:10.770004  6441 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:11.920037  6463 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:11.919059  6530 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:11.912744  6564 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:11.916638  6567 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.067361  6508 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:11.919934  6596 raft_consensus.cc:2764] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:19:12.026697  6646 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:12.070304  6646 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:11.778684  6589 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.025997  6609 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:12.072935  4893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.773s (SENT) [suppressed 40 similar messages]
W20260709 13:19:11.913515  6595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.004s	sys 0.024s
I20260709 13:19:10.770897  6601 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:11.919229  6638 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:19:11.983083  4291 rpcz_store.cc:276] 0709 13:19:10.066406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.878181 (+1811775us) service_pool.cc:224] Handling call
0709 13:19:11.878589 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.981946 (+103357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.982367 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.963896  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:12.009702  6239 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.012732  6517 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.014995  4294 pending_rounds.cc:107] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:19:12.016151  4214 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.017083  6563 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:12.023849  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:12.031970  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48904.7us
I20260709 13:19:12.024262  4296 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:12.030019  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 291) took 1540 ms. Trace:
I20260709 13:19:12.025203  6513 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:12.030531  6441 raft_consensus.cc:697] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 3 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:12.025622  6546 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.026350  6645 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.030536  6534 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.073339  6609 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.082165  6673 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.093828  6239 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.098506  4288 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:12.097982  6517 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.098281  6546 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.089425  4294 raft_consensus.cc:2889] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.099540  6534 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.100797  6667 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:12.102582  6441 consensus_queue.cc:237] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.103237  6595 consensus_queue.cc:1059] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:12.103627  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1711) took 2037 ms. Trace:
I20260709 13:19:12.104228  6567 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:12.104530  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.088389  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:12.295336  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.109036  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145695us
W20260709 13:19:12.295696  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.091089  4215 rpcz_store.cc:276] 0709 13:19:10.448780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.448909 (+   129us) service_pool.cc:224] Handling call
0709 13:19:10.449185 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.449513 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.449545 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.449972 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.598444 (+148472us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:10.598498 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.604945 (+  6447us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.984647 (+1379702us) raft_consensus.cc:1685] finished
0709 13:19:11.984694 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.989170 (+  4476us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3349,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":15435,"thread_start_us":112959,"threads_started":1,"wal-append.queue_time_us":246722}
I20260709 13:19:12.301378  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:46860 (request call id 1710) took 2171 ms. Trace:
I20260709 13:19:12.109433  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1797) took 2706 ms. Trace:
I20260709 13:19:12.331801  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1704) took 2126 ms. Trace:
W20260709 13:19:12.300278  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 294792us
W20260709 13:19:12.334283  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 261499us
I20260709 13:19:12.332404  4292 rpcz_store.cc:276] 0709 13:19:10.066099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.779396 (+1713297us) service_pool.cc:224] Handling call
0709 13:19:11.779764 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.780030 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:11.988592 (+208562us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.087479 (+ 98887us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.093292 (+  5813us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.103045 (+  9753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.103201 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.103404 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61790,"prepare.queue_time_us":17057,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":36379,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":81200,"thread_start_us":266903,"threads_started":2,"wal-append.queue_time_us":67435}
I20260709 13:19:12.371699  6672 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:12.372316  6672 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:12.372972  6672 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:12.373917  6590 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:12.345175  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 321625us
I20260709 13:19:12.169269  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.108613  4287 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:12.369212  4296 rpcz_store.cc:276] 0709 13:19:10.065778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.709468 (+643690us) service_pool.cc:224] Handling call
0709 13:19:12.112539 (+1403071us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.106470  6609 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.307531  6646 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:12.377746  6590 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.392972  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1701) took 2496 ms. Trace:
I20260709 13:19:12.393493  4294 rpcz_store.cc:276] 0709 13:19:09.896671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.594504 (+697833us) service_pool.cc:224] Handling call
0709 13:19:10.626666 (+ 32162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.392581 (+1765915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.392899 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.394356  6590 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:12.395896  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.300793  6596 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.341382  6601 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:12.299993  6610 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.110462  6480 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.108110  6563 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.370004  4290 rpcz_store.cc:276] 0709 13:19:09.402773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.551014 (+1148241us) service_pool.cc:224] Handling call
0709 13:19:10.589541 (+ 38527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.598969 (+  9428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.598999 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.622591 (+ 23592us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.773961 (+151370us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:10.774021 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.774114 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.089127 (+1315013us) raft_consensus.cc:1685] finished
0709 13:19:12.091839 (+  2712us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.109252 (+ 17413us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12267,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":22978,"thread_start_us":91409,"threads_started":1,"wal-append.queue_time_us":1147484}
I20260709 13:19:12.411803  4213 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:12.370086  4289 rpcz_store.cc:276] 0709 13:19:09.921293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.595489 (+674196us) service_pool.cc:224] Handling call
0709 13:19:10.630609 (+ 35120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.632529 (+  1920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.632572 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.640739 (+  8167us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.776691 (+135952us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.983181 (+206490us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.041104 (+1057923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.041240 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.041330 (+    90us) raft_consensus.cc:1685] finished
0709 13:19:12.041342 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.047323 (+  5981us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1471,"prepare.queue_time_us":1020220,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":811067,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":61403,"thread_start_us":768043,"threads_started":3,"wal-append.queue_time_us":1093053}
I20260709 13:19:12.468729  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:12.467963  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 381459us
I20260709 13:19:12.405212  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 266) took 2115 ms. Trace:
I20260709 13:19:12.455871  4924 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.341411  6513 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.098021  6645 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.411965  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 267) took 2127 ms. Trace:
I20260709 13:19:12.472846  4294 rpcz_store.cc:276] 0709 13:19:10.283410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.394417 (+2111007us) service_pool.cc:224] Handling call
0709 13:19:12.394828 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.395272 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.395300 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.395362 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:12.395419 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.395480 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.398413 (+  2933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.478397  4292 rpcz_store.cc:276] 0709 13:19:10.284181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.397497 (+2113316us) service_pool.cc:224] Handling call
0709 13:19:12.404606 (+  7109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.411454 (+  6848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.411482 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.411542 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:12.411581 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.411632 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.411883 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.451162  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.413312  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:12.411528  6464 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.468770  6596 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.488902  6609 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:12.490576  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 68412.8us
I20260709 13:19:12.491602  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:12.384068  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:12.481531  4924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 388) took 2009 ms. Trace:
I20260709 13:19:12.492689  6464 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.492971  4924 rpcz_store.cc:276] 0709 13:19:10.471074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.472006 (+   932us) service_pool.cc:224] Handling call
0709 13:19:12.417275 (+1945269us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:19:12.455274 (+ 37999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.474446 (+ 19172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.480458 (+  6012us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64296192}
I20260709 13:19:12.414333  6517 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.404850  4291 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:12.498486  6601 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:12.500962  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 96144.8us
I20260709 13:19:12.509141  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:12.511693  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.515300  6662 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:12.516219  6546 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.516799  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.518383  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:12.518572  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.519608  4215 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:12.519544  6601 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:12.521622  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 108543us
I20260709 13:19:12.497496  6596 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.520449  6601 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.413321  6667 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.413038  6673 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.541693  4294 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:12.542102  6480 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:12.542704  6534 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.544147  6673 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.526371  6590 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:12.542114  4294 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:12.528620  6601 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:12.554242  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 142908us
I20260709 13:19:12.555583  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 195) took 2565 ms. Trace:
I20260709 13:19:12.557222  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 271) took 2102 ms. Trace:
I20260709 13:19:12.540277  6546 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.560719  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 265) took 2245 ms. Trace:
W20260709 13:19:12.561353  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52484.9us
I20260709 13:19:12.561681  4294 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.564009  6563 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:12.565124  6472 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.570214  4219 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:12.571089  4294 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.572057  6610 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.553982  6590 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:12.560077  4289 rpcz_store.cc:276] 0709 13:19:10.454663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.483448 (+2028785us) service_pool.cc:224] Handling call
0709 13:19:12.493796 (+ 10348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.494265 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:12.494634 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.553782 (+ 59148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.553828 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.556948 (+  3120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.557042 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.557167 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":727,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":136,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5670,"thread_start_us":58489,"threads_started":1}
I20260709 13:19:12.605736  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1722) took 2140 ms. Trace:
I20260709 13:19:12.596045  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.654707  4294 rpcz_store.cc:276] 0709 13:19:10.465058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.485996 (+2020938us) service_pool.cc:224] Handling call
0709 13:19:12.536924 (+ 50928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.605318 (+ 68394us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:12.605354 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.605407 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.605453 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.605528 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.605663 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":136}
I20260709 13:19:12.559094  4146 rpcz_store.cc:276] 0709 13:19:09.987129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.962335 (+1975206us) service_pool.cc:224] Handling call
0709 13:19:11.962970 (+   635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.963895 (+   925us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:12.083556 (+119661us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.111809 (+ 28253us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.169662 (+ 57853us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.169828 (+   166us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.308950 (+139122us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.552548 (+243598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.552636 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.552673 (+    37us) raft_consensus.cc:1685] finished
0709 13:19:12.552693 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.552824 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40680,"prepare.queue_time_us":204090,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":75,"raft.queue_time_us":507263,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":7785,"thread_start_us":409399,"threads_started":3,"wal-append.queue_time_us":259282}
I20260709 13:19:12.647550  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1612) took 3033 ms. Trace:
I20260709 13:19:12.616308  4215 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:19:12.572438  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:12.572083  4893 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.621742  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:12.574505  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:12.576820  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.617192  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.621326  4291 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:12.610953  6598 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:12.612835  6645 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:12.630157  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 294817us
I20260709 13:19:12.615226  6649 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:12.656796  4138 rpcz_store.cc:276] 0709 13:19:09.614047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.798577 (+2184530us) service_pool.cc:224] Handling call
0709 13:19:11.798977 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.959117 (+160140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.623044 (+663927us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400068954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:12.647462 (+ 24418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363389184}
I20260709 13:19:12.607725  6667 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:12.567276  4295 rpcz_store.cc:276] 0709 13:19:10.282701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.394199 (+2111498us) service_pool.cc:224] Handling call
0709 13:19:12.394709 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.395302 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:12.395747 (+   445us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.526152 (+130405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.526221 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.526293 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.526368 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.528221 (+  1853us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19140,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":5323,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":21068,"thread_start_us":124594,"threads_started":1,"wal-append.queue_time_us":158277}
I20260709 13:19:12.658761  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1728) took 2084 ms. Trace:
I20260709 13:19:12.662568  4291 rpcz_store.cc:276] 0709 13:19:10.574721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.532670 (+1957949us) service_pool.cc:224] Handling call
0709 13:19:12.559324 (+ 26654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.658509 (+ 99185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.658712 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.663515  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.664304  4289 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:12.664510  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1802) took 2049 ms. Trace:
I20260709 13:19:12.664938  4291 rpcz_store.cc:276] 0709 13:19:10.615041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.663351 (+2048310us) service_pool.cc:224] Handling call
0709 13:19:12.663781 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.664146 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.664175 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.664243 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.664285 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.664358 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.664460 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.665997  4289 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:12.660281  6598 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:12.668308  6495 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:12.668814  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.668563  6598 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.669010  6495 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.669857  6598 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.670298  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.671731  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:12.672034  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.672375  4221 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:12.672856  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55863.9us
I20260709 13:19:12.666742  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1803) took 2051 ms. Trace:
I20260709 13:19:12.673640  4289 rpcz_store.cc:276] 0709 13:19:10.615315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.665231 (+2049916us) service_pool.cc:224] Handling call
0709 13:19:12.665675 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.666461 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.666673 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.673851  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.675074  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.675921  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1805) took 2060 ms. Trace:
I20260709 13:19:12.677250  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:12.678226  4928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 360) took 2213 ms (client timeout 1532 ms). Trace:
W20260709 13:19:12.678553  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.678805  4218 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:12.678668  4928 rpcz_store.cc:269] 0709 13:19:10.465040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.465238 (+   198us) service_pool.cc:224] Handling call
0709 13:19:12.677887 (+2212649us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54006d5454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:12.678023 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450753792}
I20260709 13:19:12.677516  4289 rpcz_store.cc:276] 0709 13:19:10.615840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.674743 (+2058903us) service_pool.cc:224] Handling call
0709 13:19:12.675185 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.675541 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.675571 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.675635 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.675672 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.675755 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.675870 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:12.680966  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 109010us
I20260709 13:19:12.681285  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1806) took 2065 ms. Trace:
I20260709 13:19:12.682088  6381 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.686141  6546 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:12.687510  6590 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:12.679541  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.688730  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.681700  4289 rpcz_store.cc:276] 0709 13:19:10.616097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.680389 (+2064292us) service_pool.cc:224] Handling call
0709 13:19:12.680717 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.680922 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.680948 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.681002 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:12.681048 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.681109 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.681217 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.690879  4220 raft_consensus.cc:2410] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:19:12.694265  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 146155us
I20260709 13:19:12.628988  6672 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.696650  6599 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:12.697485  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76011.1us
I20260709 13:19:12.698388  6672 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:12.698706  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 270) took 2289 ms. Trace:
I20260709 13:19:12.699487  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:12.699129  4290 rpcz_store.cc:276] 0709 13:19:10.409418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.473352 (+2063934us) service_pool.cc:224] Handling call
0709 13:19:12.494043 (+ 20691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.499150 (+  5107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.499196 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.499269 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.499336 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.698445 (+199109us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5400259ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:12.698495 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.698651 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6224128}
I20260709 13:19:12.699085  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1798) took 2085 ms. Trace:
I20260709 13:19:12.697604  6441 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.700605  6620 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.708211  4294 rpcz_store.cc:276] 0709 13:19:10.613883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.660375 (+2046492us) service_pool.cc:224] Handling call
0709 13:19:12.698428 (+ 38053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.698704 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.698734 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.698777 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:12.698845 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.698907 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.699004 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.696230  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:12.696031  4216 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:12.715327  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1808) took 2097 ms. Trace:
I20260709 13:19:12.715744  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.716506  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1804) took 2101 ms. Trace:
I20260709 13:19:12.716701  6601 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.717275  6666 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.717459  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.716940  4291 rpcz_store.cc:276] 0709 13:19:10.615586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.666073 (+2050487us) service_pool.cc:224] Handling call
0709 13:19:12.690248 (+ 24175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.716026 (+ 25778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.716058 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.716126 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:12.716226 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.716279 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.716449 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.715766  4289 rpcz_store.cc:276] 0709 13:19:10.617782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.712272 (+2094490us) service_pool.cc:224] Handling call
0709 13:19:12.714445 (+  2173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.714934 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.714960 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.715026 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.715084 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.715149 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.715265 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5888}
I20260709 13:19:12.718200  6666 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.662488  6649 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:12.738220  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1807) took 2121 ms. Trace:
I20260709 13:19:12.738986  4290 rpcz_store.cc:276] 0709 13:19:10.616402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.712067 (+2095665us) service_pool.cc:224] Handling call
0709 13:19:12.714400 (+  2333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.731826 (+ 17426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.731872 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.736397 (+  4525us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.737889 (+  1492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.737974 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.738120 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.742548  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 274) took 1946 ms. Trace:
I20260709 13:19:12.743080  4290 rpcz_store.cc:276] 0709 13:19:10.795857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.741132 (+1945275us) service_pool.cc:224] Handling call
0709 13:19:12.741689 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.742122 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.742160 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.742216 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.742275 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.742347 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.742482 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.748543  6438 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.749099  6438 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.749524  6438 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.752311  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1720) took 2650 ms. Trace:
I20260709 13:19:12.755949  4293 rpcz_store.cc:276] 0709 13:19:10.102161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.002181 (+1900020us) service_pool.cc:224] Handling call
0709 13:19:12.011400 (+  9219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.093774 (+ 82374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.093825 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.093901 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.093966 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.752045 (+658079us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54000ebd54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:12.752098 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.752228 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7447,"raft.queue_time_us":8326,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":248,"spinlock_wait_cycles":170554240}
I20260709 13:19:12.757831  6649 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.759307  6649 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.752490  4928 raft_consensus.cc:2376] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7. Re-sending same reply.
I20260709 13:19:12.754566  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1859) took 2182 ms. Trace:
I20260709 13:19:12.761633  4214 rpcz_store.cc:276] 0709 13:19:10.572027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.572730 (+   703us) service_pool.cc:224] Handling call
0709 13:19:12.015388 (+1442658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.096036 (+ 80648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.754352 (+658316us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000249d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:12.754491 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3278148352}
I20260709 13:19:12.762382  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:12.764621  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1809) took 2146 ms. Trace:
I20260709 13:19:12.765009  4291 rpcz_store.cc:276] 0709 13:19:10.618027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.718996 (+2100969us) service_pool.cc:224] Handling call
0709 13:19:12.763938 (+ 44942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.764264 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.764288 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.764368 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:12.764410 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.764468 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.764571 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:12.771593  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.778656  6667 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:12.779688  6641 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.780040  4289 pending_rounds.cc:85] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:19:12.780426  4289 pending_rounds.cc:107] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:19:12.780682  4289 raft_consensus.cc:2889] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.782648  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.782363  4291 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:12.733386  6672 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.777015  6441 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:12.792711  4142 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:12.788163  4221 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:12.795972  4214 raft_consensus.cc:1240] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:12.789940  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 93865.6us
I20260709 13:19:12.795521  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.809046  4216 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:12.796590  4215 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:12.798547  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.799923  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:12.812932  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.820804  6588 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.821391  6588 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.822695  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:12.823686  4919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 365) took 2302 ms. Trace:
I20260709 13:19:12.825073  4140 raft_consensus.cc:606] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.825443  4140 raft_consensus.cc:614] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:12.815843  4290 raft_consensus.cc:3055] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:12.827199  4293 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:12.827491  4290 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:12.811136  6601 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:12.830899  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:12.789518  6495 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:12.837440  4186 connection.cc:256] RPC call timeout handler was delayed by -1.0335708479999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:19:12.839334  4221 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:12.839646  6599 raft_consensus.cc:2764] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:19:12.840476  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49588.7us
I20260709 13:19:12.843446  6672 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.824033  4919 rpcz_store.cc:276] 0709 13:19:10.521431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.526541 (+  5110us) service_pool.cc:224] Handling call
0709 13:19:12.822331 (+2295790us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:19:12.823624 (+  1293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53707136}
I20260709 13:19:12.846781  4185 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:12.847826  6570 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:12.848275  6656 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:12.849802  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.854316  6570 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.830426  6441 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.858721  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.859951  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.871183  4919 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:12.875241  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 385) took 2413 ms. Trace:
I20260709 13:19:12.876209  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:12.877584  4924 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:12.877969  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:12.878890  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:12.882714  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65649.2us
I20260709 13:19:12.829507  6596 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.887161  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:12.887912  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.887979  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:12.888441  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.892637  4295 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:12.897449  4293 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:12.898494  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.899281  4293 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:12.900436  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:12.900537  4140 raft_consensus.cc:606] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.901214  4140 raft_consensus.cc:614] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:12.901963  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:12.906363  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:12.906993  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:12.907238  4140 raft_consensus.cc:606] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:12.908536  6599 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:12.908982  6599 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:12.909376  6599 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.913852  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:12.900437  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:12.916903  6438 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.917466  6530 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.921936  6441 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:12.929211  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 143252us
I20260709 13:19:12.895016  6588 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:12.929155  4291 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:12.930218  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:12.919920  6601 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:12.942036  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.943650  6588 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:12.945516  6596 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:12.947690  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 269) took 2543 ms. Trace:
I20260709 13:19:12.948211  4296 rpcz_store.cc:276] 0709 13:19:10.404169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.474016 (+2069847us) service_pool.cc:224] Handling call
0709 13:19:12.532205 (+ 58189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.615285 (+ 83080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.615329 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.615385 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.615445 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.947376 (+331931us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b54000c94d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:12.947429 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.947604 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154599808}
I20260709 13:19:12.950052  6630 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:12.950567  6630 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:12.951471  4147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1601) took 4056 ms (client timeout 3260 ms). Trace:
W20260709 13:19:12.952117  4147 rpcz_store.cc:269] 0709 13:19:08.895106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.352630 (+457524us) service_pool.cc:224] Handling call
0709 13:19:12.951051 (+3598421us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b540022ddd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:12.951290 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5920332672}
I20260709 13:19:12.955574  6464 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:12.944175  6672 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:19:12.959472  6672 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:12.959880  6672 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:12.963105  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:12.964270  4222 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:12.942672  6601 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:12.971740  6601 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.952195  6570 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:12.972790  6570 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:12.973284  6570 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:12.975482  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1799) took 2361 ms. Trace:
I20260709 13:19:12.965627  6672 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.978121  6672 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.976007  4295 rpcz_store.cc:276] 0709 13:19:10.614221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.705048 (+2090827us) service_pool.cc:224] Handling call
0709 13:19:12.705495 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.893081 (+187586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.975086 (+ 82005us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000eb354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:12.975388 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429955328}
I20260709 13:19:12.951795  6630 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.875743  4920 rpcz_store.cc:276] 0709 13:19:10.461446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.463952 (+  2506us) service_pool.cc:224] Handling call
0709 13:19:10.519807 (+ 55855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.571396 (+ 51589us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:10.649597 (+ 78201us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.015603 (+366006us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.015679 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:11.015762 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.874780 (+1859018us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b540062dc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:12.874851 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.875041 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307541,"prepare.queue_time_us":46211,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":719,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":127,"spinlock_wait_cycles":48314752,"thread_start_us":194285,"threads_started":1,"wal-append.queue_time_us":878954,"wal-append.run_cpu_time_us":1605,"wal-append.run_wall_time_us":1007684}
I20260709 13:19:12.944204  6588 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:12.987231  6588 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:12.924049  4290 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:12.994987  4293 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:12.990028  6438 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:13.004127  4296 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:13.035341  6570 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.042289  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:13.042666  6599 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.039870  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:13.045861  6588 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.053290  6588 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:13.054864  6700 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
I20260709 13:19:13.070801  6599 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:13.078299  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.085816  6570 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:13.088361  6601 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.092816  6601 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:13.159355  6693 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.359s	user 0.001s	sys 0.003s
W20260709 13:19:13.174016  6694 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.192s	user 0.000s	sys 0.004s
W20260709 13:19:13.175376  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.180967  4041 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 84) took 11295 ms (client timeout 15000 ms). Trace:
W20260709 13:19:13.181541  4041 rpcz_store.cc:269] 0709 13:19:01.885627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.885993 (+   366us) service_pool.cc:224] Handling call
0709 13:19:05.607791 (+3721798us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b54000dab28. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee4264c161 00007fee426d63af 00007fee426d7b11 00007fee44bd82d1 00007fee44bd8b2f 00007fee44a97d4b 00007fee44b9fc3e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc
0709 13:19:13.180606 (+7572815us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:06.487399 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:06.488207 (+   808us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:06.488350 (+   143us) write_op.cc:435] Acquired schema lock
0709 13:19:06.491514 (+  3164us) tablet.cc:662] Decoding operations
0709 13:19:06.492063 (+   549us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:06.492174 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:06.492223 (+    49us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:06.492511 (+   288us) tablet.cc:701] Row locks acquired
0709 13:19:06.492538 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:19:06.492749 (+   211us) write_op.cc:270] Start()
0709 13:19:06.492914 (+   165us) write_op.cc:276] Timestamp: P: 1783603146492680 usec, L: 0
0709 13:19:06.492945 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:19:06.493841 (+   896us) log.cc:844] Serialized 532 byte log entry
0709 13:19:09.031185 (+2537344us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b54000db220. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec60343 00007fee3ec63d75 00007fee3ec63d09 00007fee3ec63c99 00007fee3ec63c61 00007fee3ec62f5d 000000000038f354 000000000038f199 00007fee3bbf5475 00007fee3bbf77c1
0709 13:19:09.031615 (+   430us) op_driver.cc:464] REPLICATION: finished
0709 13:19:10.293475 (+1261860us) write_op.cc:301] APPLY: starting
0709 13:19:10.293571 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:10.293672 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:10.293693 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:12.605789 (+2312096us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5c0024ff0c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44ed4331 00007fee44ed4221 00007fee44ecef6c 00007fee4262f30b 00007fee4262efd3 00007fee4272de34 00007fee4271997c 00007fee4271dd61 00007fee4271dd19 00007fee4271dca9 00007fee4271dc71
0709 13:19:12.606301 (+   512us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:12.606959 (+   658us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:19:12.607025 (+    66us) write_op.cc:312] APPLY: finished
0709 13:19:12.607538 (+   513us) log.cc:844] Serialized 22 byte log entry
0709 13:19:12.607852 (+   314us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.608065 (+   213us) write_op.cc:454] Released schema lock
0709 13:19:12.608142 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:12.676654 (+ 68512us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.676695 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":966992,"reported_tablets":1,"spinlock_wait_cycles":44219136,"child_traces":[["op",{"apply.queue_time_us":1261558,"apply.run_cpu_time_us":36141,"apply.run_wall_time_us":2379697,"num_ops":1,"prepare.queue_time_us":866341,"prepare.run_cpu_time_us":43806,"prepare.run_wall_time_us":209350,"raft.queue_time_us":2980974,"raft.run_cpu_time_us":238302,"raft.run_wall_time_us":2305013,"replication_time_us":2538462,"spinlock_wait_cycles":137185920,"thread_start_us":2280788,"threads_started":4,"wal-append.queue_time_us":384695,"wal-append.run_cpu_time_us":17195,"wal-append.run_wall_time_us":2314542}]]}
I20260709 13:19:13.197391  4291 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:13.218811  4291 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:19:13.253610  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.263247  4288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1723) took 2778 ms (client timeout 1511 ms). Trace:
W20260709 13:19:13.263959  4288 rpcz_store.cc:269] 0709 13:19:10.484735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.504282 (+ 19547us) service_pool.cc:224] Handling call
0709 13:19:13.262772 (+2758490us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400295ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:13.263092 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3468124544}
I20260709 13:19:13.278120  6651 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:13.279126  6651 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:12.950575  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.298033  6672 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:13.298193  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 347767us
I20260709 13:19:13.299645  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.301599  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:13.302528  6649 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.302917  6672 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:13.303086  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:13.304112  6672 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:13.304548  6672 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:13.304965  6672 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:13.310456  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.311506  6649 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:13.311940  6649 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:13.312430  6649 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.312763  6672 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.316002  6672 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:13.318053  6672 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.316715  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.321774  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.324132  6622 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.324368  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.322466  6672 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.325114  6622 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:13.325549  6622 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.325881  6622 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.326840  6672 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.328685  6649 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.329650  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.331502  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.331923  6649 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.332998  6649 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:13.333541  6649 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:13.334028  6649 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.336331  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.337765  6656 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:13.337311  6622 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.338912  6656 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:13.338789  6672 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:13.339421  6656 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:13.340010  6622 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.328577  6666 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:13.341686  6666 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:13.342111  6666 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.344899  6656 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.346002  6413 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:13.350586  6622 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:13.351387  6438 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:13.352890  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.350855  6413 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:13.353729  4139 raft_consensus.cc:2410] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:13.354702  6413 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.344797  6649 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.357406  6649 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.346807  6656 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:13.347858  4142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 197) took 3360 ms (client timeout 1773 ms). Trace:
I20260709 13:19:13.358784  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.348039  6381 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.359488  6381 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:13.359879  6381 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:13.358513  4142 rpcz_store.cc:269] 0709 13:19:09.987739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.096739 (+109000us) service_pool.cc:224] Handling call
0709 13:19:13.347490 (+3250751us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b5400077954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:13.347698 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5249296128}
I20260709 13:19:13.361477  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.363034  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.363771  4142 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:13.365190  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.369352  4142 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:13.370898  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:13.371315  4296 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:13.372195  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.372563  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:13.372933  4139 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:13.373281  4147 raft_consensus.cc:2368] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:13.374087  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:13.375504  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:13.376039  4147 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.378265  4290 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:13.386173  6381 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:13.395726  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.397915  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.398583  4140 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 2.
W20260709 13:19:13.396276  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.406653  6666 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.410295  6666 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.408445  6381 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.412731  4147 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:13.414634  4290 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:19:13.415123  4290 pending_rounds.cc:85] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 3
I20260709 13:19:13.415637  4290 pending_rounds.cc:107] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 2.4
I20260709 13:19:13.415918  4290 raft_consensus.cc:2889] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.421797  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1730) took 1405 ms. Trace:
I20260709 13:19:13.422456  4290 rpcz_store.cc:276] 0709 13:19:12.016932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.744281 (+727349us) service_pool.cc:224] Handling call
0709 13:19:12.813766 (+ 69485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.421536 (+607770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.421734 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:13.424994  4138 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:13.426084  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.426448  4146 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:13.426829  4141 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:13.427549  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.427860  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.415830  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:13.428757  4141 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:13.429030  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:13.429919  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.430557  4146 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:13.430760  4141 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:13.430823  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.431931  4290 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:13.430112  4139 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:13.425201  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:13.433681  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:13.434346  4138 raft_consensus.cc:2376] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 4. Re-sending same reply.
I20260709 13:19:13.433619  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.429955  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.438608  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.439576  4147 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:13.441882  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.442282  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.443130  4288 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:13.443502  4140 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:13.444078  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.444643  4291 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:13.444947  4288 raft_consensus.cc:2410] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:13.444784  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.445607  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.447710  4146 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:13.447844  6630 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.445722  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.449096  4290 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:13.456890  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.457651  4296 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:13.458509  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.459806  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.460809  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.462447  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.462929  6239 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.463074  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.463953  4290 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:13.464862  4291 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:13.467615  4292 pending_rounds.cc:85] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 2
I20260709 13:19:13.467998  4292 pending_rounds.cc:107] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:19:13.468257  4292 raft_consensus.cc:2889] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.470553  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.468322  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:13.465543  4290 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:13.465387  6239 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:13.474364  6239 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.475291  6478 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.475754  6478 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:13.476135  6478 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.478314  6239 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:13.480216  4288 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:13.495499  6691 consensus_queue.cc:1059] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:13.496833  6691 raft_consensus.cc:3055] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:13.497169  6691 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:13.499635  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.498145  6691 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.485829  6239 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:13.504483  6691 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:13.504860  6554 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:13.506814  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.507378  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.507652  6554 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.509253  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.509601  6590 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:13.503722  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.511309  4288 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:13.512028  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.510249  6554 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:13.507859  6478 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.521526  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.523618  6381 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:13.525478  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.526417  6381 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.528066  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.528965  6381 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.537185  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:13.539948  6381 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:13.635533  4287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 1801) took 3020 ms (client timeout 1532 ms). Trace:
I20260709 13:19:13.559825  4218 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:13.679283  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.548178  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:13.675055  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 147025us
I20260709 13:19:13.691233  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:13.610867  6513 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.576295  6641 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:13.614691  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1862) took 2915 ms. Trace:
I20260709 13:19:13.557726  6495 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:13.551275  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.540096  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.550166  6497 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:13.543859  6651 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.556034  4220 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:13.589470  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:13.580648  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 624656us
W20260709 13:19:13.579043  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.554704  4215 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:13.559190  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 273) took 2799 ms. Trace:
W20260709 13:19:13.598404  4044 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 176) took 17697 ms (client timeout 15000 ms). Trace:
I20260709 13:19:13.595594  6676 raft_consensus.cc:3055] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:19:13.689064  4287 rpcz_store.cc:269] 0709 13:19:10.614777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.636058 (+ 21281us) service_pool.cc:224] Handling call
0709 13:19:13.634995 (+2998937us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002d69d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:13.635362 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760372096}
I20260709 13:19:13.689841  4288 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.737542  4217 rpcz_store.cc:276] 0709 13:19:10.698926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.701500 (+  2574us) service_pool.cc:224] Handling call
0709 13:19:10.711088 (+  9588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.799273 (+1088185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.614029 (+1814756us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400215054. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:13.614454 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477768064}
I20260709 13:19:13.515316  6413 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.175s
W20260709 13:19:13.741159  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.741600  4289 rpcz_store.cc:276] 0709 13:19:10.759329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.720615 (+1961286us) service_pool.cc:224] Handling call
0709 13:19:12.779760 (+ 59145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.781346 (+  1586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.781375 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.781953 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.982477 (+200524us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:12.982520 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.982616 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.558862 (+576246us) raft_consensus.cc:1685] finished
0709 13:19:13.558898 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.559090 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":200057,"threads_started":1,"wal-append.queue_time_us":257878}
I20260709 13:19:13.622131  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:13.743363  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 195256us
I20260709 13:19:13.703261  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:13.758831  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.795578  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.794692  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 91568.9us
I20260709 13:19:13.804183  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:13.738662  6239 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:13.762073  4041 catalog_manager.cc:5697] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 4 to 5, term changed from 5 to 7, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to <none>, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:13.759912  6554 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:13.831159  6554 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.831586  6554 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.832254  4920 raft_consensus.cc:1240] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 3 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:13.834923  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 902386us
I20260709 13:19:13.818619  6438 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.837693  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:13.838480  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:13.804647  6381 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:19:13.820950  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:13.822026  6483 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.822571  6478 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.826380  5879 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.827008  6589 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:19:13.849472  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:13.827893  4144 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:13.850198  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:13.828943  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:13.827828  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:13.799404  6546 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:13.836061  6239 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:13.838567  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:13.738318  6641 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:13.873718  6641 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.874974  6641 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.869889  4920 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:13.777243  6497 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:13.878165  6497 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.776825  6676 raft_consensus.cc:740] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:13.841259  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:13.881816  4220 raft_consensus.cc:2410] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:13.882256  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:13.886226  6666 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:19:13.899834  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.901671  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.902850  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.903617  6413 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.904146  6530 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.884222  6651 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:19:13.849428  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:13.904453  6413 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.906370  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:19:13.906744  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64075.4us
I20260709 13:19:13.908180  4110 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:13.909246  4214 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:13.909644  4214 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:13.910784  4214 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.799468  6588 consensus_queue.cc:1059] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:13.912963  6588 consensus_queue.cc:1059] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:13.913756  6588 consensus_queue.cc:1243] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer b81584b21ed144698954548303f1e507 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:13.854746  4893 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:13.916761  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62356.2us
I20260709 13:19:13.843480  6656 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.917857  6676 consensus_queue.cc:260] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.918066  6656 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:13.918877  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.919651  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.920490  6691 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:13.920873  6478 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:19:13.739138  4044 rpcz_store.cc:269] 0709 13:18:55.900956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.908004 (+  7048us) service_pool.cc:224] Handling call
0709 13:19:13.598131 (+17690127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:06.731659 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:06.895531 (+163872us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:06.902089 (+  6558us) write_op.cc:435] Acquired schema lock
0709 13:19:06.918503 (+ 16414us) tablet.cc:662] Decoding operations
0709 13:19:07.199795 (+281292us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:07.214609 (+ 14814us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:07.218276 (+  3667us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:07.382310 (+164034us) tablet.cc:701] Row locks acquired
0709 13:19:07.385477 (+  3167us) write_op.cc:260] PREPARE: finished
0709 13:19:07.444534 (+ 59057us) write_op.cc:270] Start()
0709 13:19:07.477030 (+ 32496us) write_op.cc:276] Timestamp: P: 1783603147439795 usec, L: 0
0709 13:19:07.477069 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:19:07.597188 (+120119us) log.cc:844] Serialized 2073 byte log entry
0709 13:19:10.279080 (+2681892us) op_driver.cc:464] REPLICATION: finished
0709 13:19:10.521460 (+242380us) write_op.cc:301] APPLY: starting
0709 13:19:10.521544 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:10.521711 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:10.521815 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:10.553788 (+ 31973us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:10.627690 (+ 73902us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:19:10.637323 (+  9633us) write_op.cc:312] APPLY: finished
0709 13:19:10.688793 (+ 51470us) log.cc:844] Serialized 46 byte log entry
0709 13:19:11.879663 (+1190870us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:11.879837 (+   174us) write_op.cc:454] Released schema lock
0709 13:19:11.879899 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:11.880527 (+   628us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:11.880586 (+    59us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":265773,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":222486,"apply.run_cpu_time_us":37900,"apply.run_wall_time_us":1359004,"num_ops":5,"prepare.queue_time_us":661849,"prepare.run_cpu_time_us":13713,"prepare.run_wall_time_us":875767,"replication_time_us":2797869,"thread_start_us":1307805,"threads_started":2,"wal-append.queue_time_us":1085047,"wal-append.run_cpu_time_us":5174,"wal-append.run_wall_time_us":1815445}]]}
I20260709 13:19:13.923775  6676 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:13.928040  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:13.836189  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:13.929636  4144 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:13.821101  4041 catalog_manager.cc:5697] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 3 to 5, term changed from 4 to 5, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68), b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:13.930680  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 94686.9us
I20260709 13:19:13.931751  4041 catalog_manager.cc:5697] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.933115  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:13.933439  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:13.869822  6239 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.870869  6483 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:13.871224  5879 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:13.911058  6546 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:13.942468  6651 consensus_queue.cc:1059] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:13.943953  6651 raft_consensus.cc:3055] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:13.944586  6651 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:13.945672  6483 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.911927  6381 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:13.945741  6651 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:13.955982  6656 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:13.851918  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:13.933375  4041 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 2 to 4, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.938241  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.932543  6438 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:13.947770  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.949743  4110 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:13.950596  4288 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:13.952325  4291 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:13.956986  6651 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.967224  4112 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:13.968426  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:13.968065  4041 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.980228  5879 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.980502  4110 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:13.984503  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:13.971186  4041 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 3 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.990900  4214 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:13.996568  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.974234  6656 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.984211  6483 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:13.987208  6413 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.989852  6464 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:14.023445  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 85854.9us
I20260709 13:19:13.977489  6478 consensus_queue.cc:1059] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:19:14.016290  4041 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 6 to 9, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 9 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.032733  4041 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 2 to 4, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:14.033228  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:14.034780  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:13.966795  6554 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.045334  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.043329  6381 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.050475  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:14.050645  6381 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:14.058317  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.059167  5879 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:14.059890  5879 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:14.038614  6464 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:14.055277  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.052037  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:14.063668  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 1.172e+06us
I20260709 13:19:14.056838  6381 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:14.072120  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:14.073313  4219 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:14.074299  4041 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 2 to 4, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.081789  4288 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:14.083827  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:14.067008  6630 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:14.059304  6495 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:14.080194  5879 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:14.087116  4142 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:14.071977  6641 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:14.089037  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.089169  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:14.072276  6713 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:14.069340  6464 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.087602  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:14.069145  6438 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:14.096452  4289 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:14.095134  4290 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:14.090587  6554 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:14.103175  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:14.081831  6590 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:14.106379  4076 debug-util.cc:398] Leaking SignalData structure 0x7b0800131aa0 after lost signal to thread 3024
W20260709 13:19:14.137274  4076 debug-util.cc:398] Leaking SignalData structure 0x7b080039fa80 after lost signal to thread 4079
W20260709 13:19:14.139093  4076 debug-util.cc:398] Leaking SignalData structure 0x7b0800300a60 after lost signal to thread 4171
I20260709 13:19:14.109983  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.110759  6601 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.110649  6497 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.111711  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:14.116645  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64684.2us
I20260709 13:19:14.120263  6538 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:14.122345  6718 consensus_queue.cc:1059] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:14.160368  4186 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:14.161182  6495 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:14.161608  6495 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:14.166297  6634 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:14.167038  6634 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.167483  6634 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:14.168576  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.168679  6641 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:14.169878  6521 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:14.171384  6713 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:14.172075  6713 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.124944  6472 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:14.128407  6630 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:14.073638  6441 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:14.132243  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.143350  6513 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:14.179936  6513 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.140712  6590 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:14.180246  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48081.6us
I20260709 13:19:14.180790  6483 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:14.181293  6483 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.181402  6691 raft_consensus.cc:3055] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:14.181717  6483 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.133018  6381 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:14.106812  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:14.184037  4289 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:14.096851  4041 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 2 to 4, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:14.142755  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:14.187288  4291 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
W20260709 13:19:14.143767  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.143781  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:14.188485  4214 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:14.185861  4041 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:19:14.189720  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 109897us
I20260709 13:19:14.183076  6381 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:14.115958  4923 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:14.099674  6666 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.177911  6630 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.181824  6691 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:14.190521  4041 catalog_manager.cc:5697] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:14.195066  6381 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:14.197558  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:14.199651  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.201061  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:14.151003  4076 debug-util.cc:398] Leaking SignalData structure 0x7b080033e080 after lost signal to thread 4246
W20260709 13:19:14.201941  4076 debug-util.cc:398] Leaking SignalData structure 0x7b0800382f40 after lost signal to thread 4247
W20260709 13:19:14.203327  4076 debug-util.cc:398] Leaking SignalData structure 0x7b08001562c0 after lost signal to thread 4320
I20260709 13:19:14.180331  6513 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:14.192859  6620 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:19:14.204386  6413 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:19:14.208041  6622 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:14.207778  6610 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:14.210906  6589 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:14.217149  6691 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.263103  6438 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:14.205101  6666 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:14.189519  6590 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.218364  4041 catalog_manager.cc:5697] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 2 to 3, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 3 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.219755  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:14.220501  6497 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:14.176973  6472 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:14.255160  6610 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.242213  6634 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:14.247160  6464 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:14.261054  6656 raft_consensus.cc:993] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:14.267954  4288 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:14.330996  6656 raft_consensus.cc:1081] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:14.332849  6666 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:14.334124  6713 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.335532  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:14.336265  6713 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:14.336385  4288 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:14.337778  4288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:14.338439  4288 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.338596  6634 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:14.338892  4288 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.340818  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:14.341543  4216 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:14.344385  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:14.344982  6666 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:14.345897  6589 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:14.346493  6464 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:14.346524  6589 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.347153  6589 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.347324  6464 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:14.317931  6630 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:14.317677  6590 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.351207  6630 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:14.351544  6590 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:14.319093  6691 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.319993  6472 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:14.322944  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 103326us
I20260709 13:19:14.354491  6495 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.356309  4187 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:14.323434  6601 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:14.360906  4214 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:14.364043  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 242941us
W20260709 13:19:14.205848  4076 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7440 after lost signal to thread 4953
I20260709 13:19:14.326731  6610 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:14.393252  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.271265  6438 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.328606  6620 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:14.397136  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:14.399585  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:14.348237  6464 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:14.361977  6472 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.409220  4215 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:14.413039  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 242567us
I20260709 13:19:14.426774  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1824) took 1547 ms. Trace:
I20260709 13:19:14.435223  4296 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:14.441413  4142 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:14.433262  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:14.452891  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.453467  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.457566  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:14.408818  6538 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:14.385773  6651 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:19:14.464115  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:14.387741  6634 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:19:14.469043  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:14.465044  4288 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:14.472131  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.472214  4145 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:19:14.473634  4140 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.402648  6620 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.478205  4217 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:14.479249  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:14.480248  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 370352us
I20260709 13:19:14.483099  4147 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:14.477150  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 120964us
I20260709 13:19:14.387511  6630 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:19:14.487605  4140 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
W20260709 13:19:14.494825  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.499147  4187 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:14.503629  5879 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:14.502408  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.479707  6641 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:14.487610  6620 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.470383  6554 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:19:14.542418  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.500450  6483 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:14.557791  4110 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.563546  4139 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:14.524730  6641 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:14.578804  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 87119us
I20260709 13:19:14.580283  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:14.586187  6495 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.430912  4293 rpcz_store.cc:276] 0709 13:19:12.879889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.998168 (+118279us) service_pool.cc:224] Handling call
0709 13:19:13.008882 (+ 10714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.632328 (+623446us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:14.035997 (+403669us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.425536 (+389539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.425640 (+   104us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:14.425727 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.425853 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.426636 (+   783us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111523,"prepare.queue_time_us":201667,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":32187,"thread_start_us":591975,"threads_started":2}
I20260709 13:19:14.594762  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:19:14.596024  6730 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
W20260709 13:19:14.600024  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.439107  6464 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:14.565737  6738 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 13:19:14.611860  6641 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:14.623885  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 126937us
W20260709 13:19:14.624507  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.568320  6554 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:14.567565  6725 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:14.721536  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 199925us
W20260709 13:19:14.723042  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 225054us
W20260709 13:19:14.738761  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 235699us
I20260709 13:19:14.755779  4291 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:14.550756  6735 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.203s
W20260709 13:19:14.752385  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 122814us
I20260709 13:19:14.758590  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.737244  6725 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:14.770226  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:14.795285  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 86091us
I20260709 13:19:14.756270  6588 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.787874  6381 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:14.799796  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 46264.7us
I20260709 13:19:14.799988  6381 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:14.800773  6739 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:19:14.801339  6590 consensus_queue.cc:1059] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:14.802068  6752 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:14.802290  6590 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:14.802601  6752 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:14.802968  6590 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:14.803617  6752 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:14.798527  6588 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:14.821353  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.741400  6718 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:19:14.822577  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 227930us
I20260709 13:19:14.828820  4219 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:14.829802  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:19:14.806573  6513 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.004s
I20260709 13:19:14.795773  6725 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.759291  6651 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:19:14.823813  6601 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:14.833745  6713 raft_consensus.cc:3055] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:14.824191  6737 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:14.803934  6590 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.846371  6733 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:14.887032  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 117084us
I20260709 13:19:14.890553  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:14.891172  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:14.891484  6441 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:14.892135  6441 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:14.893277  6441 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:14.852306  6748 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:14.840504  6610 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:14.905675  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75968.3us
I20260709 13:19:14.872579  6630 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:14.916611  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:14.867070  6713 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:14.870859  6737 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:14.885888  6752 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.850667  6513 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:14.931705  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.946866  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.950069  6554 raft_consensus.cc:697] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:14.916980  6676 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.954345  4288 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:14.918464  6546 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.958307  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:14.885214  6601 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:15.054003  6723 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.424s	user 0.000s	sys 0.002s
W20260709 13:19:15.042500  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.953080  6722 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.426s	user 0.002s	sys 0.000s
W20260709 13:19:15.057211  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.091703  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.942658  6737 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.957923  6748 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:14.957621  6733 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:14.988552  6554 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:15.156520  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 226948us
W20260709 13:19:15.156653  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 240295us
I20260709 13:19:15.157873  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:15.158998  4288 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:15.159606  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:15.160383  4295 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:15.162149  6472 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.013s
I20260709 13:19:15.175522  4295 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
W20260709 13:19:15.175791  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 230115us
I20260709 13:19:15.176877  6588 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:15.175024  4144 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.692s	user 0.012s	sys 0.002s
I20260709 13:19:15.063251  6464 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:15.097101  6735 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:15.217211  4144 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:15.112623  6733 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:15.055294  6676 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:15.307247  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.336462  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:15.219791  6734 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:15.351517  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:15.226256  6735 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:15.352764  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.102160  6546 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:19:15.371380  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 275728us
I20260709 13:19:15.306334  6464 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:15.381718  6769 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.382266  6769 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:15.382997  6756 log.cc:927] Time spent T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:19:15.383240  6676 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.333022  6733 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:15.393113  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1907) took 1493 ms. Trace:
I20260709 13:19:15.350119  6734 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:15.376533  6620 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.831s	user 0.006s	sys 0.010s
I20260709 13:19:15.393646  4213 rpcz_store.cc:276] 0709 13:19:13.899995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.902304 (+  2309us) service_pool.cc:224] Handling call
0709 13:19:13.902673 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.903165 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.903197 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.903801 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.264016 (+360215us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:14.264093 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.264195 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.392855 (+1128660us) raft_consensus.cc:1685] finished
0709 13:19:15.392879 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.393038 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1701,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":359740,"threads_started":1,"wal-append.queue_time_us":532015}
W20260709 13:19:15.377817  6749 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:19:15.361819  6771 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.387444  6727 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.564s	user 0.000s	sys 0.002s
I20260709 13:19:15.371718  6746 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:15.179509  6713 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:15.414140  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 256329us
I20260709 13:19:15.373169  6745 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:19:15.411018  6728 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.546s	user 0.000s	sys 0.001s
I20260709 13:19:15.378348  6464 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:15.434180  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.458969  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:15.486570  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 158740us
W20260709 13:19:15.491233  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.491809  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 154356us
I20260709 13:19:15.421875  6747 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.450596  6495 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.864s	user 0.016s	sys 0.003s
I20260709 13:19:15.493364  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:15.448370  6769 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.501845  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:15.517150  4295 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
W20260709 13:19:15.464951  6743 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.552s	user 0.001s	sys 0.000s
I20260709 13:19:15.456593  6464 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:15.454224  6610 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.518780  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:15.521027  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:15.523042  4295 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:15.523375  4290 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
W20260709 13:19:15.523813  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.503377  6748 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:15.524870  6768 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.313s
I20260709 13:19:15.525449  4142 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:15.537130  6546 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.537760  6601 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:15.539068  4292 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:15.532503  6773 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:19:15.526244  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:15.541260  6760 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:15.541914  6634 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:15.542037  6760 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:15.542655  6634 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:15.543431  6774 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:15.543257  6760 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:15.526679  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:15.545006  6726 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.582s	user 0.001s	sys 0.001s
I20260709 13:19:15.545450  6747 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.594460  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 218) took 1178 ms. Trace:
I20260709 13:19:15.594947  4146 rpcz_store.cc:276] 0709 13:19:14.405491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.405860 (+   369us) service_pool.cc:224] Handling call
0709 13:19:14.406197 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.406592 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.406622 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.431561 (+ 24939us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.767834 (+336273us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:14.767894 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.768674 (+   780us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.546414 (+777740us) raft_consensus.cc:1685] finished
0709 13:19:15.583945 (+ 37531us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.584143 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2986,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5731,"thread_start_us":291729,"threads_started":1,"wal-append.queue_time_us":387188}
I20260709 13:19:15.551616  6438 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:15.526680  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 67950.1us
W20260709 13:19:15.555454  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.567009  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:15.447718  6771 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.485983  6513 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.545768  6745 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.579077  6634 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:15.579712  6774 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.530028  6777 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:15.485008  6381 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:15.583357  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:15.583757  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:15.646399  4291 raft_consensus.cc:2410] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:15.546555  6755 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:15.503754  6735 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.558564  6734 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.590456  4290 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.599216  4295 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.600679  6495 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:15.601233  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 316) took 1658 ms. Trace:
I20260709 13:19:15.601586  6762 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.601989  6750 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:19:15.602759  6783 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.602958  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 280) took 1808 ms. Trace:
I20260709 13:19:15.415478  6620 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:15.594095  6589 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.239s	user 0.014s	sys 0.000s
I20260709 13:19:15.588147  6521 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:15.636919  4186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.006s	sys 0.023s
I20260709 13:19:15.684101  6521 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:15.684301  4186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.006s	sys 0.023s
W20260709 13:19:15.684798  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 930611us
I20260709 13:19:15.685191  6521 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.686388  6620 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.686578  6521 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.687139  6620 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:15.640743  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.688434  6773 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:15.688897  6773 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:15.669672  4221 rpcz_store.cc:276] 0709 13:19:13.942420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.942971 (+   551us) service_pool.cc:224] Handling call
0709 13:19:13.943430 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.943909 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.943945 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.951405 (+  7460us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.429249 (+477844us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:14.429288 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.429424 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.600970 (+1171546us) raft_consensus.cc:1685] finished
0709 13:19:15.600995 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.601151 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":788,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":472109,"threads_started":1,"wal-append.queue_time_us":887305}
I20260709 13:19:15.692600  6589 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.693344  6610 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.694094  6588 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:15.694730  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 111485us
I20260709 13:19:15.694936  6589 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.695389  6766 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:15.695626  6589 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:15.696045  6766 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.581028  6746 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:15.696528  6766 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.661537  6546 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.697957  6546 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.678458  4287 rpcz_store.cc:276] 0709 13:19:13.794936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.868454 (+ 73518us) service_pool.cc:224] Handling call
0709 13:19:13.958427 (+ 89973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.987520 (+ 29093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.987556 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.013055 (+ 25499us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.438923 (+425868us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:14.438965 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.439034 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.602747 (+1163713us) raft_consensus.cc:1685] finished
0709 13:19:15.602769 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.602902 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11801,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":5915,"thread_start_us":407365,"threads_started":1,"wal-append.queue_time_us":590309}
I20260709 13:19:15.702441  4291 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:15.688129  6762 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:15.704510  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 161525us
I20260709 13:19:15.695469  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:15.647730  6777 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:15.653214  6768 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.649963  6441 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.722764  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:15.700104  6546 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:15.723656  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.732551  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:15.736975  4289 raft_consensus.cc:2376] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7. Re-sending same reply.
I20260709 13:19:15.749607  6772 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:15.751756  4261 leader_election.cc:400] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:15.752169  4261 leader_election.cc:403] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:15.753299  6771 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.754262  6787 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.755069  6641 consensus_meta.cc:287] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.013s	user 0.012s	sys 0.006s
I20260709 13:19:15.722452  6634 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:15.713361  6381 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:15.756850  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:15.719672  6777 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:15.770653  4290 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:15.730827  6413 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:15.733019  6656 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:15.731603  6768 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.775796  6779 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:15.694020  6610 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.694725  6588 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.809971  4295 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
W20260709 13:19:15.810565  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.696218  6589 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.751806  6772 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:15.816913  4894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.011s	sys 0.016s
I20260709 13:19:15.763743  6634 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:15.823189  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:15.823995  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:15.740127  6441 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:15.781208  6656 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.895198  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:15.823534  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da0810d325774d7181018ff01e71333a"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:15.761577  6734 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:15.822522  4894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.011s	sys 0.017s
I20260709 13:19:15.907301  4221 raft_consensus.cc:606] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:15.860908  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.879962  4290 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:15.887223  6753 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:19:15.714222  6783 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.777218  6413 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:15.894783  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 74337.5us
I20260709 13:19:15.890654  6793 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.890480  6744 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.902374  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.935961  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88142.5us
I20260709 13:19:15.890471  6483 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.847322  6772 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.935912  6793 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.764117  6773 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.939754  6773 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:15.847944  4287 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.784654  6735 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:15.908617  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.908521  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 53443.3us
I20260709 13:19:15.773468  6641 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:15.892169  6731 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.271s	user 0.000s	sys 0.013s
I20260709 13:19:15.918776  4295 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:15.910643  6656 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:15.768191  6787 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:15.917912  6691 consensus_meta.cc:287] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.565s	user 0.003s	sys 0.013s
I20260709 13:19:15.923955  6766 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.910080  6590 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.888587  6785 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.965935  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:15.966908  4295 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:15.930068  6768 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.951777  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:15.935990  6413 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:15.941437  6752 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.982s	user 0.014s	sys 0.000s
I20260709 13:19:15.919857  4296 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:15.933128  6746 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:15.958499  4291 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:15.960170  4213 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:15.940321  6772 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.942502  6779 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:15.964717  6748 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.942353  6744 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:15.974287  6785 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:15.975145  6441 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.012471  6779 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:16.013190  6779 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:15.975302  6590 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:15.975920  6729 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.030s	user 0.001s	sys 0.003s
I20260709 13:19:15.960685  6774 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:15.976328  6713 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:15.983805  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.988258  6768 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.988600  6438 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:15.990672  4247 heartbeater.cc:646] Failed to heartbeat to 127.2.243.126:38007 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.243.126:38007 timed out after 15.000s (SENT)
I20260709 13:19:15.991693  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1764) took 1928 ms. Trace:
I20260709 13:19:15.977620  6718 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.992429  6472 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.994619  6601 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.988648  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:15.995836  6766 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.987481  6747 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:15.996356  6746 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:15.998845  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:15.999178  6413 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.000782  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:15.986860  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.024219  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.030263  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:16.181311  4291 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:16.182546  4296 raft_consensus.cc:2410] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:16.182595  4290 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.183951  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:16.042930  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.954838  6793 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.084287  4294 rpcz_store.cc:276] 0709 13:19:14.063130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.064575 (+  1445us) service_pool.cc:224] Handling call
0709 13:19:14.077023 (+ 12448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.096012 (+ 18989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.096043 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.108410 (+ 12367us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.404592 (+296182us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:14.404642 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.404705 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.891362 (+1486657us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:15.977725 (+ 86363us) raft_consensus.cc:1685] finished
0709 13:19:15.977757 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.991614 (+ 13857us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9413,"raft.queue_time_us":25321,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"spinlock_wait_cycles":3980672,"thread_start_us":295764,"threads_started":1,"wal-append.queue_time_us":435183}
I20260709 13:19:15.918128  6381 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:16.089061  6737 consensus_meta.cc:287] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.958s	user 0.012s	sys 0.000s
I20260709 13:19:16.089422  6588 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.095428  4287 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
W20260709 13:19:16.097707  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 70564.5us
I20260709 13:19:15.969682  6530 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 13:19:16.014192  6785 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:16.135385  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.093814  6772 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:16.235942  4290 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:16.236768  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:15.955034  6634 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.248315  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.104075  6676 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.267400  4287 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:16.180325  6483 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.270421  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:16.107200  6781 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.277100  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:16.112087  6666 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:16.180801  6760 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.283141  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 294587us
I20260709 13:19:16.288532  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.102829  6497 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.163s
I20260709 13:19:16.289438  4213 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:16.304597  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:16.307919  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.308739  4144 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:16.289811  6483 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.311364  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:16.312726  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:16.313128  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:16.313505  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.313858  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.314642  4294 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:16.315248  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.025410  6777 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.324770  5879 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.266067  6772 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:16.331182  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.332046  4216 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:16.317420  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.308717  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.108582  6601 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.323575  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:16.093714  6748 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.103822  6768 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.105816  6472 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.325423  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:16.313830  4214 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.367365  4287 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.326273  4220 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:16.275312  6588 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:16.370244  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.368167  4220 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:16.325430  5879 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.349818  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.349395  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.106142  6718 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.282496  6759 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.356215  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.279377  6745 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.282826  6651 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:16.358481  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.289812  6610 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.359754  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.364723  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:16.365217  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.365504  4218 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:16.107609  6755 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.184s
W20260709 13:19:16.379494  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.402819  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.403685  4294 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:16.401315  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:16.366463  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.405509  4218 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.326877  6785 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:16.238663  6737 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.111471  6774 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.326613  6589 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.314216  6760 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.331764  6630 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:16.353121  6438 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:16.283319  6676 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.400614  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:16.397523  6464 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.808s	user 0.008s	sys 0.005s
I20260709 13:19:16.419106  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.441649  4217 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:16.291711  6781 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.431492  5879 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:16.319206  6666 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:16.421204  6799 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.416s	user 0.000s	sys 0.002s
I20260709 13:19:16.457494  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.451558  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.447729  4293 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:16.459836  4142 raft_consensus.cc:2368] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5.
I20260709 13:19:16.451558  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:16.460955  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.461050  4294 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:16.483644  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:16.397889  6588 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.493054  4143 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 7. Ops: []
I20260709 13:19:16.496747  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:16.493463  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.492026  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.497910  6814 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.398061  6759 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.446895  6753 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:16.407321  6745 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.452735  6785 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:16.505573  4142 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:16.505497  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:16.472607  6751 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.561s	user 0.021s	sys 0.021s
I20260709 13:19:16.489666  4287 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:16.410849  6651 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.512274  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:16.509204  4214 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:16.447108  6809 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:16.516482  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:16.560105  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.561260  4214 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:16.455746  6630 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.530529  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.540694  4217 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.503782  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:16.544651  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.562999  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:16.542991  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.564888  4139 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:16.453413  6464 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:16.540575  6751 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.908s	user 0.021s	sys 0.022s
I20260709 13:19:16.509960  6753 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:16.608731  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.638985  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.566047  4215 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:16.712033  4139 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:16.639344  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.518765  6610 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.548095  6734 consensus_meta.cc:287] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.630s	user 0.013s	sys 0.002s
I20260709 13:19:16.521867  6783 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.562989  4138 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:16.529656  6766 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.545523  6782 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:16.746178  4218 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:16.603592  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:16.748994  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 105703us
W20260709 13:19:16.760304  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 156816us
I20260709 13:19:16.760748  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.761207  4186 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:16.637012  6725 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.772s	user 0.016s	sys 0.000s
I20260709 13:19:16.768549  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:16.560709  6413 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.637380  6483 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:16.638547  6630 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.634135  6748 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.775132  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.629638  6601 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:16.775393  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:16.757901  6744 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.626821  6760 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:16.781412  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.804430  4294 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:16.716274  6747 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.601874  6795 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:16.782487  4926 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:16.619252  6666 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:16.580819  6641 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:16.782994  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:16.627169  6746 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:16.636534  6809 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:16.541484  6787 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.636204  6774 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:16.796695  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:16.806675  6789 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.547s	user 0.000s	sys 0.002s
I20260709 13:19:16.775876  6570 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:16.533355  6814 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.776582  6651 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:16.776427  6734 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:16.634814  6777 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:16.781776  6782 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:16.822248  4291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.003s	sys 0.046s
I20260709 13:19:16.788434  6755 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:16.757088  6610 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:16.807533  6798 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.459s	user 0.002s	sys 0.000s
I20260709 13:19:16.635257  6588 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.831326  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:16.854574  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:16.830837  6768 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.855726  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:16.832369  4923 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
W20260709 13:19:16.832602  6802 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:19:16.833050  6770 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:16.832960  6754 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:16.635283  6785 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.629824  6438 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.812493  6472 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.871237  6759 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:16.848603  6823 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:16.853003  6413 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.846956  4291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.004s	sys 0.046s
I20260709 13:19:16.795342  6792 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.205s
I20260709 13:19:16.796464  6766 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:16.889171  6792 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:16.889744  6792 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:16.863443  6770 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.890538  6770 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.890916  6792 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.781661  6725 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.852043  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:16.901278  4139 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:16.821590  6747 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.831243  6795 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:16.856432  4218 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.843561  6570 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.855329  4294 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:16.842052  6483 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.865844  6754 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.852916  6755 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:16.887871  6779 consensus_meta.cc:287] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.874s	user 0.016s	sys 0.001s
I20260709 13:19:16.818068  6753 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:16.892648  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.893476  6413 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.856500  6554 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.850390  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:16.974043  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.856855  6734 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:16.904307  6795 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.859987  6745 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:17.000484  6570 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.833673  6809 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:16.904628  6761 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:17.027233  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 175597us
I20260709 13:19:17.011755  6779 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.012889  6483 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.000299  6777 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:17.038511  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:16.873996  6782 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.000927  6781 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.005930  6754 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:17.030411  6735 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.078s	user 0.015s	sys 0.000s
I20260709 13:19:17.203186  4218 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:17.203321  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1781) took 2025 ms. Trace:
I20260709 13:19:17.201901  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:17.237170  4217 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.673s	user 0.013s	sys 0.000s
I20260709 13:19:17.237718  4217 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
W20260709 13:19:17.035283  6800 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.746s	user 0.004s	sys 0.000s
W20260709 13:19:17.238744  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 200321us
I20260709 13:19:17.242214  4139 raft_consensus.cc:2368] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:17.242998  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:17.235316  4288 rpcz_store.cc:276] 0709 13:19:15.176975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.177155 (+   180us) service_pool.cc:224] Handling call
0709 13:19:15.177512 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.392774 (+215262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.393004 (+   230us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.418031 (+ 25027us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.588967 (+170936us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:15.589097 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.590049 (+   952us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.986492 (+1396443us) raft_consensus.cc:1685] finished
0709 13:19:16.986512 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.202375 (+215863us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":351740,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":300609,"threads_started":2,"wal-append.queue_time_us":473270}
I20260709 13:19:17.249059  4218 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:17.152781  6733 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.730s	user 0.017s	sys 0.000s
I20260709 13:19:17.263038  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:17.266192  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:17.266431  4213 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:17.267081  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:17.271744  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1796) took 1280 ms. Trace:
I20260709 13:19:17.272261  4217 raft_consensus.cc:2410] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:17.241833  6656 consensus_meta.cc:287] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.274s	user 0.015s	sys 0.000s
I20260709 13:19:17.276144  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:17.214377  6792 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.279817  6483 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:17.214705  6753 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:17.289762  6521 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.603s	user 0.013s	sys 0.005s
I20260709 13:19:17.270984  4296 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:17.032825  6554 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.281576  6413 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.184864  6786 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:17.284716  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:17.284929  6814 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:17.284623  6656 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:17.286147  6713 consensus_meta.cc:287] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.197s	user 0.014s	sys 0.000s
I20260709 13:19:17.213943  6779 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:17.287367  6590 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.259079  6827 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.243036  6777 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.089339  6761 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.190325  6755 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.290738  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:17.365736  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1944) took 1070 ms. Trace:
I20260709 13:19:17.088706  6768 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:17.293720  4139 raft_consensus.cc:2368] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:17.043622  6464 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:17.243762  6747 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.289700  4220 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.307786  6818 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.299206  4147 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:17.048802  6725 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:17.299438  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:17.272318  4291 rpcz_store.cc:276] 0709 13:19:15.991746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.196433 (+204687us) service_pool.cc:224] Handling call
0709 13:19:16.196814 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.000588 (+803774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.000675 (+    87us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.022958 (+ 22283us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.264175 (+241217us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:17.264244 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.264398 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.270388 (+  5990us) raft_consensus.cc:1685] finished
0709 13:19:17.270425 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.271639 (+  1214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":310622,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":10505,"thread_start_us":850543,"threads_started":2,"wal-append.queue_time_us":208577}
W20260709 13:19:17.301340  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.300231  6773 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.360s	user 0.009s	sys 0.009s
I20260709 13:19:17.306488  4216 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:17.123878  6734 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:17.361735  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 114545us
I20260709 13:19:17.309911  6521 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.303604  6774 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:17.367848  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 227) took 1615 ms. Trace:
I20260709 13:19:17.384433  4146 rpcz_store.cc:276] 0709 13:19:15.751988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.768061 (+ 16073us) service_pool.cc:224] Handling call
0709 13:19:15.768552 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.777683 (+  9131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.777732 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.821334 (+ 43602us) log.cc:844] Serialized 26 byte log entry
0709 13:19:16.015474 (+194140us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:16.015521 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.015600 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.005244 (+989644us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:17.362004 (+356760us) raft_consensus.cc:1685] finished
0709 13:19:17.362035 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.367771 (+  5736us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79381,"raft.queue_time_us":8741,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":35763,"spinlock_wait_cycles":35626240,"thread_start_us":109719,"threads_started":1,"wal-append.queue_time_us":328772}
I20260709 13:19:17.386891  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:17.274812  6733 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.366268  4218 rpcz_store.cc:276] 0709 13:19:16.294912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.290319 (+995407us) service_pool.cc:224] Handling call
0709 13:19:17.365665 (+ 75346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:17.036310  6828 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:17.356405  6497 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.376540  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1934) took 1083 ms. Trace:
I20260709 13:19:17.377828  4220 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:17.388947  4218 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:17.388844  4217 rpcz_store.cc:276] 0709 13:19:16.293070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.297773 (+1004703us) service_pool.cc:224] Handling call
0709 13:19:17.376470 (+ 78697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:17.389941  4146 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:17.383383  4145 raft_consensus.cc:2410] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:17.362080  6748 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:17.390076  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1935) took 1096 ms. Trace:
I20260709 13:19:17.390566  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:17.393404  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.393759  4139 raft_consensus.cc:2376] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7. Re-sending same reply.
I20260709 13:19:17.394169  4291 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:17.394337  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1937) took 1100 ms. Trace:
I20260709 13:19:17.391614  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:17.359993  6827 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.393414  4218 rpcz_store.cc:276] 0709 13:19:16.293279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.388388 (+1095109us) service_pool.cc:224] Handling call
0709 13:19:17.388750 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.389707 (+   957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.389997 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:17.394819  4217 rpcz_store.cc:276] 0709 13:19:16.293690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.390601 (+1096911us) service_pool.cc:224] Handling call
0709 13:19:17.393763 (+  3162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.393973 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.393998 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.394046 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:17.394102 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.394156 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.394274 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:17.310756  6786 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.395036  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:17.404228  4295 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:17.380667  6641 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:17.406520  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1939) took 1108 ms. Trace:
I20260709 13:19:17.406673  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:17.388180  6828 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.381847  6779 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:17.407671  4139 raft_consensus.cc:2368] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:17.406991  4217 rpcz_store.cc:276] 0709 13:19:16.294022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.398207 (+1104185us) service_pool.cc:224] Handling call
0709 13:19:17.402307 (+  4100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.402505 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.402534 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.402577 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:17.402618 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.402676 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.402792 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:17.400691  6827 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.374320  6768 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.430429  6634 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:17.433943  6777 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:17.381136  6818 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.399348  6497 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.420563  6735 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:17.396762  6774 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.422840  6828 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:17.393841  6521 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.445785  4220 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
W20260709 13:19:17.444224  6832 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 13:19:17.399941  6748 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.424912  6779 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.463165  6779 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:17.457242  4220 pending_rounds.cc:85] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 4
I20260709 13:19:17.423349  6641 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.585098  4220 pending_rounds.cc:107] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:19:17.585997  4220 raft_consensus.cc:2889] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:17.459074  6656 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.468513  6768 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:17.474644  6554 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:17.587409  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1929) took 1305 ms. Trace:
W20260709 13:19:17.584985  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 201336us
W20260709 13:19:17.540320  6770 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.004s
W20260709 13:19:17.514400  6829 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:19:17.566628  4892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.67:40585 timed out after 1.588s (SENT) [suppressed 4 similar messages]
I20260709 13:19:17.596414  4220 rpcz_store.cc:276] 0709 13:19:16.281867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.282040 (+   173us) service_pool.cc:224] Handling call
0709 13:19:16.282393 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.289225 (+1006832us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b4c00232840. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3cfaea20 00007fee3cfbfa29 00007fee3cf85644 00007fee3cfacf2d 00007fee3cfacb93 00007fee3ecdd18b 00007fee3ecddcb5 00007fee3ecd8f30 00007fee3ecda7de 00007fee3ece4b49 00007fee3ece5416
0709 13:19:17.587103 (+297878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.587343 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116990208}
I20260709 13:19:17.600579  4187 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:17.463366  6521 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.474082  6733 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:17.604765  4220 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 1. Current term is 3. Ops: []
W20260709 13:19:17.607016  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.609112  6818 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.623298  6779 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:17.624019  6779 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.624979  6786 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:17.578100  6775 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:17.626629  4261 connection.cc:256] RPC call timeout handler was delayed by -4.4146511250000913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:19:17.626878  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.627120  4261 connection.cc:256] RPC call timeout handler was delayed by -4.4029511250000724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 13:19:17.614878  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1666) took 1224 ms. Trace:
I20260709 13:19:17.616012  6521 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:19:17.633476  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 66914.6us
I20260709 13:19:17.626012  6761 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.621904  6748 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:17.627334  4187 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:17.629566  4220 rpcz_store.cc:276] 0709 13:19:16.390928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.603918 (+1212990us) service_pool.cc:224] Handling call
0709 13:19:17.604482 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.614448 (+  9966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.614792 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:17.629777  4261 connection.cc:256] RPC call timeout handler was delayed by -4.3993511250000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:19:17.629343  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1933) took 1336 ms. Trace:
I20260709 13:19:17.619041  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:17.636581  6554 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:17.633885  6570 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.007s
W20260709 13:19:17.642693  4261 connection.cc:256] RPC call timeout handler was delayed by -4.2859511250001106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 13:19:17.657572  4261 connection.cc:256] RPC call timeout handler was delayed by -4.153651125000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 13:19:17.658010  4261 connection.cc:256] RPC call timeout handler was delayed by -4.1527511250001226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:19:17.658327  4261 connection.cc:256] RPC call timeout handler was delayed by -4.1356511250000949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:19:17.658619  4261 connection.cc:256] RPC call timeout handler was delayed by -4.1221511250000731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:19:17.643407  4220 raft_consensus.cc:1217] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
W20260709 13:19:17.658972  4261 connection.cc:256] RPC call timeout handler was delayed by -4.0573511249999683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:19:17.602082  6770 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:17.659339  4261 connection.cc:256] RPC call timeout handler was delayed by -3.9799511250000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 13:19:17.659402  4220 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:19:17.640064  6656 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.642777  4216 rpcz_store.cc:276] 0709 13:19:16.292746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.390141 (+1097395us) service_pool.cc:224] Handling call
0709 13:19:17.403629 (+ 13488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.403887 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:17.593205 (+189318us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.628810 (+ 35605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.628890 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:17.628984 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.629087 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.629259 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204147,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":147,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5579,"thread_start_us":205807,"threads_started":2,"wal-append.queue_time_us":22876}
I20260709 13:19:17.641283  6774 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:17.661046  4261 connection.cc:256] RPC call timeout handler was delayed by -3.9349511249999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:19:17.665115  4261 connection.cc:256] RPC call timeout handler was delayed by -3.623551124999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2403s for a response
W20260709 13:19:17.665560  4261 connection.cc:256] RPC call timeout handler was delayed by -3.5443511250000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24910000000000002s for a response
W20260709 13:19:17.665916  4261 connection.cc:256] RPC call timeout handler was delayed by -3.14835112500009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2931s for a response
I20260709 13:19:17.661963  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1670) took 1119 ms. Trace:
W20260709 13:19:17.666427  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 63859.3us
I20260709 13:19:17.667660  4187 leader_election.cc:400] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5.
I20260709 13:19:17.636790  6775 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.652868  6754 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.658525  6818 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:17.667433  4220 rpcz_store.cc:276] 0709 13:19:16.542710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.642844 (+1100134us) service_pool.cc:224] Handling call
0709 13:19:17.643257 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.661355 (+ 18098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.661870 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:17.718029  6757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.770s	user 0.014s	sys 0.008s
I20260709 13:19:17.668793  4187 leader_election.cc:403] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.768270  4222 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:17.660310  4919 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:17.721905  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1797) took 1477 ms. Trace:
I20260709 13:19:17.736150  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1631) took 1370 ms. Trace:
I20260709 13:19:17.736932  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1837) took 1997 ms. Trace:
W20260709 13:19:17.718240  4145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1626) took 1381 ms (client timeout 1667 ms). Trace:
I20260709 13:19:17.767663  6762 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.660570  6765 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:17.769030  4893 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:17.772573  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.780985  4919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 404) took 1063 ms. Trace:
I20260709 13:19:17.781492  4919 rpcz_store.cc:276] 0709 13:19:16.717749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.740460 (+ 22711us) service_pool.cc:224] Handling call
0709 13:19:17.618811 (+878351us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:19:17.780891 (+162080us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17270656}
W20260709 13:19:17.774410  4145 rpcz_store.cc:269] 0709 13:19:16.316612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.316772 (+   160us) service_pool.cc:224] Handling call
0709 13:19:17.694228 (+1377456us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b5400076f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:17.698173 (+  3945us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274275712}
W20260709 13:19:17.771785  6757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.826s	user 0.015s	sys 0.008s
I20260709 13:19:17.775653  6770 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.773689  4290 rpcz_store.cc:276] 0709 13:19:16.244771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.246540 (+  1769us) service_pool.cc:224] Handling call
0709 13:19:16.247010 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.247458 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:16.788991 (+541533us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.684663 (+895672us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b180025f660. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a 00007fee3ececa2a
0709 13:19:17.721357 (+ 36694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.721442 (+    85us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:17.721505 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.721602 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.721818 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":341360,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":7317,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":135,"spinlock_wait_cycles":8098560,"thread_start_us":535601,"threads_started":2,"wal-append.queue_time_us":978817}
I20260709 13:19:17.671450  4216 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:17.783293  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.793627  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:17.794031  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:17.794415  4924 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:17.795698  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:17.796207  4294 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:17.796495  4288 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:17.797677  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:17.783584  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 119392us
I20260709 13:19:17.773931  4147 rpcz_store.cc:276] 0709 13:19:16.366302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.402666 (+ 36364us) service_pool.cc:224] Handling call
0709 13:19:16.404861 (+  2195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.374971 (+970110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.735813 (+360842us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b540022ddd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:17.736059 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2056292608}
I20260709 13:19:17.774689  4293 rpcz_store.cc:276] 0709 13:19:15.739912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.776399 (+ 36487us) service_pool.cc:224] Handling call
0709 13:19:15.776725 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.459838 (+683113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.736594 (+1276756us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b5400374454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:17.736840 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542624512}
I20260709 13:19:17.799522  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.657830  6779 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:17.785987  6818 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:17.800050  4290 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.801338  4147 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:17.663439  6570 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.801774  4290 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:17.667203  6656 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.660694  6554 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.803586  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.885183  4287 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:17.807622  4293 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:17.804250  6478 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:17.758253  6828 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.812723  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.804687  6827 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:17.888176  4291 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:17.813666  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.814445  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.890213  4290 raft_consensus.cc:2410] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:17.891112  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:17.814555  6610 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.816746  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:17.817703  6754 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.820328  6748 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:17.821938  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.822196  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.822491  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.825572  4142 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:17.825892  6656 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.733909  6772 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.897948  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.898613  6772 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.898787  4293 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:17.826905  4259 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:17.829972  6718 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.833570  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1624) took 1523 ms. Trace:
W20260709 13:19:17.834548  4213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1946) took 1539 ms (client timeout 1867 ms). Trace:
W20260709 13:19:17.836817  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.837508  6779 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.781080  6765 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:17.846585  4138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1627) took 1517 ms (client timeout 1853 ms). Trace:
I20260709 13:19:17.906564  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1595) took 1391 ms. Trace:
I20260709 13:19:17.900969  4140 rpcz_store.cc:276] 0709 13:19:16.314878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.315013 (+   135us) service_pool.cc:224] Handling call
0709 13:19:17.833321 (+1518308us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400068e54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:17.833495 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2939297152}
W20260709 13:19:17.846920  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.907001  4142 rpcz_store.cc:276] 0709 13:19:16.515213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.824928 (+1309715us) service_pool.cc:224] Handling call
0709 13:19:17.825357 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.896767 (+ 71410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.906475 (+  9708us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:17.906947  4138 rpcz_store.cc:269] 0709 13:19:16.329073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.329266 (+   193us) service_pool.cc:224] Handling call
0709 13:19:17.846323 (+1517057us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540038ed54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:17.846488 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341907840}
I20260709 13:19:17.849777  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 229) took 1270 ms. Trace:
I20260709 13:19:17.854102  4214 raft_consensus.cc:2368] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:17.908674  4144 rpcz_store.cc:276] 0709 13:19:16.579833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.848487 (+1268654us) service_pool.cc:224] Handling call
0709 13:19:17.849003 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.849290 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.849329 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.849389 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:17.849442 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.849522 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.849687 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:17.855319  6570 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.856433  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:17.911110  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:17.912182  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55904.2us
I20260709 13:19:17.857002  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1644) took 1362 ms. Trace:
I20260709 13:19:17.913637  4147 rpcz_store.cc:276] 0709 13:19:16.494861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.800461 (+1305600us) service_pool.cc:224] Handling call
0709 13:19:17.801014 (+   553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.801889 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.856935 (+ 55046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:17.859126  6497 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:17.916030  4294 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:17.887804  6478 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.872959  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1848) took 1877 ms. Trace:
I20260709 13:19:17.892194  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.894182  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.897673  4289 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:17.900321  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.900609  4288 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
W20260709 13:19:17.901154  4213 rpcz_store.cc:269] 0709 13:19:16.295336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.456774 (+161438us) service_pool.cc:224] Handling call
0709 13:19:17.834361 (+1377587us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540001f754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:17.834480 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714258176}
W20260709 13:19:17.900571  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 73734.7us
I20260709 13:19:17.901017  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.868541  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1633) took 1450 ms. Trace:
I20260709 13:19:17.933344  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:17.988704  4291 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:17.988452  4141 rpcz_store.cc:276] 0709 13:19:16.417739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.445942 (+ 28203us) service_pool.cc:224] Handling call
0709 13:19:16.470385 (+ 24443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.531357 (+ 60972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.531396 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.531438 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:16.531483 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.868261 (+1336778us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b540010fc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:17.868311 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.868469 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139635456}
W20260709 13:19:17.987658  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 224860us
I20260709 13:19:17.985742  4296 rpcz_store.cc:276] 0709 13:19:15.996058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.235650 (+239592us) service_pool.cc:224] Handling call
0709 13:19:17.270653 (+1035003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.300083 (+ 29430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.872694 (+572611us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400288f50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:17.872871 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379121408}
I20260709 13:19:17.995028  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.009052  4296 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:17.910683  6733 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:17.998597  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65331us
I20260709 13:19:18.004750  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.987372  4293 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:17.993324  4923 raft_consensus.cc:2368] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:17.978837  6521 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:19:18.000089  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.010957  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:17.993683  6478 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.023733  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.006969  6570 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.024501  4296 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:18.015766  4291 raft_consensus.cc:3055] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:18.028707  4291 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:17.916378  6779 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:17.911571  6774 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:19:18.019033  6752 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.019858  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1642) took 1525 ms. Trace:
I20260709 13:19:17.916735  6801 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:19:18.026350  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.039237  4287 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
W20260709 13:19:18.027210  4261 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.541s (SENT)
I20260709 13:19:18.012153  4294 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:17.917274  6792 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
W20260709 13:19:18.011902  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 119460us
I20260709 13:19:17.917752  6651 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:19:17.907521  6748 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:18.034693  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:18.029624  4291 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:18.042954  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.043394  4291 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.040864  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:18.034600  4139 rpcz_store.cc:276] 0709 13:19:16.494123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.440146 (+946023us) service_pool.cc:224] Handling call
0709 13:19:17.453630 (+ 13484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.454326 (+   696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.454359 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.537191 (+ 82832us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.656798 (+119607us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:17.908043 (+251245us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.019455 (+111412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.019545 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.019589 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:18.019603 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.019789 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116515,"raft.queue_time_us":112805,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":9872,"thread_start_us":197344,"threads_started":2,"wal-append.queue_time_us":99485}
I20260709 13:19:18.044782  4296 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:18.034318  6666 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:18.046325  6666 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:18.029649  6818 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5.
I20260709 13:19:18.048732  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.044073  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.055169  6666 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:18.055778  6827 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:18.055920  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.056536  4112 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.014479  6733 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:18.057906  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:18.058533  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.058825  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.121169  4294 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:18.059458  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.060458  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:18.062527  6656 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.064401  6792 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:18.065543  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.049299  6734 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:18.033756  6570 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.072266  6765 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.078138  6676 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:18.083209  6737 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:18.083904  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.084105  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.084255  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.089483  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.090615  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.090798  6779 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:18.092602  6819 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.599s	user 0.008s	sys 0.006s
I20260709 13:19:18.093132  6766 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:18.094449  4222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1930) took 1812 ms (client timeout 2105 ms). Trace:
W20260709 13:19:18.095458  4215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1664) took 1807 ms (client timeout 1921 ms). Trace:
I20260709 13:19:18.095779  6634 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.124821  6792 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.080219  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:18.080725  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.109484  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 330) took 1777 ms. Trace:
I20260709 13:19:18.151127  4218 rpcz_store.cc:276] 0709 13:19:16.332266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.398292 (+1066026us) service_pool.cc:224] Handling call
0709 13:19:17.398630 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.578691 (+180061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.578742 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.578808 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:17.578873 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.109226 (+530353us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400215554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:18.109281 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.109427 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413241088}
I20260709 13:19:18.153290  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.155051  4218 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:18.113999  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.051748  6530 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:18.052583  6641 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:18.128960  6734 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:18.131331  6770 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.121789  4287 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:18.176614  4922 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:18.035733  6521 consensus_queue.cc:1059] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:19:18.123863  4296 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.123643  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:18.178082  4293 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.061451  6733 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:18.130017  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 71582us
I20260709 13:19:18.131256  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.179811  4219 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:18.107923  6735 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:18.080984  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.056746  6774 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:19:18.141705  4259 leader_election.cc:400] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:18.147194  6737 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.190018  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.193992  4218 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:18.195068  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.195762  4218 raft_consensus.cc:2376] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6. Re-sending same reply.
W20260709 13:19:18.196478  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.204455  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 192204us
I20260709 13:19:18.123039  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.143719  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:18.220093  4294 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:19:18.144635  4215 rpcz_store.cc:269] 0709 13:19:16.288081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.288371 (+   290us) service_pool.cc:224] Handling call
0709 13:19:18.095274 (+1806903us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540041aad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:18.095396 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579126656}
I20260709 13:19:18.121361  6651 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:18.144500  4222 rpcz_store.cc:269] 0709 13:19:16.282229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.308990 (+ 26761us) service_pool.cc:224] Handling call
0709 13:19:18.094249 (+1785259us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001f7a54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:18.094378 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3207999744}
I20260709 13:19:18.095919  6828 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:18.147102  6676 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:18.216428  4920 raft_consensus.cc:2410] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:19:18.117542  4214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1671) took 1399 ms (client timeout 1667 ms). Trace:
I20260709 13:19:18.173575  6634 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:18.176153  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.144461  6809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.008s	sys 0.054s
I20260709 13:19:18.180660  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:18.258620  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 78091.9us
I20260709 13:19:18.258803  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.259523  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.259806  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.190526  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.260664  4219 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:18.259531  4215 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:18.191694  4259 leader_election.cc:403] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:19:18.142230  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 83985.9us
I20260709 13:19:18.206286  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:18.262281  4287 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.262704  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:18.174204  6792 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.211100  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 331) took 1878 ms. Trace:
I20260709 13:19:18.217094  6748 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:18.175088  6554 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:18.207574  4919 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:18.182183  6765 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.184136  6735 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:18.220196  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:18.257697  6809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.008s	sys 0.055s
I20260709 13:19:18.247145  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.156703  4220 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
I20260709 13:19:18.192669  6530 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:18.216037  6622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.702s	user 0.010s	sys 0.017s
W20260709 13:19:18.254225  4214 rpcz_store.cc:269] 0709 13:19:16.717851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.774801 (+ 56950us) service_pool.cc:224] Handling call
0709 13:19:18.111006 (+1336205us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002f0b54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:18.117454 (+  6448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446628096}
W20260709 13:19:18.263609  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 123700us
I20260709 13:19:18.265172  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.213807  4921 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:18.268424  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:18.268093  4217 rpcz_store.cc:276] 0709 13:19:16.332682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.423221 (+1090539us) service_pool.cc:224] Handling call
0709 13:19:17.424573 (+  1352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.597050 (+172477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.597103 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.597151 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:17.597197 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.210761 (+613564us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54002ef754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:18.210823 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.211025 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396126976}
W20260709 13:19:18.213792  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 173000us
I20260709 13:19:18.215891  6737 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.282487  4110 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:18.303910  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.255059  6676 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.273550  6766 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.290400  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.298470  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.323632  4214 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:18.299445  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:18.304277  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84179.4us
I20260709 13:19:18.324888  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.304702  4215 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:18.254629  6651 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.271786  6795 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.277046  6666 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.281126  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.312464  4294 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:18.318753  4287 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:18.285251  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 405) took 1567 ms. Trace:
I20260709 13:19:18.326377  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.309244  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:18.348414  4214 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.350948  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:18.319921  6773 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:18.325376  6754 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:18.331808  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.332020  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.311235  6570 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:18.381240  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.334965  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:18.291742  6622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.786s	user 0.010s	sys 0.018s
I20260709 13:19:18.340955  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:18.390833  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49988.7us
I20260709 13:19:18.337564  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:18.347095  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47738.5us
I20260709 13:19:18.347295  4222 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:18.360419  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:18.308256  6770 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.321257  6676 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.320904  6748 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.367190  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.431596  4294 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:18.367702  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.374305  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.368116  6773 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:18.334157  6841 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.567s	user 0.004s	sys 0.000s
W20260709 13:19:18.369386  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.386549  4187 connection.cc:256] RPC call timeout handler was delayed by -1.0569550850000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 13:19:18.387411  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:18.441072  4288 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:18.396234  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43985.4us
I20260709 13:19:18.338513  6666 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.396768  4214 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:18.396168  4186 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:18.280128  6734 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:18.426046  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.372040  6849 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.366739  6620 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:18.368837  6610 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:18.376794  6754 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.379282  4215 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:18.475322  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:18.476291  4138 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:18.466439  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.348054  6766 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:19:18.446197  4220 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:18.446647  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:18.448449  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:18.442906  6773 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:18.451530  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:18.452816  4147 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:18.457954  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.347939  6478 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:18.466355  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.406548  6812 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:18.468562  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 72456.5us
I20260709 13:19:18.469966  6857 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:18.392941  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.470902  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:18.471483  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 150633us
I20260709 13:19:18.528717  4141 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:18.526836  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:18.380107  6795 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.477749  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.479959  4140 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 2: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:18.449801  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.552021  4291 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:18.554090  4926 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:18.347932  4920 rpcz_store.cc:276] 0709 13:19:16.718157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.740707 (+ 22550us) service_pool.cc:224] Handling call
0709 13:19:18.084106 (+1343399us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b5800144998. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbdeee 0000000000375939 00007fee43c311e0 00007fee43cfa0c4 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:19:18.280223 (+196117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19512576}
I20260709 13:19:18.482899  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:18.482899  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.464924  6666 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.534801  4112 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.535318  4287 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:18.536829  4294 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.467322  6620 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.479230  6754 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.545645  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:18.451381  6554 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:18.560068  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.566007  4288 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:18.475754  6570 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:18.570820  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.389213  6735 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.575165  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.580468  4138 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:18.583910  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:18.591013  4291 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:18.476132  6610 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:18.593587  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.546525  6795 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.601550  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:18.525199  6634 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:18.579352  6620 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.467324  6530 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.621798  4141 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:18.622946  4138 raft_consensus.cc:1217] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Deduplicated request from leader. Original: 7.4->[9.5-9.5]   Dedup: 9.5->[]
W20260709 13:19:18.592975  6854 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:19:18.570212  6762 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.609404  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.649744  4222 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:18.626784  6868 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:18.608788  6610 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.634951  6752 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:18.635800  6801 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:18.625422  6795 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.647703  4138 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:18.637336  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.584573  6812 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:18.648629  4293 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:18.697301  6812 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:18.698493  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:18.634243  6859 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:18.655740  4294 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:18.658455  4296 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:18.596607  6570 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.701138  6570 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.701310  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.702262  4220 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:18.702693  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:18.582849  6828 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:18.604377  6793 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:18.636088  6860 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:19:18.546761  6857 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.645591  4924 raft_consensus.cc:2368] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:18.688895  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:18.690162  4138 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:18.838690  4138 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 5. Ops: []
I20260709 13:19:18.696051  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.839839  4287 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:18.841063  6656 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.005s
I20260709 13:19:18.840965  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.841621  6656 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:18.842700  6733 consensus_meta.cc:287] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.001s
I20260709 13:19:18.843168  6733 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:18.703167  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.844591  4290 raft_consensus.cc:2410] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:18.673686  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:19:18.846568  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 172958us
W20260709 13:19:18.707454  4295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47710 (request call id 298) took 2730 ms (client timeout 1588 ms). Trace:
W20260709 13:19:18.848589  4295 rpcz_store.cc:269] 0709 13:19:15.977330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.977666 (+   336us) service_pool.cc:224] Handling call
0709 13:19:18.707195 (+2729529us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002779d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:18.707369 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2809471232}
I20260709 13:19:18.850310  4295 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:18.851615  4295 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:18.704735  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:18.746605  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.852545  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.769052  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.854601  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:18.854890  4292 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:18.855702  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 1860) took 1045 ms. Trace:
I20260709 13:19:18.856112  4292 rpcz_store.cc:276] 0709 13:19:17.810394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.713393 (+902999us) service_pool.cc:224] Handling call
0709 13:19:18.855620 (+142227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:18.858507  6857 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:18.859244  6857 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:18.859582  6857 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:18.859962  6857 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.861194  6570 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.828306  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.903499  4218 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:18.717705  6478 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:18.905798  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:18.828249  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:18.907043  4222 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:18.867103  6849 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:18.710158  6864 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:18.650480  6737 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:18.647753  6651 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:18.683782  6842 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.917s	user 0.000s	sys 0.005s
I20260709 13:19:18.832523  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1641) took 2338 ms. Trace:
I20260709 13:19:18.834682  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:18.936578  4293 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:18.835757  6772 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.002s
I20260709 13:19:18.706208  6786 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:18.950197  6786 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:18.954082  4924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42928 (request call id 203) took 1149 ms. Trace:
I20260709 13:19:18.954797  4924 rpcz_store.cc:276] 0709 13:19:17.805123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.816412 (+ 11289us) service_pool.cc:224] Handling call
0709 13:19:18.953704 (+1137292us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400113854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:18.953974 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591170304}
I20260709 13:19:18.956269  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:18.957274  4259 leader_election.cc:400] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:18.957628  4259 leader_election.cc:403] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:19:18.846695  6733 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:18.798429  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.647235  6735 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.864120  4261 leader_election.cc:400] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
W20260709 13:19:18.969276  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 105322us
I20260709 13:19:18.970290  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:18.827078  4185 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:18.970850  6862 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
W20260709 13:19:18.971678  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 144725us
I20260709 13:19:18.973078  6651 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:18.973368  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:18.973858  6651 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:18.974761  4185 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:18.874626  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:18.868114  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:18.873086  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 271665us
I20260709 13:19:18.707190  6779 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:18.680143  6801 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:18.951642  6786 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:18.996318  6801 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:18.997092  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1809) took 1185 ms. Trace:
I20260709 13:19:18.997514  6801 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.712915  6766 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.002105  6570 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:18.672748  6752 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:19.004510  6752 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.005697  6752 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.006412  6762 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.006788  6734 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.860006  4893 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:18.688937  6856 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260709 13:19:18.910028  4288 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:19.012871  4143 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:19.016990  4217 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
W20260709 13:19:19.021550  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 45934.5us
I20260709 13:19:18.914659  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1643) took 2420 ms. Trace:
I20260709 13:19:18.937201  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:18.936225  4146 rpcz_store.cc:276] 0709 13:19:16.493713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.404048 (+910335us) service_pool.cc:224] Handling call
0709 13:19:17.404661 (+   613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.405029 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:17.823246 (+418217us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18002b8820. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf2455 00007fee426da3c7 00007fee3ecec9a7 00007fee3ecfc0bf 00007fee3ecfc038
0709 13:19:18.132622 (+309376us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.552830 (+420208us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.553530 (+   700us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.553703 (+   173us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:18.556172 (+  2469us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.561516 (+  5344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.561612 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.832229 (+270617us) raft_consensus.cc:1685] finished
0709 13:19:18.832254 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.832451 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25071,"prepare.queue_time_us":663350,"prepare.run_cpu_time_us":157,"prepare.run_wall_time_us":5498,"raft.queue_time_us":71537,"raft.run_cpu_time_us":598,"raft.run_wall_time_us":58288,"spinlock_wait_cycles":4678016,"thread_start_us":663622,"threads_started":3,"wal-append.queue_time_us":252183}
I20260709 13:19:18.939090  4292 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:18.945546  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.928663  6868 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:18.977290  4220 raft_consensus.cc:2368] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:18.991043  6774 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:18.991590  6852 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:18.992051  4289 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:19.008065  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 148134us
I20260709 13:19:18.997537  4290 rpcz_store.cc:276] 0709 13:19:17.811903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.891973 (+ 80070us) service_pool.cc:224] Handling call
0709 13:19:18.996795 (+1104822us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54002d5ad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:18.996991 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974997248}
I20260709 13:19:19.009193  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.010161  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:19.011116  4293 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
W20260709 13:19:19.109795  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.124785  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.121354  4892 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:19.121354  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:19.136198  4214 raft_consensus.cc:2368] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:19.020949  6472 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:19.146299  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.146849  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1924) took 2878 ms. Trace:
I20260709 13:19:19.147248  4221 rpcz_store.cc:276] 0709 13:19:16.268473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.271266 (+  2793us) service_pool.cc:224] Handling call
0709 13:19:16.303738 (+ 32472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.327745 (+ 24007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.327777 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.358604 (+ 30827us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.113540 (+1754936us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b1800236fe0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e8820d1 00007fee3ec9da0f
0709 13:19:18.281125 (+167585us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:18.281198 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.281317 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.146513 (+865196us) raft_consensus.cc:1685] finished
0709 13:19:19.146537 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.146780 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34927,"raft.queue_time_us":95090,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":18581,"spinlock_wait_cycles":36040960,"thread_start_us":167244,"threads_started":1,"wal-append.queue_time_us":1992748}
I20260709 13:19:19.021608  6764 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.038422  6737 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.150719  6641 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.151153  6641 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:19.095491  6754 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:19.151935  6792 consensus_meta.cc:287] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.004s
I20260709 13:19:19.152460  6792 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.123034  6795 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.153849  6754 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:19.154981  6795 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.123296  4145 rpcz_store.cc:276] 0709 13:19:16.494481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.798279 (+1303798us) service_pool.cc:224] Handling call
0709 13:19:17.894392 (+ 96113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.020037 (+125645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.020067 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.028147 (+  8080us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.217026 (+188879us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:18.256154 (+ 39128us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.256514 (+   360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.256629 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.699041 (+442412us) raft_consensus.cc:1685] finished
0709 13:19:18.699066 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.914564 (+215498us) inbound_call.cc:177] Queueing success response
0709 13:19:18.973963 (+ 59399us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003885a0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
Metrics: {"mutex_wait_us":157379,"prepare.queue_time_us":37354,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":125734,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":203,"spinlock_wait_cycles":23708416,"thread_start_us":149529,"threads_started":1,"wal-append.queue_time_us":292083}
I20260709 13:19:19.157614  6610 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:19.160030  6666 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.000s
W20260709 13:19:19.185541  6620 consensus_meta.cc:287] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
W20260709 13:19:19.186022  6676 consensus_meta.cc:287] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.004s
I20260709 13:19:19.186298  6620 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:19.186713  6676 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.188153  4219 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:19.188462  6666 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.188870  6610 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.190366  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.191009  6666 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.191632  4219 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:19.192829  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.193660  4219 raft_consensus.cc:2410] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:19.194810  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.144057  6622 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:19.206642  4143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1640) took 2713 ms (client timeout 1726 ms). Trace:
W20260709 13:19:19.216603  4143 rpcz_store.cc:269] 0709 13:19:16.493374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.499369 (+  5995us) service_pool.cc:224] Handling call
0709 13:19:19.206405 (+2707036us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b5400286254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:19.206551 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5160287616}
I20260709 13:19:19.218004  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.218724  4143 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:19.220016  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.205798  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.221170  4221 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:19.225855  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:19.122735  6765 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.832s	user 0.015s	sys 0.000s
I20260709 13:19:19.244120  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:19.244112  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:19.160830  4147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.000s	sys 0.020s
W20260709 13:19:19.161213  6861 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:19:19.162310  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:19.252561  4147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.001s	sys 0.020s
I20260709 13:19:19.163096  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.121994  6733 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:19.253264  4145 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:19.165671  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44396us
I20260709 13:19:19.166833  6478 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:19.262795  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.167680  6570 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.168551  6651 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.126142  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 116097us
I20260709 13:19:19.282604  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:19.170339  4213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.008s	sys 0.008s
I20260709 13:19:19.171876  6766 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.120437  6852 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:19.174137  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.174546  6775 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.175566  4144 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:19.103255  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 133038us
I20260709 13:19:19.176280  6764 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.178541  4138 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:19.223490  6622 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.150178  6472 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.230805  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.314517  4217 raft_consensus.cc:2410] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:19.254280  4146 raft_consensus.cc:2368] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4.
I20260709 13:19:19.165112  6744 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:19.256875  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 447049us
I20260709 13:19:19.037312  6735 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.264151  4143 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:19.240893  6554 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.036s	sys 0.038s
I20260709 13:19:19.266568  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.268550  4215 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.220307  6774 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.274355  4221 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
W20260709 13:19:19.292724  4213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.009s	sys 0.008s
I20260709 13:19:19.339766  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.303109  4218 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:19.304380  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1863) took 1313 ms. Trace:
I20260709 13:19:19.340430  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:19.341140  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.286324  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:19.313181  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.341423  4292 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.316644  4261 leader_election.cc:400] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:19.318260  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.342244  4221 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:19.318499  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.321059  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.343412  4146 raft_consensus.cc:2368] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:19.343282  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.320076  4291 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:19.325155  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.327113  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:19.345196  4296 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.329072  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:19.346083  4294 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
W20260709 13:19:19.327991  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.312295  6852 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.336898  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.344477  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.340044  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 334) took 1232 ms. Trace:
I20260709 13:19:19.359131  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.358289  4213 rpcz_store.cc:276] 0709 13:19:18.107548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.109100 (+  1552us) service_pool.cc:224] Handling call
0709 13:19:18.109509 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.109776 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:18.401865 (+292089us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.339641 (+937776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.339705 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:19.339770 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.339850 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.339987 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":482429,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":48,"raft.queue_time_us":869,"thread_start_us":1210783,"threads_started":2,"wal-append.queue_time_us":912076}
W20260709 13:19:19.324553  6554 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.037s	sys 0.039s
I20260709 13:19:19.362828  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.362993  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.366230  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.393360  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.312367  6792 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.389333  4213 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:19.317291  6478 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:19.421859  6478 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:19.318802  6622 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.317274  6472 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.407364  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.389358  6774 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.320097  6744 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:19.428828  6744 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.430717  6774 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:19.430776  6874 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:19.411217  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.412269  4222 raft_consensus.cc:2410] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:19.432696  4218 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.433423  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.434329  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1960) took 1316 ms. Trace:
I20260709 13:19:19.434653  4222 rpcz_store.cc:276] 0709 13:19:18.118256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.433067 (+1314811us) service_pool.cc:224] Handling call
0709 13:19:19.434247 (+  1180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.435889  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.436686  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1962) took 1318 ms. Trace:
I20260709 13:19:19.437047  4222 rpcz_store.cc:276] 0709 13:19:18.118710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.435555 (+1316845us) service_pool.cc:224] Handling call
0709 13:19:19.436627 (+  1072us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.438140  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.438920  4222 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:19.420603  6879 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:19:19.442559  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.443460  4222 raft_consensus.cc:2410] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:19:19.439700  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 136475us
I20260709 13:19:19.444706  4261 leader_election.cc:400] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:19.445752  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 333) took 1348 ms. Trace:
I20260709 13:19:19.446020  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.446878  4140 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:19.447052  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:19.447480  6676 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.447804  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.447986  6809 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.324796  6875 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.449400  4140 raft_consensus.cc:2368] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:19.454972  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.314746  6651 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.460239  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.449797  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1973) took 1108 ms. Trace:
I20260709 13:19:19.460239  4141 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:19.460407  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.451066  4292 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:19.461652  4222 rpcz_store.cc:276] 0709 13:19:18.336008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.442269 (+1106261us) service_pool.cc:224] Handling call
0709 13:19:19.443833 (+  1564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.462191  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 338) took 1321 ms. Trace:
I20260709 13:19:19.439699  4215 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:19.446242  4216 rpcz_store.cc:276] 0709 13:19:18.097537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.098599 (+  1062us) service_pool.cc:224] Handling call
0709 13:19:18.126220 (+ 27621us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.129907 (+  3687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.129940 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.135171 (+  5231us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.439727 (+304556us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:18.638655 (+198928us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.645699 (+  7044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.645781 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.445515 (+799734us) raft_consensus.cc:1685] finished
0709 13:19:19.445536 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.445682 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235879,"prepare.queue_time_us":152729,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":7065,"raft.queue_time_us":10322,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":73241,"thread_start_us":413146,"threads_started":2,"wal-append.queue_time_us":749101}
I20260709 13:19:19.463356  4219 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:19.463706  4922 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:19.462759  4221 rpcz_store.cc:276] 0709 13:19:18.140928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.460087 (+1319159us) service_pool.cc:224] Handling call
0709 13:19:19.462122 (+  2035us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.465659  4259 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:19.457790  4218 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:19.302606  6570 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.467736  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1963) took 1348 ms. Trace:
I20260709 13:19:19.467857  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.468663  4142 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:19.438973  6857 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 13:19:19.469255  4219 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:19.478614  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1951) took 1362 ms. Trace:
I20260709 13:19:19.470680  4218 rpcz_store.cc:276] 0709 13:19:18.118957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.391359 (+1272402us) service_pool.cc:224] Handling call
0709 13:19:19.467640 (+ 76281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.341014  4287 rpcz_store.cc:276] 0709 13:19:17.990967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.843728 (+852761us) service_pool.cc:224] Handling call
0709 13:19:18.844087 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.866526 (+ 22439us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:18.867408 (+   882us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.303523 (+436115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.303612 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:19.303702 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.303870 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.304265 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":279,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":228,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":137,"thread_start_us":396423,"threads_started":1,"wal-append.queue_time_us":449426}
I20260709 13:19:19.474540  4220 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:19.407122  6554 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:19.482160  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.482050  4296 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:19.479136  4219 rpcz_store.cc:276] 0709 13:19:18.116103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.468440 (+1352337us) service_pool.cc:224] Handling call
0709 13:19:19.468824 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.478208 (+  9384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.478543 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.479502  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 241) took 1013 ms. Trace:
I20260709 13:19:19.487452  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1953) took 1370 ms. Trace:
I20260709 13:19:19.501717  4222 rpcz_store.cc:276] 0709 13:19:18.116669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.465991 (+1349322us) service_pool.cc:224] Handling call
0709 13:19:19.486155 (+ 20164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.486828 (+   673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.486871 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.486943 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:19.487012 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.487142 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.487347 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.478946  4146 raft_consensus.cc:2368] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:19.338835  6735 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:19.473335  6773 consensus_meta.cc:287] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.005s
I20260709 13:19:19.523736  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:19.477342  6842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.013s	sys 0.042s
I20260709 13:19:19.478931  6737 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:19.481619  4147 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:19.506718  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.539726  4146 raft_consensus.cc:2368] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 5.
I20260709 13:19:19.498724  4220 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:19.540611  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 337) took 1408 ms. Trace:
I20260709 13:19:19.541267  4220 rpcz_store.cc:276] 0709 13:19:18.135522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.497602 (+1362080us) service_pool.cc:224] Handling call
0709 13:19:19.498154 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.540234 (+ 42080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.540544 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.515066  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.542748  4143 raft_consensus.cc:2368] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
W20260709 13:19:19.515830  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 68845.7us
W20260709 13:19:19.517398  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 427847us
I20260709 13:19:19.523782  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 343) took 1276 ms. Trace:
I20260709 13:19:19.544132  4219 rpcz_store.cc:276] 0709 13:19:18.247947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.522661 (+1274714us) service_pool.cc:224] Handling call
0709 13:19:19.523135 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.523365 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.523398 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.523449 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:19.523492 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.523554 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.523699 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.502622  4144 rpcz_store.cc:276] 0709 13:19:18.466256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.526425 (+ 60169us) service_pool.cc:224] Handling call
0709 13:19:19.355415 (+828990us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b5400069354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:19.479430 (+124015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480435584}
I20260709 13:19:19.537945  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 339) took 1362 ms. Trace:
W20260709 13:19:19.514235  6734 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.000s
I20260709 13:19:19.546989  4216 rpcz_store.cc:276] 0709 13:19:18.175595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.505212 (+1329617us) service_pool.cc:224] Handling call
0709 13:19:19.537292 (+ 32080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.537535 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.537563 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.537608 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:19.537652 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.537721 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.537876 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:19.487999  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 201770us
I20260709 13:19:19.547580  4110 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:19.549961  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.511031  6795 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:19.536080  6842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.013s	sys 0.046s
I20260709 13:19:19.558159  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1970) took 1272 ms. Trace:
I20260709 13:19:19.558645  4220 rpcz_store.cc:276] 0709 13:19:18.285919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.542104 (+1256185us) service_pool.cc:224] Handling call
0709 13:19:19.557548 (+ 15444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.557747 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.557774 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.557816 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:19.557849 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.557903 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.558019 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.553714  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.552824  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:19.560325  4261 leader_election.cc:400] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 2. Current term is 3.
I20260709 13:19:19.556012  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.563067  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:19.566388  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.567409  4145 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:19.481354  6857 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:19.576125  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1648) took 1098 ms. Trace:
I20260709 13:19:19.613524  4139 rpcz_store.cc:276] 0709 13:19:18.482661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.579795 (+ 97134us) service_pool.cc:224] Handling call
0709 13:19:18.610113 (+ 30318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.010969 (+400856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.011017 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.024141 (+ 13124us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.466793 (+442652us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:19.478740 (+ 11947us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.479005 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.479100 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.575887 (+ 96787us) raft_consensus.cc:1685] finished
0709 13:19:19.575909 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.576055 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15424,"prepare.run_wall_time_us":17580,"raft.queue_time_us":75965,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":139,"spinlock_wait_cycles":63258112,"thread_start_us":744841,"threads_started":2,"wal-append.queue_time_us":473613}
I20260709 13:19:19.615339  6857 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:19.533460  6773 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.616509  4295 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:19.618990  6773 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.555550  6737 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:19.625361  6744 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:19.625718  6737 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:19.629534  6744 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:19.588593  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.632087  4145 raft_consensus.cc:2368] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:19.633467  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.635352  4145 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:19.642038  6641 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:19.644601  6765 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:19.645408  6765 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.649338  4217 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:19.594790  6868 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:19.594933  6852 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:19.595528  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.596149  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.661058  4143 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:19.560393  6530 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.598145  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:19.600664  6472 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:19.602594  4142 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:19.612036  6570 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.555467  6795 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.615937  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.593771  6651 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:19.662629  4143 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 5. Ops: []
I20260709 13:19:19.644220  6641 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:19.665346  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67273.9us
I20260709 13:19:19.692000  4213 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:19.666529  6878 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:19.694625  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:19.684707  4138 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:19.596992  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53081.3us
I20260709 13:19:19.687132  4145 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:19.687964  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.667017  6868 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:19.706066  6884 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:19:19.709529  4287 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:19.712177  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1651) took 1112 ms. Trace:
I20260709 13:19:19.712827  4141 rpcz_store.cc:276] 0709 13:19:18.600038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.649530 (+ 49492us) service_pool.cc:224] Handling call
0709 13:19:19.711997 (+1062467us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400286c54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:19.712117 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124799744}
I20260709 13:19:19.683019  6795 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.715030  4922 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:19.719120  6472 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:19.720148  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.720714  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.720535  6878 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:19.721333  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.721972  6878 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.755453  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.757148  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.760025  4287 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:19:19.761026  4187 leader_election.cc:336] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 3.139s (SENT)
I20260709 13:19:19.761739  4221 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:19.762145  4221 pending_rounds.cc:85] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 4
I20260709 13:19:19.762394  4221 pending_rounds.cc:107] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:19.762615  4221 raft_consensus.cc:2889] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.765583  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:19.766386  4214 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:19.767526  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.769318  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.773000  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:19.777433  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.779419  4221 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.693209  6554 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:19.780320  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.953516  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:19.845532  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 384944us
I20260709 13:19:19.957316  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:19.965948  4214 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:19.781881  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:19.968405  4296 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.819022  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.833427  4222 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:19.970593  4928 raft_consensus.cc:2410] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:19.908983  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1701) took 1228 ms. Trace:
I20260709 13:19:19.968449  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:19.959569  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 285573us
I20260709 13:19:19.910370  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 317) took 1828 ms. Trace:
I20260709 13:19:19.960192  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.972759  4295 rpcz_store.cc:276] 0709 13:19:18.081849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.866100 (+784251us) service_pool.cc:224] Handling call
0709 13:19:18.866353 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.617134 (+750781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.909780 (+292646us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540042b8d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:19.910156 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724540288}
I20260709 13:19:19.974028  4141 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:19.971586  4217 rpcz_store.cc:276] 0709 13:19:18.680718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.315244 (+634526us) service_pool.cc:224] Handling call
0709 13:19:19.908622 (+593378us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54000258d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:19.908797 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490273664}
I20260709 13:19:19.907603  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:19.975409  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.976058  4217 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:19.972749  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.012679  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:20.012775  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.002569  4221 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:20.020754  4112 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:20.024932  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.025576  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.026080  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.026494  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.027297  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.820806  6610 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:20.044974  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:20.045756  4222 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:20.034969  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.035529  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:20.052415  4221 raft_consensus.cc:2368] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:20.053086  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:20.053551  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.050830  4146 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:20.055886  4296 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:20.056488  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:19.943257  6735 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:20.054335  4186 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:20.061158  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:20.061587  4221 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.058597  4140 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:20.032634  4217 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:19.881534  6765 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:20.083127  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.098419  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:19.982174  6849 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.819485  6495 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.277s
I20260709 13:19:19.881131  6810 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.184s
I20260709 13:19:20.050825  6656 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:19.760048  6773 consensus_queue.cc:1059] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.336s
I20260709 13:19:19.831892  6666 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.233s
I20260709 13:19:20.095396  6734 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:20.115638  4221 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:20.161705  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.130277  4139 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:20.058058  6651 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:20.044633  6610 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:19.907079  6868 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:20.166920  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:20.107570  6735 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:20.013113  6876 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.120s
I20260709 13:19:20.325506  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 345) took 1144 ms. Trace:
I20260709 13:19:20.743647  4213 rpcz_store.cc:276] 0709 13:19:19.180930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.406523 (+225593us) service_pool.cc:224] Handling call
0709 13:19:20.325147 (+918624us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400216e54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:20.325407 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583588608}
W20260709 13:19:20.743961  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9939074599999458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:19:20.421073  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 366780us
W20260709 13:19:20.745318  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9939074599999458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:19:20.745894  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9840074599999298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 13:19:20.746174  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:20.442538  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1954) took 2325 ms. Trace:
W20260709 13:19:20.746534  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9840074599999298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 13:19:20.748739  4218 rpcz_store.cc:276] 0709 13:19:18.116904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.479579 (+1362675us) service_pool.cc:224] Handling call
0709 13:19:19.505429 (+ 25850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.505698 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:19.967686 (+461988us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.361085 (+393399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:20.442138 (+ 81053us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:20.442201 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.442302 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.442462 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31943,"prepare.queue_time_us":765350,"raft.queue_time_us":35171,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":13801,"spinlock_wait_cycles":75183232,"thread_start_us":830267,"threads_started":3,"wal-append.queue_time_us":320675}
W20260709 13:19:20.750998  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9363074599998527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:19:20.751603  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9363074599998527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:19:20.752013  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9039074600000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:19:20.752621  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9039074600000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 13:19:20.756070  4213 raft_consensus.cc:2368] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6.
W20260709 13:19:20.298332  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 249450us
I20260709 13:19:20.779573  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:20.780833  4140 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
W20260709 13:19:20.784636  4262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.013s
W20260709 13:19:20.785322  4262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.013s
W20260709 13:19:20.785495  4215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1971) took 2452 ms (client timeout 2780 ms). Trace:
W20260709 13:19:20.785980  4215 rpcz_store.cc:269] 0709 13:19:18.305624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.561996 (+256372us) service_pool.cc:224] Handling call
0709 13:19:20.757545 (+2195549us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b5400216454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:20.757701 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529131264}
I20260709 13:19:20.787559  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:20.796665  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:20.612003  6622 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.187s	user 0.004s	sys 0.012s
I20260709 13:19:20.858443  4213 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:20.858685  6622 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:20.167899  6656 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:20.864027  6656 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:20.613168  6795 consensus_meta.cc:287] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.899s	user 0.013s	sys 0.002s
I20260709 13:19:20.841107  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:20.772277  6744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.007s	sys 0.008s
W20260709 13:19:20.866802  6744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.009s	sys 0.008s
W20260709 13:19:20.744740  6641 consensus_meta.cc:287] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.051s	user 0.015s	sys 0.001s
I20260709 13:19:20.866215  6795 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:20.864391  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.870417  4213 raft_consensus.cc:2368] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:20.871775  6795 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:20.179001  6849 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:20.881762  6849 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:20.882114  6892 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.317s	user 0.000s	sys 0.003s
I20260709 13:19:20.872855  4144 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:20.884737  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1972) took 2559 ms. Trace:
I20260709 13:19:20.885434  4219 rpcz_store.cc:276] 0709 13:19:18.325553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.545130 (+1219577us) service_pool.cc:224] Handling call
0709 13:19:19.545524 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.545934 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.545965 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.546485 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.049949 (+503464us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:20.050000 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.050210 (+   210us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.881214 (+831004us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:20.884207 (+  2993us) raft_consensus.cc:1685] finished
0709 13:19:20.884242 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.884631 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":307,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":7808,"spinlock_wait_cycles":55813504,"thread_start_us":477699,"threads_started":1,"wal-append.queue_time_us":824485}
I20260709 13:19:20.889119  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:20.890636  6897 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.596s	user 0.005s	sys 0.009s
I20260709 13:19:20.206388  6610 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.203934  6765 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.874867  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:20.941149  4218 raft_consensus.cc:2368] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:20.875753  6622 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:20.494568  6894 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:19:20.886982  4144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1667) took 1695 ms (client timeout 2246 ms). Trace:
W20260709 13:19:20.964066  4144 rpcz_store.cc:269] 0709 13:19:19.191733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.551253 (+359520us) service_pool.cc:224] Handling call
0709 13:19:20.886620 (+1335367us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400287154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:20.886880 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3015330048}
I20260709 13:19:20.158596  6812 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.686s
I20260709 13:19:20.270182  6570 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.896723  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.873488  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.972842  4213 raft_consensus.cc:2368] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:20.972986  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:20.973878  4140 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:20.980206  6570 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:20.984129  6570 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:20.985978  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:20.986896  4213 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.742776  6735 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.271309  6734 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:20.478529  6852 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:20.757571  6876 consensus_queue.cc:1243] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:21.016424  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.755807  6737 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:21.004601  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:20.967478  4220 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 2.
I20260709 13:19:20.986827  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:21.021333  4218 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:21.021719  4922 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:21.021884  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:21.020613  4219 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:21.022629  4146 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.015702  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:21.023272  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:21.023969  4219 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:21.024464  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1707) took 1009 ms. Trace:
I20260709 13:19:21.024760  4219 rpcz_store.cc:276] 0709 13:19:20.014956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.023016 (+1008060us) service_pool.cc:224] Handling call
0709 13:19:21.024401 (+  1385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.026418  4144 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:21.038045  4113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.002s	sys 0.006s
W20260709 13:19:21.041921  4113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.002s	sys 0.006s
I20260709 13:19:21.042421  6907 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.046679  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1986) took 1279 ms. Trace:
W20260709 13:19:20.992630  4222 consensus_meta.cc:287] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.934s	user 0.007s	sys 0.006s
I20260709 13:19:20.269704  6530 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.767s
I20260709 13:19:21.048705  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:20.894155  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 95008.9us
I20260709 13:19:20.882710  6849 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:21.017684  6620 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:20.990635  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66404.7us
I20260709 13:19:21.049572  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:21.044970  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.049793  4222 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:21.067546  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 348) took 1078 ms. Trace:
I20260709 13:19:21.067930  4222 rpcz_store.cc:276] 0709 13:19:19.989434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.005236 (+ 15802us) service_pool.cc:224] Handling call
0709 13:19:21.067475 (+1062239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.049453  4219 rpcz_store.cc:276] 0709 13:19:19.767429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.025444 (+1258015us) service_pool.cc:224] Handling call
0709 13:19:21.025762 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.025981 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:21.026343 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.046261 (+ 19918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.046322 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:21.046397 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.046468 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.046615 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11158,"prepare.queue_time_us":224,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"spinlock_wait_cycles":19840,"thread_start_us":8157,"threads_started":1}
I20260709 13:19:21.069891  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 350) took 1050 ms. Trace:
I20260709 13:19:21.038924  6651 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.070277  4219 rpcz_store.cc:276] 0709 13:19:20.019342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.069000 (+1049658us) service_pool.cc:224] Handling call
0709 13:19:21.069347 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.069545 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.069571 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.069618 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:21.069661 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.069712 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.069831 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.071841  4219 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:21.072502  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:21.004849  6641 consensus_queue.cc:1059] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:19:21.057407  4146 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:21.057984  4140 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:21.059154  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1980) took 1293 ms. Trace:
I20260709 13:19:21.061865  4922 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:20.971606  6765 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.005008  6735 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.063417  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:21.077287  4214 rpcz_store.cc:276] 0709 13:19:19.765509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.979223 (+213714us) service_pool.cc:224] Handling call
0709 13:19:19.979623 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.980081 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.980111 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.980726 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.552329 (+571603us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:21.018095 (+465766us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.048588 (+ 30493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.050636 (+  2048us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.058355 (+  7719us) raft_consensus.cc:1685] finished
0709 13:19:21.058376 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.058915 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26368,"prepare.queue_time_us":314764,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":343,"raft.queue_time_us":28537,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":38624,"thread_start_us":884097,"threads_started":2,"wal-append.queue_time_us":936915}
I20260709 13:19:21.084859  4146 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:21.085264  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:21.090864  4141 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:21.045969  6570 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:21.094762  4222 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:19:21.096547  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8625074599999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:19:21.098506  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 347) took 1132 ms. Trace:
I20260709 13:19:21.085333  6651 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:21.099005  4222 rpcz_store.cc:276] 0709 13:19:19.966278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.068703 (+1102425us) service_pool.cc:224] Handling call
0709 13:19:21.092019 (+ 23316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.098166 (+  6147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.098424 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.099644  6495 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:21.100306  6495 raft_consensus.cc:697] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:21.101342  6495 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:21.063360  6907 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:21.017213  6903 consensus_queue.cc:1059] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:19:21.115352  4215 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:21.105643  4144 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:21.046756  6737 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:21.108820  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:21.063714  6875 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:21.098439  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8625074599999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:19:21.114250  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:21.122560  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8148074599998836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 13:19:21.104652  6907 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:21.122875  4139 raft_consensus.cc:2368] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:21.104526  6912 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:21.122725  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:21.123313  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8148074599998836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:19:21.135154  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8031074599998647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
I20260709 13:19:21.135358  4141 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:21.127785  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:21.099678  6901 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:19:21.136636  4144 raft_consensus.cc:2393] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:21.135687  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8031074599998647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:19:21.158910  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7383074599999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:19:21.159255  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7383074599999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:19:21.159523  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7194074599999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:19:21.159801  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7194074599999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:19:21.160059  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7014074599999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:19:21.160398  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7014074599999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:19:21.160784  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6996074599999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:19:21.161123  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6996074599999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:19:21.161381  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6951074599999174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 13:19:21.112509  6734 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.080090  6910 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:21.074295  6849 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:21.177151  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.177706  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.161665  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6951074599999174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 13:19:21.178287  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6717074599998796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:19:21.178656  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6717074599998796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:19:21.178997  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6465074599998388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:19:21.179256  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6465074599998388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:19:21.179517  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6456074599998374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
W20260709 13:19:21.179780  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6456074599998374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 13:19:21.163342  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:21.179713  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1713) took 1157 ms. Trace:
I20260709 13:19:21.180796  4144 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:21.180616  4215 rpcz_store.cc:276] 0709 13:19:20.025274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.787264 (+761990us) service_pool.cc:224] Handling call
0709 13:19:21.179459 (+392195us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54002efc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:21.179646 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":751832448}
W20260709 13:19:21.155809  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 89204.4us
W20260709 13:19:21.193250  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.202095  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:19:21.256633  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6267074599998068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:19:21.257345  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6240074600000298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:19:21.257742  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5844074599999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 13:19:21.258139  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5727074599999469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:19:21.258513  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5601074599999265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 13:19:21.258975  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5583074599999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:19:21.259414  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5583074599999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:19:21.260026  4261 connection.cc:256] RPC call timeout handler was delayed by -1.509707459999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 13:19:21.260507  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4890074599998115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:19:21.261001  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4890074599998115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:19:21.261431  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4647074599999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 13:19:21.261897  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4521074599999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:19:21.262339  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4440074599999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:19:21.262861  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4440074599999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:19:21.263859  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3810074599998643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:19:21.265378  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2523074599998836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23670000000000002s for a response
I20260709 13:19:21.270714  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:21.308115  6876 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:21.317425  6876 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:21.321566  6876 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:21.327702  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:21.328974  4144 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
W20260709 13:19:21.342897  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.331139  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:21.112494  6570 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:21.350545  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 148594us
I20260709 13:19:21.358289  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:21.364511  4187 leader_election.cc:336] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.726s (SENT)
I20260709 13:19:21.365041  4187 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:21.413444  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 142802us
I20260709 13:19:21.414983  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.129964  6899 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.233s
I20260709 13:19:21.181116  6907 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:21.414634  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51338.8us
I20260709 13:19:21.193337  6914 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.209477  6530 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:21.417135  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:21.420861  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:21.436421  4295 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:21.423086  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:21.438285  4141 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:21.419816  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55342.8us
I20260709 13:19:21.429472  4294 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:21.430542  4291 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:21.431386  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.432235  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:21.157151  6875 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.443427  4218 raft_consensus.cc:2410] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:21.445454  4290 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:21.424474  4112 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:21.447873  4892 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:21.449281  4296 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:21.450722  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 268046us
I20260709 13:19:21.437463  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.413233  6902 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:21.353241  6876 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:21.459208  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.468220  4294 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.171936  6912 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.424635  6773 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.416051  6920 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:21.417692  6852 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.420600  6900 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:21.180748  6910 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.516177  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.516924  4289 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:21.518549  4216 consensus_meta.cc:287] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.774s	user 0.007s	sys 0.003s
I20260709 13:19:21.519135  4216 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
W20260709 13:19:21.519810  4216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1706) took 1505 ms (client timeout 1637 ms). Trace:
W20260709 13:19:21.520241  4216 rpcz_store.cc:269] 0709 13:19:20.014611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.116802 (+102191us) service_pool.cc:224] Handling call
0709 13:19:21.519732 (+1402930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.522833  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:21.526189  4294 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
W20260709 13:19:21.509024  4213 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260709 13:19:21.527432  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.528332  4294 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:21.528918  6764 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.441972  6907 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.534682  6735 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.528585  6868 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:21.527982  4213 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:21.465516  6902 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:21.451527  6914 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:21.535007  6910 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:21.479259  6828 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:21.530966  6912 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:21.461022  6495 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:19:21.521462  6641 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.456878  6530 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.573662  4219 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:21.546685  6900 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:21.521637  6852 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.504220  6773 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.587906  4295 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:21.603957  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.581071  4215 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:21.578758  6908 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.497s	user 0.003s	sys 0.000s
I20260709 13:19:21.544111  6903 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:19:21.575003  6765 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.580832  6905 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.539088  6920 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.580953  6868 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:21.587394  6916 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.589905  6921 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.627553  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 212612us
I20260709 13:19:21.603124  6926 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:21.634647  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 182313us
I20260709 13:19:21.636909  4261 leader_election.cc:400] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:21.637338  4261 leader_election.cc:403] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.639678  4295 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:21.613931  6828 raft_consensus.cc:697] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:21.642999  4261 leader_election.cc:400] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:21.650935  4261 leader_election.cc:403] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.615609  6737 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:21.639910  4294 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:21.620262  6927 raft_consensus.cc:2764] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:19:21.653357  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.664230  4294 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:21.664314  6907 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:21.643668  6912 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:21.662290  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:19:21.664745  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 240392us
I20260709 13:19:21.654362  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.685269  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.685791  4186 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.686010  4294 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:21.690284  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 223603us
I20260709 13:19:21.622413  6928 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:19:21.694743  4217 pending_rounds.cc:85] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 3
I20260709 13:19:21.694988  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.699172  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:21.628423  6905 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.652225  6570 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.696923  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:21.699960  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:21.699998  4217 pending_rounds.cc:107] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:21.703361  4217 raft_consensus.cc:2889] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:21.632725  6916 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.659657  6931 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:21.696424  6620 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.714841  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:19:21.711511  4111 connection.cc:256] RPC call timeout handler was delayed by -2.8115264349999052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2344s for a response
W20260709 13:19:21.719044  4111 connection.cc:256] RPC call timeout handler was delayed by -1.293054317999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2521s for a response
W20260709 13:19:21.719369  4111 connection.cc:256] RPC call timeout handler was delayed by -1.2012543179998829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26230000000000003s for a response
I20260709 13:19:21.695752  6875 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.697954  6907 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.660420  6926 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:21.662930  6903 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:19:21.695461  6849 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:21.719648  4111 connection.cc:256] RPC call timeout handler was delayed by -1.0599543179998818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27799999999999997s for a response
I20260709 13:19:21.720654  4110 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:21.714098  6931 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:21.719626  4294 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:21.641010  6921 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.757750  6916 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:21.708230  6927 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:21.629858  6902 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.727382  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.715883  6930 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.729101  6773 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.730226  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:21.701642  6868 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:21.734472  6917 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:21.737955  6754 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.739138  4289 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
W20260709 13:19:21.747006  6610 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.000s
I20260709 13:19:21.742130  6933 raft_consensus.cc:3055] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:21.742921  6828 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:21.780615  6931 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.782240  6931 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.764147  6735 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.775388  4289 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:21.774567  6620 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:21.784813  6852 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.723630  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:21.762856  6570 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.708248  6900 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.709131  6936 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.745606  6905 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.758632  6927 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:21.760417  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:21.807380  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47058us
W20260709 13:19:21.762179  6922 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.101s	user 0.001s	sys 0.001s
W20260709 13:19:21.764303  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 68871.4us
I20260709 13:19:21.765444  6945 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.765965  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:21.767561  6916 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:19:21.771833  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 45168.3us
I20260709 13:19:21.746100  6920 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.746335  6907 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:21.830696  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64837.5us
W20260709 13:19:21.831632  6923 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.327s	user 0.001s	sys 0.002s
I20260709 13:19:21.831828  6905 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.832386  6916 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:21.833415  6916 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.776142  4216 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:19:21.785518  6620 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.793339  6942 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.793738  6903 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.808300  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:21.804014  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1978) took 2047 ms. Trace:
I20260709 13:19:21.845783  4220 rpcz_store.cc:276] 0709 13:19:19.757046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.757173 (+   127us) service_pool.cc:224] Handling call
0709 13:19:21.803765 (+2046592us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400024ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:21.803929 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288645888}
I20260709 13:19:21.817600  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.822181  4893 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:21.827147  4290 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:21.828078  4924 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:19:21.820188  6737 raft_consensus.cc:2764] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:19:21.831828  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:21.851758  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 43641.2us
I20260709 13:19:21.819284  6902 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.871688  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:21.774927  6933 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:21.842746  6530 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.850502  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:21.804003  6939 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.839956  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:21.837844  6936 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:21.854015  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.788980  6914 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:21.828198  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:21.775192  6610 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:21.889147  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:21.889448  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:21.894868  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.884028  6765 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.898661  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:21.911294  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.901964  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:21.903285  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:21.871585  6903 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.913966  6773 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.900190  6737 raft_consensus.cc:2764] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:21.917380  6914 raft_consensus.cc:2764] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:19:21.881021  6754 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:21.899930  6875 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:21.819118  6570 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.881131  6907 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:21.923244  4289 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:21.922605  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 100543us
I20260709 13:19:21.924981  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:21.950400  4261 leader_election.cc:400] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:21.950753  4261 leader_election.cc:403] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.904680  6928 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:21.953008  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:21.940478  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:21.953732  4287 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:21.940654  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:21.920230  6495 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.953832  4291 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:21.880960  6920 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:19:21.957214  6930 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:21.958315  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:21.845136  6942 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.959507  6899 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:21.927266  6913 raft_consensus.cc:2764] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:19:21.969298  4261 leader_election.cc:400] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6.
I20260709 13:19:21.969726  4261 leader_election.cc:403] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.872581  6934 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
W20260709 13:19:21.978799  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 67748us
I20260709 13:19:21.983709  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:21.985380  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:21.948870  6907 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:21.988386  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:21.934940  6765 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.966342  6737 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:21.961527  6495 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:21.971148  6926 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:21.975415  6899 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:22.103694  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:21.971078  6786 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:19:22.004009  6495 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.004623  6737 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:19:22.116044  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 127757us
I20260709 13:19:22.007992  6570 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:21.905325  6939 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:21.991317  6773 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:21.968972  6927 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:22.100757  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:21.995358  6875 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:19:21.994374  6936 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:22.107968  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 352) took 1292 ms. Trace:
I20260709 13:19:22.110522  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:22.110643  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:21.996613  6907 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.117455  4261 leader_election.cc:400] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:21.990783  6530 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.132000  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.148315  4261 leader_election.cc:403] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:22.106887  6916 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:22.153100  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:22.114562  6876 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:19:22.106019  6734 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:21.966648  6928 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:22.118180  6852 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:22.146333  4296 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:22.143671  4214 rpcz_store.cc:276] 0709 13:19:20.815611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.087959 (+272348us) service_pool.cc:224] Handling call
0709 13:19:21.088681 (+   722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.356710 (+268029us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:21.361328 (+  4618us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.615855 (+254527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.615919 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:21.615976 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.107598 (+491622us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400181854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:22.107671 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.107880 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14214,"prepare.queue_time_us":4839,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":122468,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3477,"spinlock_wait_cycles":636489984,"thread_start_us":253981,"threads_started":2,"wal-append.queue_time_us":212614}
I20260709 13:19:22.153532  6916 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:22.172158  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 54861.2us
I20260709 13:19:22.173792  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:22.153893  6913 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
W20260709 13:19:22.165920  6919 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.436s	user 0.001s	sys 0.000s
I20260709 13:19:22.156798  6762 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:22.181414  6762 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:22.171772  6956 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:22.166111  6898 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.766s	user 0.009s	sys 0.006s
I20260709 13:19:22.152714  6676 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:19:22.174594  6953 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:19:22.159709  6734 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:22.193346  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 206776us
I20260709 13:19:22.174732  6948 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:22.175733  6916 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.172238  6925 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6.
I20260709 13:19:22.182433  6762 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:22.223142  6952 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 13:19:22.224103  6905 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.223914  6903 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:22.232527  6955 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:19:22.234390  6939 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:22.214206  6911 raft_consensus.cc:3055] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:22.235019  6911 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:22.235873  6911 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:22.237243  6911 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:22.242580  6943 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.466s	user 0.004s	sys 0.000s
I20260709 13:19:22.186681  6737 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:22.243855  6924 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.710s	user 0.003s	sys 0.000s
I20260709 13:19:22.221365  6942 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:22.224541  6925 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:22.250573  6921 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:22.255167  6929 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.636s	user 0.004s	sys 0.000s
W20260709 13:19:22.290889  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 137601us
I20260709 13:19:22.302650  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:22.317086  6734 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:22.319447  6734 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.305096  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:22.322064  6928 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:22.322260  4290 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:22.318584  6899 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:22.328241  6937 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:22.328677  6737 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.343073  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 353) took 1247 ms. Trace:
I20260709 13:19:22.343743  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:22.346019  6651 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:22.345806  6907 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:22.343578  4222 rpcz_store.cc:276] 0709 13:19:21.095600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.100019 (+  4419us) service_pool.cc:224] Handling call
0709 13:19:21.107739 (+  7720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.113383 (+  5644us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:21.135340 (+ 21957us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.026929 (+891589us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b180024d6c0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a 00007fee3ececa2a
0709 13:19:22.286435 (+259506us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.288528 (+  2093us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.288972 (+   444us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:22.289084 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.289288 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.342635 (+ 53347us) raft_consensus.cc:1685] finished
0709 13:19:22.342733 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.342888 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13656,"prepare.queue_time_us":43631,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":80619,"raft.run_cpu_time_us":558,"raft.run_wall_time_us":153211,"spinlock_wait_cycles":57995008,"thread_start_us":184259,"threads_started":1,"wal-append.queue_time_us":1070507}
W20260709 13:19:22.348899  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 56550.5us
I20260709 13:19:22.352646  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:22.353925  4288 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:22.354724  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 1994) took 1154 ms. Trace:
I20260709 13:19:22.354595  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:22.355448  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:22.333976  6933 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:22.357605  4214 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:22.358124  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:22.358400  6765 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:22.359169  4923 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 1.
I20260709 13:19:22.359529  6907 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:22.361675  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 351) took 1546 ms. Trace:
I20260709 13:19:22.362413  4219 rpcz_store.cc:276] 0709 13:19:20.815252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.073464 (+258212us) service_pool.cc:224] Handling call
0709 13:19:21.573454 (+499990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.589107 (+ 15653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.360995 (+771888us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002ef750. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:22.361386 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148743936}
W20260709 13:19:22.367027  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.367712  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.369047  6899 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.429406  6936 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:22.429906  6936 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:22.430270  6936 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:22.375376  4221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1710) took 2359 ms (client timeout 1667 ms). Trace:
I20260709 13:19:22.376835  6737 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:22.377291  4218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1720) took 2300 ms (client timeout 2931 ms). Trace:
I20260709 13:19:22.434909  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:22.435252  4218 rpcz_store.cc:269] 0709 13:19:20.077006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.022074 (+945068us) service_pool.cc:224] Handling call
0709 13:19:22.376590 (+1354516us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54001f6b54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:22.377051 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865267456}
I20260709 13:19:22.379365  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:22.436375  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 69015.2us
I20260709 13:19:22.437189  4295 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:22.437325  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:22.437706  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.438648  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.438763  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:22.383596  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 1990) took 1184 ms. Trace:
I20260709 13:19:22.387573  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:22.388653  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.355465  4215 rpcz_store.cc:276] 0709 13:19:21.200078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.362227 (+162149us) service_pool.cc:224] Handling call
0709 13:19:22.353968 (+991741us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003c3cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:22.354364 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320114560}
I20260709 13:19:22.357626  6933 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.395627  4290 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:22.400044  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:22.401866  6913 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:22.403200  6760 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:22.358098  4292 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:22.406009  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:22.361630  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:22.410653  4216 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:22.411139  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:22.387862  6902 consensus_meta.cc:287] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.506s	user 0.002s	sys 0.007s
W20260709 13:19:22.396041  4187 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.853s (SENT)
I20260709 13:19:22.418081  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:22.420275  4219 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:22.423363  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:22.427294  4214 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:22.434809  6776 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:22.417589  6916 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:22.720286  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 324424us
I20260709 13:19:22.582635  4288 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:22.434645  4221 rpcz_store.cc:269] 0709 13:19:20.015825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.161242 (+145417us) service_pool.cc:224] Handling call
0709 13:19:22.374770 (+2213528us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54002f0b54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:22.375104 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4012949760}
I20260709 13:19:22.668236  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:22.588023  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49127.7us
W20260709 13:19:22.580415  4893 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.591s (SENT)
I20260709 13:19:22.720669  4213 rpcz_store.cc:276] 0709 13:19:21.198917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.574888 (+375971us) service_pool.cc:224] Handling call
0709 13:19:22.380171 (+805283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.380897 (+   726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.380930 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.381005 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:22.381235 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.381351 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.382981 (+  1630us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54001f6b50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:22.383340 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850504576}
I20260709 13:19:22.513288  4295 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:22.728503  4289 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:22.509130  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.559778  4217 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
W20260709 13:19:22.719501  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 545575us
I20260709 13:19:22.584502  4287 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
W20260709 13:19:22.508214  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.423378  6610 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:22.508540  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:22.712499  6495 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:22.735745  4922 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:22.735927  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 335587us
I20260709 13:19:22.737350  6911 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:22.740136  4295 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:22.741183  6911 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.748741  6911 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:22.743602  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 382334us
I20260709 13:19:22.756788  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:22.556000  6737 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:22.584383  6916 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:22.581250  6773 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:22.764760  6957 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:22.740576  6495 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:22.584676  6570 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:22.784577  4187 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.533s (SENT)
I20260709 13:19:22.508778  6969 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:22.800802  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 291777us
I20260709 13:19:22.801566  4295 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:22.796592  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62498.5us
I20260709 13:19:22.789019  6899 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.803339  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:22.822009  4261 leader_election.cc:400] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:22.823715  4261 leader_election.cc:400] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:22.824007  4261 leader_election.cc:403] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:22.827386  6927 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:22.829284  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:22.830499  6930 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:22.831418  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.805428  6969 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.833081  6969 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.832551  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.835711  6916 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.836077  6916 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:22.836496  6916 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.837268  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:22.583407  6764 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.812186  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:22.839737  6764 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:22.797742  6570 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:22.843891  6764 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:22.859309  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.863274  4923 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:22.858875  6570 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.851814  6916 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:22.894316  6915 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.894906  6964 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:22.902812  6964 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:22.896581  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:22.897336  6902 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:22.904953  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.867517  6936 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:22.897807  6734 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:22.903584  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 144522us
W20260709 13:19:22.908465  4187 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.623s (SENT) [suppressed 46 similar messages]
I20260709 13:19:22.909144  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 357) took 1050 ms. Trace:
I20260709 13:19:22.909641  4220 rpcz_store.cc:276] 0709 13:19:21.858674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.918140 (+ 59466us) service_pool.cc:224] Handling call
0709 13:19:21.918662 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.304604 (+385942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.304658 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.304729 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:22.304819 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.908634 (+603815us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54002f0154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:22.908686 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.908940 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885687552}
I20260709 13:19:22.910745  6911 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:22.943503  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:22.944533  4220 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:22.912563  6927 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:22.904987  6902 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:22.945986  6902 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.946112  6927 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:22.946847  6927 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:22.949038  4217 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:22.915386  6936 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:22.911978  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:22.954453  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:22.956645  6930 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:22.956802  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 392677us
I20260709 13:19:22.917819  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:22.957875  6907 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:22.958487  6907 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:22.956884  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:22.961162  6945 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:22.957273  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:22.961944  6945 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.962564  6945 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.962626  4222 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:22.912163  6737 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:22.936583  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:22.941293  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44855.2us
I20260709 13:19:22.957252  6930 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:22.961385  4214 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:22.905833  6964 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.928493  6915 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:22.917970  6764 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:22.993467  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:22.949047  6911 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:22.999280  6902 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.003232  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:23.005293  6795 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:23.006155  6610 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:23.006932  6936 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.959728  6907 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:23.008500  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 104131us
I20260709 13:19:23.011674  6735 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:23.011416  6570 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:22.991624  6927 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:23.028350  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.965579  6737 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:23.055509  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 52417.4us
I20260709 13:19:23.065514  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:23.066466  6927 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.105947  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:23.067441  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:23.054777  6735 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:23.116242  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58641.9us
I20260709 13:19:23.063787  6737 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:23.121742  6916 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:23.059597  6764 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:23.137352  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:23.120502  6735 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:23.133124  6933 consensus_meta.cc:287] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.008s
W20260709 13:19:23.152577  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.771s (SENT)
I20260709 13:19:23.134382  6937 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:23.155369  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 246916us
I20260709 13:19:23.158772  6911 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:23.159525  6911 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.160029  6911 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.115751  6936 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.161158  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:23.162153  6937 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.186745  6933 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:23.208585  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 147417us
W20260709 13:19:23.211274  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 144246us
W20260709 13:19:23.211995  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 156784us
I20260709 13:19:23.185868  6937 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:23.277655  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59683.2us
I20260709 13:19:23.220329  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:23.309599  6952 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:23.309547  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:23.312435  6905 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:23.312762  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 100820us
I20260709 13:19:23.313027  6786 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:23.312995  6734 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:23.314653  6734 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.314013  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:23.315208  6610 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:23.315208  6734 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.302881  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.316362  6610 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:23.332206  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 186763us
I20260709 13:19:23.322453  6905 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.185214  6930 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.337772  6610 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.330119  6915 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:23.352396  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.341763  6902 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:23.367755  4187 connection.cc:256] RPC call timeout handler was delayed by -1.3043380149999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260709 13:19:23.372212  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:23.380518  6641 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:23.313074  6900 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.205s
I20260709 13:19:23.394080  6936 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.403359  6570 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.348217  6905 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:23.413820  4893 leader_election.cc:336] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.793s (SENT)
I20260709 13:19:23.346029  6916 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:23.302201  6554 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.278s
W20260709 13:19:23.428910  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 57613.6us
W20260709 13:19:23.431926  4261 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.951s (SENT)
I20260709 13:19:23.439635  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:23.417789  6933 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:23.431599  6969 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.006s
I20260709 13:19:23.425791  6913 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.452674  4187 leader_election.cc:336] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.661s (SENT)
I20260709 13:19:23.315101  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:23.355404  6764 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.462503  4187 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:23.476783  6980 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:19:23.473239  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1903) took 1545 ms. Trace:
I20260709 13:19:23.488958  6620 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:23.492286  6620 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.492798  6620 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.493330  6913 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.495900  6913 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:23.497027  6981 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:19:23.498384  6912 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:23.499051  6983 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:19:23.504815  4213 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:23.505393  6945 consensus_meta.cc:287] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 13:19:23.505822  6945 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:23.507824  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.508165  4289 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:23.508791  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:23.509124  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 74605.6us
I20260709 13:19:23.457051  6969 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:23.497040  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 139564us
W20260709 13:19:23.512902  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 207120us
I20260709 13:19:23.478466  4287 rpcz_store.cc:276] 0709 13:19:21.927689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.761881 (+834192us) service_pool.cc:224] Handling call
0709 13:19:22.829155 (+ 67274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.830235 (+  1080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.830288 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.831344 (+  1056us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.168093 (+336749us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:23.168176 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.168374 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.472893 (+304519us) raft_consensus.cc:1685] finished
0709 13:19:23.472930 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.473150 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":289,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":331091,"threads_started":1,"wal-append.queue_time_us":355037}
I20260709 13:19:23.513314  6570 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.508227  6945 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:23.457634  6916 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:23.534391  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.539549  4220 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:23.535683  4213 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.525785  6902 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.535256  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.543524  4221 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:23.512061  6906 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:23.550971  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1900) took 1649 ms. Trace:
I20260709 13:19:23.518144  6936 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.551457  4293 rpcz_store.cc:276] 0709 13:19:21.901197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.589975 (+688778us) service_pool.cc:224] Handling call
0709 13:19:22.755797 (+165822us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.822535 (+ 66738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.822612 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.823835 (+  1223us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.115110 (+291275us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:23.115158 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.115248 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.550716 (+435468us) raft_consensus.cc:1685] finished
0709 13:19:23.550745 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.550901 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3015,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":1801,"thread_start_us":290604,"threads_started":1,"wal-append.queue_time_us":453495}
I20260709 13:19:23.557296  6906 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:23.548688  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:23.575171  6902 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:23.609133  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:23.616115  4922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 394) took 1166 ms. Trace:
W20260709 13:19:23.576265  6964 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.006s
I20260709 13:19:23.618744  4213 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 3: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:23.609123  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.626436  4214 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:23.616669  4922 rpcz_store.cc:276] 0709 13:19:22.438877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.439655 (+   778us) service_pool.cc:224] Handling call
0709 13:19:22.440156 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.736261 (+296105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.601580 (+865319us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54006d5454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:23.605441 (+  3861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678972160}
I20260709 13:19:23.544023  6786 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:19:23.604019  4923 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:23.597800  6906 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:23.575912  6936 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.643453  6766 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:19:23.645063  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:23.645292  6766 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:23.645998  6936 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.553206  6641 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:19:23.645900  6766 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:23.647109  6795 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.648149  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:23.649606  6915 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:23.650012  6915 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.650358  6915 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:23.652532  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 229642us
I20260709 13:19:23.652776  6812 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.653434  4261 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.954s (SENT)
I20260709 13:19:23.653326  6812 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:23.653910  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:23.657280  6795 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:23.656003  6554 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:19:23.658290  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.659132  6554 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:23.659487  4222 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.643631  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:23.661926  6902 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:23.662843  6991 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:23.664162  6991 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:23.664610  6991 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:23.665401  6927 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.004s
I20260709 13:19:23.665628  6991 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.666960  6927 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:23.669353  6969 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.669672  6902 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:23.670111  6902 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:23.670421  6995 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.671030  6995 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:23.671205  6902 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.668154  6936 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.672917  6936 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:23.601433  6899 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:23.675592  6936 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:23.678339  6916 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:23.667484  6991 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.682533  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.683163  4221 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:23.683506  4222 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
W20260709 13:19:23.636274  6985 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.081s	user 0.004s	sys 0.000s
W20260709 13:19:23.685148  6737 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.007s
I20260709 13:19:23.685578  6737 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.685909  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:23.687340  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:23.688796  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 345) took 1094 ms. Trace:
I20260709 13:19:23.689181  4295 rpcz_store.cc:276] 0709 13:19:22.594318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.853038 (+258720us) service_pool.cc:224] Handling call
0709 13:19:22.878485 (+ 25447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.898700 (+ 20215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.898727 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.899318 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.150452 (+251134us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:23.151442 (+   990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.151522 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.688573 (+537051us) raft_consensus.cc:1685] finished
0709 13:19:23.688593 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.688731 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1550,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":7898,"thread_start_us":250600,"threads_started":1,"wal-append.queue_time_us":637873}
I20260709 13:19:23.697080  6900 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:19:23.705204  6620 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:23.693002  6735 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.001s
I20260709 13:19:23.659632  6554 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:23.720875  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:23.693858  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:23.692750  6795 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:23.601653  6933 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.703467  6773 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:23.720288  6812 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.735291  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:23.736531  6762 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.012s	sys 0.007s
I20260709 13:19:23.736860  4214 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 13:19:23.737044  6762 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.012s	sys 0.007s
I20260709 13:19:23.737637  6656 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.738993  6993 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:19:23.700634  6610 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.736552  4141 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.741839  6990 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:23.743023  6990 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:23.743340  6610 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.746731  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:23.747589  4214 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.705607  6906 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:23.738533  6656 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:19:23.750141  6995 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:23.753151  6988 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.135s	user 0.003s	sys 0.000s
I20260709 13:19:23.753505  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.743465  6990 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:23.759476  6620 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.759169  6990 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.761353  6990 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.762526  4141 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:23.765129  4144 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:23.767419  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:23.769125  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:23.769382  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:23.770169  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:23.771051  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:23.772246  4143 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:23.771082  4146 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.774351  4922 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:23.776923  6795 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.777127  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:23.777673  6795 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:23.778208  4144 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:23.779685  4140 raft_consensus.cc:2368] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 2. Current term is 3.
I20260709 13:19:23.781344  4222 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:23.785144  6554 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.786911  6554 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.772274  4142 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:23.731525  6766 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:23.701670  6937 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.767812  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:23.629576  6964 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.797199  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:23.797566  6906 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.798012  4222 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:23.798784  6964 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.800751  6927 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:23.800920  6737 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:23.802098  4217 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:23.811560  4110 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:23.799757  6734 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:23.826510  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 314552us
I20260709 13:19:23.759213  4214 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:23.792361  6773 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:23.851857  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 252259us
I20260709 13:19:23.852635  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.855513  4221 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:23.856918  6795 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:23.861831  4893 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:23.847568  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.865844  6937 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.869185  6963 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.871995  4041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 85) took 10552 ms. Trace:
I20260709 13:19:23.874682  4141 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:23.873541  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:23.850999  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:23.789491  6916 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:23.877952  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:23.806638  6656 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.881575  4215 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:23.875510  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:23.884950  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:23.801438  6927 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.724388  6905 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.896438  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:23.878360  6773 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.905529  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:23.911724  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 81102.8us
I20260709 13:19:23.725600  6735 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.914671  4110 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:23.917004  4146 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
W20260709 13:19:23.885411  6911 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.002s
I20260709 13:19:23.882861  6937 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:23.909003  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:23.923859  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:23.924870  4141 raft_consensus.cc:2376] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 5. Re-sending same reply.
I20260709 13:19:23.896103  6641 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:23.928686  4221 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:23.874373  6915 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.873406  4044 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:23.948987  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:23.897094  6764 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:19:23.920303  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:23.955072  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 283710us
I20260709 13:19:23.960124  6902 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:23.960938  6622 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:23.933096  6656 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:23.963428  4140 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 4: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:23.938804  6964 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:23.965426  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 312011us
W20260709 13:19:23.964982  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.979503  6734 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:23.982713  6927 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:23.983821  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.961s (SENT)
I20260709 13:19:23.939288  6937 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:23.926738  6911 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:23.997515  4221 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:24.003376  4221 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:23.967937  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:24.005446  4215 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:23.965070  6945 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:19:24.010102  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:24.011503  6735 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:24.011291  6937 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.031147  4222 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:23.983224  6754 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:24.046523  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:24.047781  4217 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.050037  4295 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:24.022202  6907 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.079408  4213 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:24.058734  4219 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.950656  6641 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:24.081387  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:24.109560  6913 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.110529  6913 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.115303  6913 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:24.056615  6754 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:24.118516  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.119262  4146 raft_consensus.cc:2376] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 7. Re-sending same reply.
W20260709 13:19:24.078539  6998 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:19:24.153818  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 189942us
W20260709 13:19:24.155171  4893 leader_election.cc:336] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.076s (SENT)
I20260709 13:19:24.159493  4214 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:24.124816  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 117246us
I20260709 13:19:24.080019  6945 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:24.105127  6927 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.188694  6927 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.191723  6927 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:24.192229  4214 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:24.182008  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.199900  4143 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:24.206317  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.874743  4041 rpcz_store.cc:276] 0709 13:19:13.319820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.320146 (+   326us) service_pool.cc:224] Handling call
0709 13:19:23.871641 (+10551495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:15.086020 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:15.560215 (+474195us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:15.560301 (+    86us) write_op.cc:435] Acquired schema lock
0709 13:19:15.560328 (+    27us) tablet.cc:662] Decoding operations
0709 13:19:15.637690 (+ 77362us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:15.666239 (+ 28549us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:15.672912 (+  6673us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:19:15.776053 (+103141us) tablet.cc:701] Row locks acquired
0709 13:19:15.776106 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:19:15.776321 (+   215us) write_op.cc:270] Start()
0709 13:19:15.776514 (+   193us) write_op.cc:276] Timestamp: P: 1783603155776248 usec, L: 0
0709 13:19:15.776531 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:19:15.853912 (+ 77381us) log.cc:844] Serialized 5245 byte log entry
0709 13:19:17.682438 (+1828526us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3bbd80ac 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b
0709 13:19:18.337859 (+655421us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:19.571700 (+1233841us) op_driver.cc:464] REPLICATION: finished
0709 13:19:20.138141 (+566441us) write_op.cc:301] APPLY: starting
0709 13:19:20.138300 (+   159us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:20.138746 (+   446us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:20.138813 (+    67us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:20.842602 (+703789us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:20.999497 (+156895us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:19:21.017641 (+ 18144us) write_op.cc:312] APPLY: finished
0709 13:19:21.093068 (+ 75427us) log.cc:844] Serialized 94 byte log entry
0709 13:19:21.265165 (+172097us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:21.265371 (+   206us) write_op.cc:454] Released schema lock
0709 13:19:21.265563 (+   192us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:21.266117 (+   554us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:21.266149 (+    32us) write_op.cc:454] Released schema lock
0709 13:19:21.831003 (+564854us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
Metrics: {"mutex_wait_us":304743,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":533733,"apply.run_cpu_time_us":17121,"apply.run_wall_time_us":1131332,"num_ops":13,"prepare.queue_time_us":181278,"prepare.run_cpu_time_us":36655,"prepare.run_wall_time_us":2795652,"raft.queue_time_us":626944,"raft.run_cpu_time_us":20760,"raft.run_wall_time_us":411131,"replication_time_us":3794959,"spinlock_wait_cycles":137324288,"thread_start_us":3097361,"threads_started":5,"wal-append.queue_time_us":2190496,"wal-append.run_cpu_time_us":74439,"wal-append.run_wall_time_us":4248496}]]}
I20260709 13:19:24.176021  4141 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:24.176404  4142 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:24.177552  4187 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.668s (SENT)
I20260709 13:19:24.178582  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.178946  4145 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:24.179888  4146 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:24.180560  4044 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:24.181993  6754 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.182928  6913 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.184021  6911 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:24.169976  6945 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:24.179891  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.121332  6610 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:24.226176  4261 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.011s (SENT)
I20260709 13:19:24.233165  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:24.233822  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 56343.4us
I20260709 13:19:24.078446  7009 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
I20260709 13:19:24.078658  6907 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:24.167122  6933 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.056468  7007 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.209s
I20260709 13:19:24.245934  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:24.248502  4147 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:24.249027  4187 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.957s (SENT)
I20260709 13:19:24.251818  6915 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:24.252570  6991 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:24.258440  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 230277us
I20260709 13:19:24.271618  4221 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:24.272469  4215 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:24.270282  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:24.261497  4143 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
W20260709 13:19:24.278587  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65744.6us
I20260709 13:19:24.239639  6610 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:24.270272  4044 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 4 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:24.284472  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:24.287652  4219 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:24.288571  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:24.295853  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.295734  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:24.296471  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.297636  4893 leader_election.cc:336] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.615s (SENT)
I20260709 13:19:24.229758  6913 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:24.282426  4923 consensus_meta.cc:287] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.006s
W20260709 13:19:24.310338  4261 leader_election.cc:336] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.025s (SENT)
I20260709 13:19:24.313817  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.315267  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:24.257284  6933 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.327867  4293 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:24.309088  6937 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:19:24.329571  4291 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:24.357707  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.293601  6902 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:24.472541  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 230120us
W20260709 13:19:24.419651  6906 consensus_meta.cc:287] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.610s	user 0.013s	sys 0.000s
I20260709 13:19:24.360896  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:24.474591  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.357311  4292 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.417686  6656 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:24.484629  6656 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:24.484926  6766 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:24.485423  6766 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:24.485788  6656 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.486285  6766 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.487506  6656 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.488682  6913 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:24.471760  6554 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.004s
W20260709 13:19:24.475890  6990 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.714s	user 0.014s	sys 0.001s
I20260709 13:19:24.492617  6795 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.493258  6795 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.495735  6795 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:24.501551  6933 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:24.412827  6905 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:24.509852  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:24.412217  7007 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:24.511988  7007 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:24.514640  7007 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:24.516821  6641 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:24.482755  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:24.524577  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.416836  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:24.309808  4044 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 6 to 7, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 7 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:24.402719  4290 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:24.477890  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 175714us
I20260709 13:19:24.478590  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:24.344688  7012 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:19:24.532449  4143 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
W20260709 13:19:24.411787  7013 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:19:24.298215  6773 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:24.481588  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 191824us
I20260709 13:19:24.348946  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:24.414618  7016 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:24.484087  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.510053  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:24.558007  4295 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.524777  4140 raft_consensus.cc:2368] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
I20260709 13:19:24.304292  4923 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:24.401955  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:24.462984  4219 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:24.541904  4217 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:24.326149  6916 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:24.357297  7001 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.418598  6964 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.416987  6735 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:24.582854  6735 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:24.583371  7001 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.584618  6735 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:24.586655  7001 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:24.588238  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.883s (SENT)
I20260709 13:19:24.546747  4293 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:24.555804  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:24.590044  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.328866  6570 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.408319  6907 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:24.566187  4044 catalog_manager.cc:5697] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 2, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.568819  4222 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:24.582798  6964 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:24.559537  4187 leader_election.cc:336] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.201s (SENT)
I20260709 13:19:24.572007  4147 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:24.576841  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:24.601769  4288 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.577965  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:24.602620  4296 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.581255  6916 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:24.590342  4291 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.556105  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.604328  4146 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:19:24.594750  4294 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.595568  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:24.596563  4289 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:24.597952  4139 raft_consensus.cc:2368] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5.
I20260709 13:19:24.598380  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:24.606230  4217 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:24.351230  6945 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.595194  4923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 395) took 1055 ms. Trace:
I20260709 13:19:24.615417  4290 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:24.403199  6610 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.630952  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.638527  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.638892  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:24.639427  4291 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:24.599411  6570 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.644953  4296 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:24.653751  4261 leader_election.cc:336] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.081s (SENT)
W20260709 13:19:24.654841  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66671.8us
I20260709 13:19:24.656673  4292 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:24.657302  4217 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:24.639580  4213 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:24.667083  6916 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:24.667446  7011 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.686s	user 0.000s	sys 0.004s
I20260709 13:19:24.668891  4044 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 3 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 4 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:24.670594  4044 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:24.673074  6570 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:24.674192  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:24.674839  4287 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.623291  4923 rpcz_store.cc:276] 0709 13:19:23.533051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.541503 (+  8452us) service_pool.cc:224] Handling call
0709 13:19:24.570623 (+1029120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.661255  6945 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.685142  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.685915  4143 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:24.687119  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.688421  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.688728  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.689268  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.690579  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.690662  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:24.691411  7015 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:19:24.692788  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.693055  4140 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:19:24.693444  4144 raft_consensus.cc:2376] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:24.694305  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.694458  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:24.695015  4147 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:24.695468  4921 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:24.697813  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2020) took 1171 ms. Trace:
I20260709 13:19:24.698235  4218 rpcz_store.cc:276] 0709 13:19:23.526589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.597102 (+ 70513us) service_pool.cc:224] Handling call
0709 13:19:23.617562 (+ 20460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.883452 (+265890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.883499 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.913246 (+ 29747us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.046733 (+133487us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:24.046788 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.046869 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.697571 (+650702us) raft_consensus.cc:1685] finished
0709 13:19:24.697593 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.697737 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4876,"raft.queue_time_us":45258,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":289993,"threads_started":2,"wal-append.queue_time_us":304400}
I20260709 13:19:24.699581  6754 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:24.699892  6913 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:24.700778  7005 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:24.700631  6913 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:24.701371  7005 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:24.689397  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.703784  7005 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:24.704766  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:24.705977  6773 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:24.712163  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 95663.7us
W20260709 13:19:24.713645  4261 leader_election.cc:336] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.131s (SENT)
W20260709 13:19:24.714749  4261 leader_election.cc:336] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.145s (SENT)
I20260709 13:19:24.716747  6762 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:24.717312  6762 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:24.718282  6762 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.719431  6762 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:24.720780  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 174956us
I20260709 13:19:24.705984  4138 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:24.722390  6735 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:24.724162  4893 leader_election.cc:336] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.040s (SENT)
I20260709 13:19:24.724462  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:24.725270  4893 leader_election.cc:336] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.107s (SENT)
I20260709 13:19:24.725437  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:24.726766  6554 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:24.726815  6995 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:24.727490  6554 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:24.727581  6995 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:24.728991  6766 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.728694  6554 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.735196  4218 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:24.736876  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:24.737196  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2026) took 1080 ms. Trace:
I20260709 13:19:24.737572  4220 rpcz_store.cc:276] 0709 13:19:23.656713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.659519 (+  2806us) service_pool.cc:224] Handling call
0709 13:19:23.659933 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.909017 (+249084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.909056 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.928253 (+ 19197us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.263048 (+334795us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:24.263107 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.263193 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.690603 (+427410us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:24.736853 (+ 46250us) raft_consensus.cc:1685] finished
0709 13:19:24.736880 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.737131 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8722,"raft.queue_time_us":9693,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":32416640,"thread_start_us":507009,"threads_started":2,"wal-append.queue_time_us":510111}
I20260709 13:19:24.728694  6995 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:24.688814  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.740415  4146 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:24.741727  4893 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.225s (SENT)
I20260709 13:19:24.742093  4294 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:24.672289  4044 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 2 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 4 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.746891  4295 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:24.742832  4893 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:24.750278  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:24.752218  4291 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:24.750778  4287 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:24.760690  6913 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:24.763871  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.763978  6900 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:24.770311  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:24.771347  4294 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:24.772151  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.772809  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:24.773388  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.774257  4261 leader_election.cc:336] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.367s (SENT)
W20260709 13:19:24.775449  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.775802  4261 connection.cc:256] RPC call timeout handler was delayed by -2.8109959460000482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2741s for a response
I20260709 13:19:24.776649  4138 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:24.776208  4261 connection.cc:256] RPC call timeout handler was delayed by -2.264695945999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3348s for a response
W20260709 13:19:24.778609  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7587285530000827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 13:19:24.779018  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5877285530000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 13:19:24.779588  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4329285530000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 13:19:24.780208  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1980285530000856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.229s for a response
W20260709 13:19:24.783540  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.793677  4288 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:24.799526  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.786511  4112 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:24.805872  6900 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:24.806365  6900 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.806756  6900 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.801856  4145 raft_consensus.cc:2376] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:24.815409  4147 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:24.815712  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:24.820050  4143 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:24.817392  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:24.824879  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:24.832147  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:24.833858  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.834527  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.834895  4141 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:24.835368  4143 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:24.835891  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.836378  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.836759  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.837036  4143 raft_consensus.cc:2376] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:24.838178  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.838439  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.839576  4140 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:24.839437  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 48025us
I20260709 13:19:24.841235  4141 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:24.841269  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:24.836663  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.862394  4142 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:24.863477  4295 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:24.866706  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.818512  6902 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:19:24.867764  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.899492  4145 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:24.881829  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:24.909269  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:24.881246  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.196127  4138 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:25.053387  4143 raft_consensus.cc:2410] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:19:25.011684  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.196929  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:25.194772  4139 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:24.948756  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.198935  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.881194  4293 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
W20260709 13:19:24.898267  4187 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.504s (SENT)
W20260709 13:19:25.193127  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.203044  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 302757us
W20260709 13:19:25.201073  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.193125  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 375823us
I20260709 13:19:25.204486  4144 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:25.201735  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 399339us
I20260709 13:19:25.220659  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.223942  6913 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:25.224752  6913 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.226722  6610 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.227294  6913 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:25.227646  6610 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.230010  6795 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.230386  6610 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:25.230662  6795 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.233160  6795 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:25.233956  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:25.234654  4214 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:25.234742  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:25.235428  4217 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:25.197818  4295 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:25.202277  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:19:25.238431  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 496793us
W20260709 13:19:25.126456  7023 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:19:24.847374  6945 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:25.203912  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:25.078323  7029 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 13:19:24.862499  7001 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:25.252524  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:24.853875  7000 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:25.241122  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:24.882858  6905 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.235973  6570 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:25.251516  4220 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:24.899734  7026 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.201648  6766 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:25.258602  6762 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.537s	user 0.016s	sys 0.000s
I20260709 13:19:24.854483  6734 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.394s
W20260709 13:19:25.250195  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.847488  6964 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.261626  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:25.257216  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.268960  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:25.284046  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:25.349237  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 65328.2us
I20260709 13:19:25.261664  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:25.347496  6902 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:19:25.354013  7034 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:19:25.411803  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:25.354350  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 85456.7us
W20260709 13:19:25.355212  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.266368  7026 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:25.356781  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 95258us
I20260709 13:19:25.357360  6937 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:25.356833  6913 raft_consensus.cc:2764] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:25.265069  6905 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:25.362116  7028 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.406s	user 0.001s	sys 0.006s
I20260709 13:19:25.263506  6900 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.261878  6735 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.265892  6945 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:25.262945  7001 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:25.420950  4140 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:25.423970  7026 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.431216  6905 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:25.435537  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:25.285495  6766 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.426718  6937 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.439366  6945 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.442762  6795 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.444445  6622 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:25.487643  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 614517us
I20260709 13:19:25.447288  6735 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.474080  6937 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.500875  4139 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:25.504005  4141 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:25.504245  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 300405us
I20260709 13:19:25.505393  6570 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:25.507140  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:25.507056  6570 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.509164  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:25.509822  4928 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:25.510361  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:25.511412  7046 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:25.512006  4928 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:25.512265  7046 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:25.512423  4187 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.615s (SENT)
I20260709 13:19:25.512915  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:25.513414  7046 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:25.514533  4187 leader_election.cc:336] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.705s (SENT)
I20260709 13:19:25.515277  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:25.515580  4187 leader_election.cc:336] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.745s (SENT)
I20260709 13:19:25.513943  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:25.516383  4928 raft_consensus.cc:2376] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3. Re-sending same reply.
W20260709 13:19:25.516559  4187 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.821s (SENT)
I20260709 13:19:25.516986  4218 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:25.517475  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:25.519073  7003 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:25.519608  7003 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:25.511466  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:25.520032  7003 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:25.511826  7036 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.156s	user 0.003s	sys 0.000s
I20260709 13:19:25.480883  6945 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:25.492544  6995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.022s	sys 0.022s
I20260709 13:19:25.501277  6795 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.540248  6610 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:25.541560  6964 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:25.542289  6964 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:25.541900  6913 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:25.543484  6964 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:25.534629  6995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.023s	sys 0.023s
I20260709 13:19:25.547176  6964 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:25.550109  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:25.549901  6964 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.540779  6795 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:25.545508  7032 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:19:25.557945  7015 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:19:25.583706  4216 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:19:25.586072  7035 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:19:25.556758  6902 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:25.523641  6622 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:25.603163  6766 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:25.631847  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 120470us
I20260709 13:19:25.632884  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:25.637799  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.638581  4141 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:25.644726  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.561530  7001 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.652393  6902 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.629647  6656 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:25.660897  6656 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:25.663529  6656 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:25.665750  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:25.675729  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.678357  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.681120  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:25.681740  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 160604us
W20260709 13:19:25.682967  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50198.9us
I20260709 13:19:25.683970  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.707983  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:25.713409  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:25.714321  4213 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:25.718782  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:25.721153  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.721557  4146 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:25.721825  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 354) took 1013 ms. Trace:
I20260709 13:19:25.681002  7040 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:25.727257  4292 rpcz_store.cc:276] 0709 13:19:24.708119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.752488 (+ 44369us) service_pool.cc:224] Handling call
0709 13:19:24.752823 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.814320 (+ 61497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.814371 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.853738 (+ 39367us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.248747 (+395009us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:25.248805 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.248889 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:25.721559 (+472670us) raft_consensus.cc:1685] finished
0709 13:19:25.721583 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.721751 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19006,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":6847,"thread_start_us":306334,"threads_started":1,"wal-append.queue_time_us":512820}
W20260709 13:19:25.729509  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.693674  7044 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.678413  7026 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.740545  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.741781  4146 raft_consensus.cc:2393] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:25.739478  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:25.744102  4186 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:25.746678  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.715339  6900 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:25.725689  6964 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:25.733711  6754 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.763589  4186 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:25.756641  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 73722.6us
I20260709 13:19:25.756649  4138 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:25.733167  7045 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.776225  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.741464  7040 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:25.782665  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 110366us
W20260709 13:19:25.783471  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.750191  6734 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:25.792742  6734 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:25.793322  6622 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:25.793994  6734 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.795017  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:25.763096  7041 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:19:25.745422  6905 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:19:25.752954  7044 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:25.805846  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.806021  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.806730  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.807420  4140 raft_consensus.cc:2376] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:25.807797  7044 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:25.808574  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.809254  4140 raft_consensus.cc:2376] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4. Re-sending same reply.
I20260709 13:19:25.809707  7026 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:25.810231  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.810890  4143 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:25.817550  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.818611  4138 raft_consensus.cc:2376] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:25.775604  6964 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:25.823479  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.823324  6902 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:25.825436  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.825650  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.860177  4145 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:25.827098  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.861459  4138 raft_consensus.cc:2376] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:25.862737  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.829392  4142 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:25.776697  7045 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:25.831876  4213 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:25.834457  4143 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:25.838552  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61131.9us
I20260709 13:19:25.840554  4222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:25.867421  4222 raft_consensus.cc:606] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:25.845211  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1723) took 1009 ms. Trace:
I20260709 13:19:25.846777  6937 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.847234  7040 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:25.850703  6795 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:25.852552  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.852978  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:25.886942  4295 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.858625  6902 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:25.773910  6754 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:25.869779  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 86121us
I20260709 13:19:25.870250  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:25.868327  4139 rpcz_store.cc:276] 0709 13:19:24.836220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.237045 (+400825us) service_pool.cc:224] Handling call
0709 13:19:25.255268 (+ 18223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.501346 (+246078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.844795 (+343449us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54003976d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:25.845107 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533323520}
I20260709 13:19:25.873387  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:25.904469  4261 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.667s (SENT)
I20260709 13:19:25.904976  4293 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.880877  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.905133  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:25.906224  4143 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:25.907526  4141 raft_consensus.cc:2368] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8.
I20260709 13:19:25.890413  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:25.857411  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.908515  4145 raft_consensus.cc:2376] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:25.891678  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:25.908882  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.909826  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.867631  7051 raft_consensus.cc:2764] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:25.867784  7045 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.930205  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.933398  4143 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:25.933435  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:25.930791  4147 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:25.949785  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:25.955288  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 83884.1us
I20260709 13:19:25.965550  4291 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:25.966236  4291 pending_rounds.cc:85] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 2
I20260709 13:19:25.966549  4291 pending_rounds.cc:107] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:25.966967  4291 raft_consensus.cc:2889] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:25.969880  4294 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
W20260709 13:19:25.971077  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 94433.5us
I20260709 13:19:25.903517  6902 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:25.928233  7001 raft_consensus.cc:2764] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:25.895183  6795 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:25.993862  4142 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:26.145836  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.162508  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.194367  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.194530  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.195262  4291 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
W20260709 13:19:26.191512  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 321361us
I20260709 13:19:26.196571  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.008380  4295 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:26.041533  6754 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:26.190639  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.201894  4138 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:26.205541  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:26.207193  7051 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:26.207974  7051 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:26.209343  7051 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:26.051923  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.213995  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.217120  4291 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:26.218114  4287 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:26.218600  4295 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:26.218938  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.219847  4147 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:26.221642  4112 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:26.189548  7033 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.828s	user 0.000s	sys 0.004s
W20260709 13:19:26.140125  6945 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.006s
I20260709 13:19:26.229125  4293 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:26.230942  4291 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:19:26.233390  4287 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:26.238129  4294 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:26.027498  6620 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:26.243558  4290 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:26.243319  6620 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:26.246217  6620 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:26.247042  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.247267  6945 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:26.251482  4143 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:26.252468  7060 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:26.253255  4295 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.257727  6570 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.258718  6570 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:26.264007  4146 raft_consensus.cc:2368] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8.
I20260709 13:19:25.990881  6964 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:26.270290  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2045) took 1750 ms. Trace:
I20260709 13:19:26.270268  6734 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.272481  6734 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:26.273940  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.274878  6734 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:26.266896  6795 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:26.279296  4288 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:26.242573  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:25.952466  7003 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:26.270927  4221 rpcz_store.cc:276] 0709 13:19:24.519658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.526332 (+  6674us) service_pool.cc:224] Handling call
0709 13:19:24.526834 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.748578 (+221744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.748617 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.749649 (+  1032us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.962485 (+212836us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:24.962531 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.227547 (+265016us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540010b154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:25.227608 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.188754 (+961146us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:26.269974 (+ 81220us) raft_consensus.cc:1685] finished
0709 13:19:26.270001 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.270191 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87766,"raft.queue_time_us":75784,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":166,"spinlock_wait_cycles":420747520,"thread_start_us":187831,"threads_started":1,"wal-append.queue_time_us":517637}
W20260709 13:19:26.399596  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 120219us
I20260709 13:19:26.405294  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:26.413525  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.422441  4287 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:19:26.422605  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.281477  4293 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:26.285079  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:26.416898  4892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.056s	sys 0.099s
W20260709 13:19:26.424959  4892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.057s	sys 0.099s
W20260709 13:19:26.425428  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 521087us
I20260709 13:19:26.394362  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.112052  6916 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:26.429286  4215 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
W20260709 13:19:26.440240  4187 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.623s (SENT)
I20260709 13:19:26.475194  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.476018  4288 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:26.290381  6754 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:26.480010  4921 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:26.442441  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 215399us
I20260709 13:19:26.403551  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:26.277434  6945 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:26.319554  6620 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:26.504590  6620 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:26.322934  6899 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 13:19:26.467779  6937 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:26.502094  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 78706.7us
I20260709 13:19:26.401661  7045 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:26.323326  6554 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.429420  6913 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:26.517874  4187 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.728s (SENT)
I20260709 13:19:26.496946  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.534083  4187 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:26.506973  6620 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:26.546697  4289 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.547978  4293 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:26.509845  6754 raft_consensus.cc:697] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:26.557228  4187 leader_election.cc:336] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.057s (SENT)
I20260709 13:19:26.557816  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:26.561267  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:26.567957  4261 leader_election.cc:336] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 2.931s (SENT)
I20260709 13:19:26.568732  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:26.544282  6570 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:26.575727  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.578436  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.580394  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.581434  4287 raft_consensus.cc:2410] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:26.578989  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:26.542362  6554 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:26.541457  6913 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:26.609176  6754 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:26.610783  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53579.4us
W20260709 13:19:26.611765  4187 leader_election.cc:336] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.148s (SENT)
I20260709 13:19:26.612197  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:26.537621  6899 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:19:26.613869  6570 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:26.617246  4290 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:26.618522  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.620280  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:26.620800  4214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:26.621141  4294 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:26.621484  4214 raft_consensus.cc:606] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:26.619273  4290 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:26.612284  7045 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:26.637492  4291 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:26.639173  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:26.640059  4287 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:19:26.610857  7071 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
I20260709 13:19:26.572002  7051 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:26.647305  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.652412  4291 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:26.651357  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.657305  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.663419  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.664095  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.664949  4290 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:26.665932  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.663419  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:26.666759  4290 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:26.667657  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:26.667860  7064 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:19:26.648660  6734 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:26.669665  4291 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:26.670085  4291 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:19:26.671223  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59480.6us
W20260709 13:19:26.672014  4187 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.183s (SENT)
I20260709 13:19:26.672470  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:26.674611  4294 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:26.686439  4294 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:26.682235  4291 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:26.689062  4291 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:26.691288  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:26.694868  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 226397us
I20260709 13:19:26.703768  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.704797  4143 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:26.705456  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.706197  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.706634  4139 raft_consensus.cc:2368] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:19:26.708000  4287 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:26.708966  4292 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:26.709183  4146 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:19:26.712478  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.713268  4294 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:26.714838  4290 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:26.716702  4146 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:26.693030  7041 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.717824  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.718497  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.719136  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:26.719404  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.726290  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.726816  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.719756  4147 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:26.727828  4146 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:26.720294  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.720397  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:26.721073  4187 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.225s (SENT)
I20260709 13:19:26.729115  4145 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:26.721980  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:26.731753  4291 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:26.732118  4291 pending_rounds.cc:85] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 3
I20260709 13:19:26.732345  4291 pending_rounds.cc:107] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:26.732643  4291 raft_consensus.cc:2889] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.737977  4921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42928 (request call id 224) took 1131 ms. Trace:
W20260709 13:19:26.741510  7078 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:26.741751  7003 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:26.743528  7081 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:19:26.745734  7075 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:19:26.748302  7079 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:19:26.753301  4187 leader_election.cc:336] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.246s (SENT)
I20260709 13:19:26.729049  4138 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:26.725584  4142 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:26.738531  4921 rpcz_store.cc:276] 0709 13:19:25.606218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.606391 (+   173us) service_pool.cc:224] Handling call
0709 13:19:25.609293 (+  2902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.486810 (+877517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.737654 (+250844us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54006e0354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:26.737899 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001917184}
I20260709 13:19:26.759554  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:26.760694  4296 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:26.764843  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.780680  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:26.785393  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.781584  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:26.786707  4221 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:26.786701  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.787526  4287 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:26.787652  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:26.789444  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.790201  4219 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:26.792253  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.797910  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:26.799896  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.802428  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.802654  4142 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:26.805925  4296 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:26.806628  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:26.806942  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:26.804253  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 253590us
I20260709 13:19:26.808653  4143 raft_consensus.cc:2368] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:26.809903  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.811657  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.816311  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.816588  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.817447  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.818248  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.819235  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.816311  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.827730  4147 raft_consensus.cc:2368] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:26.827630  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.829113  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.831141  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.832906  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:26.833425  4222 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:26.780577  7083 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:26.821425  4145 raft_consensus.cc:2368] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 5.
I20260709 13:19:26.820019  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.841840  4219 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:26.834769  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.843745  4139 raft_consensus.cc:2368] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:26.834923  4144 raft_consensus.cc:2368] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:26.845639  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.846995  4294 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:26.822134  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.848582  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.849149  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.850346  4146 raft_consensus.cc:2368] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:26.832927  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.851145  4290 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:26.823508  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.834802  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.820325  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.853183  4217 raft_consensus.cc:2410] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:26.854228  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.813241  7041 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:26.862756  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:26.837764  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:26.863204  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 51734.7us
I20260709 13:19:26.837289  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.863983  4217 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:26.854936  4141 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:26.864400  4138 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:26.859302  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.818656  6766 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.866792  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.867271  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:26.867558  4139 raft_consensus.cc:2376] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7. Re-sending same reply.
I20260709 13:19:26.868201  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.785159  7060 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:19:26.868989  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.853159  7058 consensus_queue.cc:1059] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:26.818682  6964 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:26.872835  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:26.873121  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:26.873759  4219 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:26.871598  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.877435  4295 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:26.893597  4139 raft_consensus.cc:2376] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5. Re-sending same reply.
I20260709 13:19:26.837102  7077 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:26.895233  4222 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:26.873152  7085 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:19:26.899039  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.900961  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.918970  4213 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:26.913451  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.921160  4139 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 8.
I20260709 13:19:26.922612  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.923466  4222 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:26.818583  7059 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:19:26.923678  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:26.817904  7084 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:19:26.926767  4219 raft_consensus.cc:606] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:26.929112  4146 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:26.931303  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.932133  4146 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:26.932731  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.933475  4143 raft_consensus.cc:2368] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 8.
I20260709 13:19:26.927902  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:26.906454  4923 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:26.870322  6916 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:19:26.939702  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.941654  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.940898  6937 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.905879  7077 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:26.941617  7041 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:26.933305  6945 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.942381  6964 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:26.947273  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.976678  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.948161  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.976717  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.977957  4146 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:26.978367  4141 raft_consensus.cc:2368] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:26.949308  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:26.979159  4147 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:26.940815  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:26.950309  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.979998  4219 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:26.953917  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.953858  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.953366  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.981230  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:26.981626  4145 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:26.982024  4219 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:19:26.957866  4222 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:26.877290  6766 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:27.010887  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:27.011925  4290 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.959256  4217 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:26.959617  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:26.929991  6554 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:26.974735  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:26.948966  6762 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.023200  4140 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:26.985956  4219 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:27.040482  4287 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:27.045603  4289 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:27.046362  4289 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:26.953390  7051 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:27.049238  4222 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:26.979154  6902 consensus_meta.cc:287] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.937s	user 0.017s	sys 0.000s
I20260709 13:19:27.050863  4213 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:27.047495  4289 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:27.057740  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:27.063067  4294 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.064728  4289 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.058812  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:26.998037  7088 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:19:27.058367  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.997045  7087 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 13:19:27.054862  4187 leader_election.cc:336] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.544s (SENT)
W20260709 13:19:27.072736  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 205568us
W20260709 13:19:27.026247  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.083338  4187 leader_election.cc:336] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.598s (SENT)
I20260709 13:19:27.083976  4187 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:26.958397  7077 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:27.088265  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.057577  6762 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:27.094090  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:26.983254  6945 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:27.061211  6554 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.155871  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 217560us
I20260709 13:19:27.159140  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:27.162868  4294 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:27.094169  7060 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.095682  6570 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.069334  6902 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:27.172290  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:27.172907  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 78923.1us
I20260709 13:19:27.177028  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:27.183753  4140 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:27.171610  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:27.169598  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1573484939999616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:19:26.993121  7041 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:27.186311  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0853484940000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:19:27.212270  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 128962us
I20260709 13:19:27.208463  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:27.171980  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:27.242552  4187 leader_election.cc:336] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.636s (SENT)
I20260709 13:19:27.242702  4138 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:27.186300  4147 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:27.217490  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:27.243839  4140 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.244671  4221 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:27.245589  4216 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:27.240331  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0853484940000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:19:27.217629  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 58718.9us
I20260709 13:19:27.187171  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:27.258867  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0547484940000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 13:19:27.246066  4142 raft_consensus.cc:2368] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8.
W20260709 13:19:27.260432  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 74124.2us
W20260709 13:19:27.260649  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0547484940000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 13:19:27.181721  7046 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.284183  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:27.286484  4147 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:27.181000  7086 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.186952  7051 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.289800  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:27.291520  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:27.292160  7092 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:27.232110  7099 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:27.268962  7096 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:27.299301  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55760.2us
I20260709 13:19:27.301159  4290 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:27.304975  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:27.306962  4187 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.850s (SENT)
I20260709 13:19:27.308506  4294 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.164983  6554 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:27.315317  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:27.318068  4147 raft_consensus.cc:2376] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4. Re-sending same reply.
I20260709 13:19:27.232959  6933 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:19:27.326858  4140 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:27.329595  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:27.187153  6570 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:27.300040  4923 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:27.353144  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:27.354390  4138 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 3: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:27.354292  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 73698us
W20260709 13:19:27.351984  4187 leader_election.cc:336] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.041s (SENT)
I20260709 13:19:27.200479  7060 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:27.410471  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:27.306617  7096 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:27.416276  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:27.303314  6916 raft_consensus.cc:2764] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:27.180671  6964 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:27.414609  4187 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:27.426359  4140 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.334465  6766 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:27.427044  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.430863  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.428299  7051 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:27.427774  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75834.7us
I20260709 13:19:27.442028  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:27.442951  4290 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:27.444689  4142 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:27.445809  4147 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:27.446803  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 148687us
I20260709 13:19:27.446930  4138 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.422766  7096 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:27.452060  4187 leader_election.cc:336] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.049s (SENT)
I20260709 13:19:27.492871  4140 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:27.527933  4140 pending_rounds.cc:85] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 3
I20260709 13:19:27.528515  4140 pending_rounds.cc:107] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:27.528893  4140 raft_consensus.cc:2889] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:27.494563  7079 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:27.513571  4892 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:27.530624  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 84114.8us
W20260709 13:19:27.530709  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 121268us
I20260709 13:19:27.533586  6913 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:27.448172  6902 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:27.506786  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:27.534368  6913 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:27.544898  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 108985us
W20260709 13:19:27.576649  4187 leader_election.cc:336] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.099s (SENT)
I20260709 13:19:27.577231  4187 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:27.316478  7086 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:27.549996  6916 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:27.551755  4142 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:27.446009  6766 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:19:27.525553  6762 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:27.561069  4290 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
W20260709 13:19:27.574870  4289 consensus_meta.cc:287] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.001s
I20260709 13:19:27.578509  4147 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:27.552794  6945 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:27.575834  7064 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:19:27.582005  4142 pending_rounds.cc:85] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 2
W20260709 13:19:27.587796  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 140139us
I20260709 13:19:27.591835  4142 pending_rounds.cc:107] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:27.700515  4142 raft_consensus.cc:2889] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:27.607920  4187 leader_election.cc:336] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.113s (SENT)
I20260709 13:19:27.759230  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:27.653424  4217 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:27.587136  4296 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:27.997946  4219 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:19:27.846988  4111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.021s	sys 0.004s
W20260709 13:19:27.998939  4111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.027s	sys 0.010s
W20260709 13:19:27.999423  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 847358us
I20260709 13:19:27.633730  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:19:27.674923  4893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.005s	sys 0.022s
W20260709 13:19:28.001232  4893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.013s	sys 0.035s
I20260709 13:19:27.999423  4221 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:27.831719  4215 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:27.763267  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.004580  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.006943  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:27.997098  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 404402us
W20260709 13:19:28.013944  4187 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.218s (SENT) [suppressed 58 similar messages]
I20260709 13:19:28.016211  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 385) took 1168 ms. Trace:
I20260709 13:19:28.024322  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:28.024780  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:27.620019  7110 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:19:27.620386  7093 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 13:19:28.026533  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:27.620482  7091 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.381s	user 0.000s	sys 0.002s
W20260709 13:19:28.015233  4113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.005s	sys 0.038s
W20260709 13:19:27.616170  7103 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:19:28.017006  4218 rpcz_store.cc:276] 0709 13:19:26.847797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.925874 (+ 78077us) service_pool.cc:224] Handling call
0709 13:19:26.926229 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.926476 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:27.097196 (+170720us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.949016 (+851820us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.954455 (+  5439us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:28.015600 (+ 61145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.015693 (+    93us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.015821 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.015931 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.016128 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74152,"prepare.queue_time_us":17056,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":150104,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":200,"spinlock_wait_cycles":23404416,"thread_start_us":937977,"threads_started":4,"wal-append.queue_time_us":278443}
W20260709 13:19:27.955652  7108 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
W20260709 13:19:28.029479  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 395869us
I20260709 13:19:27.762436  6554 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:27.590500  6902 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:27.620405  7102 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:28.049664  4113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.005s	sys 0.038s
W20260709 13:19:28.065245  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.048588  4187 leader_election.cc:336] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.917s (SENT)
I20260709 13:19:27.620041  7118 raft_consensus.cc:2764] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:27.953408  7080 raft_consensus.cc:3055] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:27.956488  7058 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:27.602075  6570 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:27.620464  7100 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.058648  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:19:28.192780  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 134193us
W20260709 13:19:27.620424  7104 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.119s	user 0.004s	sys 0.000s
I20260709 13:19:27.841488  7086 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:27.845085  7122 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:28.066279  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:28.068238  4287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.020s
I20260709 13:19:28.068305  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2090) took 1339 ms. Trace:
W20260709 13:19:28.218918  4287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.008s	sys 0.020s
I20260709 13:19:27.632705  7121 consensus_queue.cc:1059] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.454s
W20260709 13:19:28.170991  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.616135  7101 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:19:28.046505  7124 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:27.616065  7109 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.615s
I20260709 13:19:28.202369  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1946) took 1391 ms. Trace:
I20260709 13:19:28.065009  7102 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.213578  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:28.188632  7050 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.219012  4216 rpcz_store.cc:276] 0709 13:19:26.730105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.730236 (+   131us) service_pool.cc:224] Handling call
0709 13:19:27.245395 (+515159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.259416 (+ 14021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.067989 (+808573us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54003c37d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:28.068227 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026152832}
I20260709 13:19:28.180675  7080 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:28.264771  7046 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:28.265605  7080 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.190303  7115 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.266646  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:28.267127  7080 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.266978  7115 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.231263  7100 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:28.257582  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 231122us
I20260709 13:19:28.270941  7100 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.271373  7124 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:28.273684  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1953) took 1008 ms. Trace:
I20260709 13:19:28.272989  7124 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.274115  4294 rpcz_store.cc:276] 0709 13:19:27.265253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.265441 (+   188us) service_pool.cc:224] Handling call
0709 13:19:27.308276 (+ 42835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.308960 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.273439 (+964479us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b5400374950. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:28.273610 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55753472}
W20260709 13:19:28.226646  7074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.064s	sys 0.141s
I20260709 13:19:28.177315  7058 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:28.207448  6766 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:28.262610  7119 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:28.191118  7129 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:19:28.263456  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1699) took 1324 ms. Trace:
I20260709 13:19:28.190392  6762 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:19:28.264008  7050 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:28.266126  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 250187us
I20260709 13:19:28.267375  4142 raft_consensus.cc:606] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.276918  7102 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.253329  4295 rpcz_store.cc:276] 0709 13:19:26.787198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.802204 (+ 15006us) service_pool.cc:224] Handling call
0709 13:19:26.838731 (+ 36527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.893893 (+ 55162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.178404 (+1284511us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b54003539d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:28.178721 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88058752}
W20260709 13:19:28.270984  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.271003  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.209494  7118 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:28.290131  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 76718.4us
I20260709 13:19:28.303400  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:28.277576  6570 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:28.282668  7096 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.726s	user 0.015s	sys 0.000s
W20260709 13:19:28.188160  7077 consensus_meta.cc:287] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.047s	user 0.011s	sys 0.002s
W20260709 13:19:28.301170  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.311460  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.311942  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.297519  6754 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.307410  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:28.297137  4144 rpcz_store.cc:276] 0709 13:19:26.938870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.000824 (+ 61954us) service_pool.cc:224] Handling call
0709 13:19:27.001406 (+   582us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:27.002100 (+   694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.002146 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:27.003429 (+  1283us) log.cc:844] Serialized 52 byte log entry
0709 13:19:27.237942 (+234513us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:27.534496 (+296554us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:27.616879 (+ 82383us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.005520 (+388641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.005642 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.263010 (+257368us) raft_consensus.cc:1685] finished
0709 13:19:28.263149 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.263356 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147025,"prepare.queue_time_us":41447,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":232452,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":27200,"spinlock_wait_cycles":41192192,"thread_start_us":570753,"threads_started":2,"wal-append.queue_time_us":285421}
I20260709 13:19:28.298763  7119 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:28.288734  7074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.065s	sys 0.142s
I20260709 13:19:28.294555  6766 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:28.170823  6554 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:19:28.318352  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:19:28.321548  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50671.8us
I20260709 13:19:28.324633  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1890) took 1705 ms. Trace:
I20260709 13:19:28.326304  4292 rpcz_store.cc:276] 0709 13:19:26.618776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.670530 (+ 51754us) service_pool.cc:224] Handling call
0709 13:19:26.708577 (+ 38047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.709447 (+   870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.324427 (+1614980us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b54003f1450. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:28.324573 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48809856}
I20260709 13:19:28.306156  6734 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:28.251194  7122 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.309634  7050 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:28.305948  7118 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:28.312180  7086 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:28.308105  7132 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.320454  7123 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:28.342589  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 308040us
W20260709 13:19:28.328236  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 283428us
I20260709 13:19:28.325587  6766 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.348124  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.317870  7128 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:28.323840  7140 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.330556  6795 consensus_queue.cc:1059] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:19:28.332072  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:28.401321  4923 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:28.403635  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:28.311929  7096 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.408823  6554 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:28.343438  7118 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.409395  6554 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.410008  6554 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:28.411293  7122 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.411532  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2086) took 1739 ms. Trace:
I20260709 13:19:28.411895  7122 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:28.322590  6754 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.327359  7127 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:28.414165  6754 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.345700  6762 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:19:28.414422  7127 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.354779  7060 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.346279  7123 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:28.397848  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:28.398028  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:28.446180  4144 raft_consensus.cc:606] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.399021  7132 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.324517  7045 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:19:28.399626  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:28.459672  4921 raft_consensus.cc:2410] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:28.343765  7086 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.332500  7058 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.311524  6570 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.313836  7077 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.361614  7128 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:28.332171  7119 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.445322  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1737) took 1655 ms. Trace:
I20260709 13:19:28.411891  4214 rpcz_store.cc:276] 0709 13:19:26.673440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.673618 (+   178us) service_pool.cc:224] Handling call
0709 13:19:26.689541 (+ 15923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.689947 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:26.917934 (+227987us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.184840 (+266906us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.185515 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.185908 (+   393us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:27.185952 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.186031 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.411304 (+1225273us) raft_consensus.cc:1685] finished
0709 13:19:28.411329 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.411472 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20540,"prepare.queue_time_us":253356,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":56047,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":17306,"thread_start_us":388774,"threads_started":2,"wal-append.queue_time_us":239424}
I20260709 13:19:28.399878  7141 consensus_queue.cc:1059] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:28.341746  6734 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:28.467800  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69849.9us
I20260709 13:19:28.474048  4213 rpcz_store.cc:276] 0709 13:19:26.789704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.926360 (+136656us) service_pool.cc:224] Handling call
0709 13:19:27.050682 (+124322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.061669 (+ 10987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.445102 (+1383433us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54002ef750. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:28.445260 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231009152}
W20260709 13:19:28.474217  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 125341us
W20260709 13:19:28.462800  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 144512us
I20260709 13:19:28.457935  6762 consensus_queue.cc:1059] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:19:28.484714  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.468761  7086 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.479120  6570 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.479602  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:28.479990  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:28.477589  7077 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.491175  4187 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:28.491991  7077 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:28.492362  7077 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:28.492743  7077 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.458031  7123 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.497493  7127 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:28.498513  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.465324  7122 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:28.555634  7122 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.474303  7131 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.480326  7141 raft_consensus.cc:3055] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:28.561064  7141 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:28.562103  7141 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.563553  7141 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.486312  6964 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.489753  7130 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:28.478413  7115 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:28.500133  7128 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.567134  7128 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:28.568284  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 220224us
I20260709 13:19:28.475955  6754 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:19:28.573463  6754 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:28.573827  6754 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:28.574708  6754 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.576067  6754 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.501256  7094 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:28.501798  6762 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:28.580646  7094 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:28.503374  7045 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:28.504431  6734 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.487828  7119 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:19:28.581918  7045 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.584061  7045 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.505857  6570 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.506814  7118 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.507308  6902 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:28.481353  7058 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.508674  7129 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:28.509541  4923 raft_consensus.cc:2410] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:28.598695  6902 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:28.513021  7109 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:28.515216  7086 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.599203  6902 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.599803  7109 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:28.600160  7109 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:28.516091  6795 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:28.601050  7109 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.601575  6795 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.602442  7109 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.516767  7127 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:28.603675  7127 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.469998  7099 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:19:28.520931  4186 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:28.608639  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 87781.2us
I20260709 13:19:28.610488  6734 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:28.611186  6734 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:28.611747  7134 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:28.612323  6734 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.614384  7131 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.615870  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:28.616786  7134 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:28.617281  6620 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:28.617640  7134 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:28.618014  7134 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:28.620826  6570 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.621399  7127 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.622093  7086 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:28.622756  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.624178  6795 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.626267  4292 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:28.626381  7134 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.627684  7134 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.628093  4292 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:28.629911  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.630522  4292 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:28.520756  6766 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.521394  6554 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.633581  6766 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.534626  7132 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:28.534870  7096 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.537181  7144 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.523075  7123 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.634583  7144 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.635540  4220 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:28.636379  7123 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:28.636633  7144 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:28.545595  7133 raft_consensus.cc:3055] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:28.537551  4261 connection.cc:256] RPC call timeout handler was delayed by -2.9025599130000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29150000000000004s for a response
I20260709 13:19:28.637225  7133 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:28.580716  6762 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:28.638355  6762 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.638401  7133 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.639663  6762 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:28.485239  7102 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.640668  7133 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:28.642203  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:28.642395  7102 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.505275  7046 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:28.642845  4923 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:28.643023  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:28.643163  7046 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.643710  4213 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:28.588840  7094 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.631832  4289 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:28.633635  6554 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:28.542649  7083 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:28.637310  4261 connection.cc:256] RPC call timeout handler was delayed by -2.7603599130000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3073s for a response
I20260709 13:19:28.645274  7046 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:28.550606  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 67999.6us
I20260709 13:19:28.646127  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:28.624534  6902 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:28.651476  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.642400  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:28.652652  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:28.653256  4287 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.653277  4217 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:28.653580  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.654955  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.656586  7083 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:28.657583  7083 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:28.658686  7083 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.659741  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:28.652092  4295 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 3.
W20260709 13:19:28.659768  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.661376  4220 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:28.664193  7046 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.664741  7046 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.665163  7046 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.666395  4295 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:28.668722  7146 consensus_queue.cc:1059] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:28.670202  7146 raft_consensus.cc:3055] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:28.670614  7146 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:28.671509  7146 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:28.672627  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5157114189998993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:19:28.673022  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5058114189998832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 13:19:28.673065  7146 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:28.673403  4261 connection.cc:256] RPC call timeout handler was delayed by -1.501311418999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 13:19:28.673714  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4581114189998061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:19:28.673956  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4311114189997625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:19:28.674201  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4257114189999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:19:28.674463  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3843114189999142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:19:28.674734  4261 connection.cc:256] RPC call timeout handler was delayed by -1.368111418999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:19:28.674973  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3474114189998545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 13:19:28.675302  4261 connection.cc:256] RPC call timeout handler was delayed by -1.336611418999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 13:19:28.675153  7046 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:28.675802  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3249114189998181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:19:28.676285  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2826114189999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:19:28.676867  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2781114189999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 13:19:28.677289  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2601114189999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:19:28.677718  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2502114189999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 13:19:28.678123  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2412114189999102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:19:28.678529  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2376114189999043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:19:28.678947  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2232114189998811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:19:28.679311  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2214114189998782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:19:28.679718  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2169114189998709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 13:19:28.680052  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2088114189998578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:19:28.664150  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 165685us
I20260709 13:19:28.548234  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:28.700023  4261 connection.cc:256] RPC call timeout handler was delayed by -1.193511418999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 13:19:28.683210  7077 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:28.702268  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1827114189998156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:19:28.702634  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1800114189998112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:19:28.702947  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1764114189998054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:19:28.703233  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1683114189997923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:19:28.703527  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1674114189997908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
W20260709 13:19:28.703812  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1377114189999702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:19:28.704098  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1152114189999338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 13:19:28.704398  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0801114189998771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:19:28.704828  4261 connection.cc:256] RPC call timeout handler was delayed by -1.010811418999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 13:19:28.705013  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.705832  4289 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:28.608414  6933 consensus_queue.cc:1175] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:28.706233  7144 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:28.707111  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.708149  6933 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.681089  4292 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:28.687077  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:28.701267  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.709087  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.709761  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:28.710251  7046 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:28.711973  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:28.700503  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 152351us
I20260709 13:19:28.712127  4041 catalog_manager.cc:5697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 9, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 9 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.680151  4287 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:28.713953  4293 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:28.714133  4044 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 160) took 11096 ms. Trace:
I20260709 13:19:28.716049  7118 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:28.693603  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.716626  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:28.741137  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:28.700429  6570 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:28.719540  4923 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:28.825050  4290 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:28.721154  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:28.824807  4922 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
W20260709 13:19:28.825372  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 97354.7us
I20260709 13:19:28.828233  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.825043  4295 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.830245  4290 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:28.831344  6754 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:28.832886  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:28.826395  4893 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:28.828708  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:28.826521  4217 raft_consensus.cc:2410] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:28.837169  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.838205  4289 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:28.838358  4290 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:28.837528  4288 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.837013  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:19:28.839828  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 138625us
I20260709 13:19:28.835850  4041 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 5, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 5 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.740917  4921 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:28.842500  4041 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 5 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:28.837543  4893 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.704284  7077 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:28.848892  4221 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:28.850823  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.844920  4041 catalog_manager.cc:5697] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 7, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 7 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.852067  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:28.852656  4214 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.852591  4041 catalog_manager.cc:5697] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 3, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:28.854095  4041 catalog_manager.cc:5697] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 10, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 10 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.890121  4041 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 7, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 7 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.849174  6899 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:28.893797  6899 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.894189  6899 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.733856  7123 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:19:28.832966  4044 rpcz_store.cc:276] 0709 13:19:17.618157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.633592 (+ 15435us) service_pool.cc:224] Handling call
0709 13:19:18.714449 (+1080857us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:28.714063 (+9999614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:25.761395 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:25.793155 (+ 31760us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:25.793219 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:19:25.793238 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:25.794381 (+  1143us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:25.794474 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:25.794503 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:19:25.795325 (+   822us) tablet.cc:701] Row locks acquired
0709 13:19:25.795377 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:19:25.795567 (+   190us) write_op.cc:270] Start()
0709 13:19:25.795732 (+   165us) write_op.cc:276] Timestamp: P: 1783603165795495 usec, L: 0
0709 13:19:25.795750 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:19:25.826199 (+ 30449us) log.cc:844] Serialized 3220 byte log entry
0709 13:19:26.508939 (+682740us) op_driver.cc:464] REPLICATION: finished
0709 13:19:26.752289 (+243350us) write_op.cc:301] APPLY: starting
0709 13:19:26.752430 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:26.752729 (+   299us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:26.753030 (+   301us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:26.955191 (+202161us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:27.004844 (+ 49653us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:19:27.004936 (+    92us) write_op.cc:312] APPLY: finished
0709 13:19:27.005420 (+   484us) log.cc:844] Serialized 64 byte log entry
0709 13:19:27.005666 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:27.005810 (+   144us) write_op.cc:454] Released schema lock
0709 13:19:27.005883 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:27.006388 (+   505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:27.006420 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":246353,"reported_tablets":24,"spinlock_wait_cycles":67865984,"child_traces":[["op",{"apply.queue_time_us":200880,"apply.run_cpu_time_us":6063,"apply.run_wall_time_us":254105,"num_ops":8,"prepare.queue_time_us":246982,"prepare.run_cpu_time_us":26231,"prepare.run_wall_time_us":236295,"raft.queue_time_us":298794,"raft.run_cpu_time_us":52387,"raft.run_wall_time_us":135565,"replication_time_us":712986,"thread_start_us":465946,"threads_started":4,"wal-append.queue_time_us":380695,"wal-append.run_cpu_time_us":51215,"wal-append.run_wall_time_us":1819200}]]}
I20260709 13:19:28.882318  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:28.884254  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:28.899019  4294 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:28.884829  4187 leader_election.cc:400] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8.
I20260709 13:19:28.880986  4295 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:28.832098  7151 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:19:28.857219  6610 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.874680  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:28.836823  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:28.883774  7128 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:28.891726  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.891885  4041 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 2 to 4, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.890822  4186 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:28.900563  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:28.904657  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:28.912011  4214 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:28.883877  7132 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:28.880491  6766 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:28.923724  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.920554  4187 connection.cc:256] RPC call timeout handler was delayed by -1.3095068929999343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 13:19:28.943565  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:28.943563  4187 connection.cc:256] RPC call timeout handler was delayed by -1.2177068929997859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:19:28.918776  4041 catalog_manager.cc:5697] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.945571  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:28.944708  4187 connection.cc:256] RPC call timeout handler was delayed by -1.1853068929999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 13:19:28.947394  4187 connection.cc:256] RPC call timeout handler was delayed by -1.0332068929999423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 13:19:28.947825  4187 connection.cc:256] RPC call timeout handler was delayed by -1.0260068929999306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:19:28.949375  4288 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:28.949316  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.948324  4041 catalog_manager.cc:5697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.952801  4186 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:28.955948  4041 catalog_manager.cc:5697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.889739  6734 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:19:28.958828  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 111716us
I20260709 13:19:28.960834  4185 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:28.964761  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:28.965214  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:28.966338  4214 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:28.916045  6933 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:28.971582  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2102) took 1318 ms. Trace:
I20260709 13:19:28.972149  4221 rpcz_store.cc:276] 0709 13:19:27.653032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.029251 (+376219us) service_pool.cc:224] Handling call
0709 13:19:28.051375 (+ 22124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.849360 (+797985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.971277 (+121917us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400216454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:28.971511 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833654144}
I20260709 13:19:28.966161  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:28.976624  4221 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:28.976939  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:28.978500  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:28.906648  7077 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:19:28.920490  6570 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.909824  7041 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:19:28.950793  7127 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:28.917936  7132 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:28.985363  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 110753us
I20260709 13:19:28.997512  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:28.947952  7128 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:28.986523  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:28.986552  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.000651  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:28.950321  7133 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:28.944680  4924 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:28.916115  6554 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:19:28.956064  7118 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.955864  7109 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.982818  4041 catalog_manager.cc:5697] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:29.022470  4041 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 7, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 7 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.958099  6620 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.994774  4214 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:28.965821  6610 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:29.001257  4146 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:29.009825  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:29.030233  4144 raft_consensus.cc:2376] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 8. Re-sending same reply.
I20260709 13:19:29.010512  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:29.031064  4138 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:28.950577  6754 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:19:28.984339  6795 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.989900  6933 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:28.986208  7074 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:28.990531  6766 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:28.958039  7129 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:19:28.960417  7130 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:19:28.994961  6570 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:28.991117  7046 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:29.035101  4147 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:29.006589  7132 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.993769  7127 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:29.035514  6795 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.083112  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:29.083918  4214 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:29.033509  4041 catalog_manager.cc:5697] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 2 to 3, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 3 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:29.043882  4893 leader_election.cc:336] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.174s (SENT)
W20260709 13:19:29.087615  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 43769.8us
I20260709 13:19:29.012200  7115 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:29.012683  7133 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.057207  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:19:29.066855  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69459us
I20260709 13:19:29.021862  7077 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:29.035485  7070 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.071369  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:29.012486  7122 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:29.032068  6620 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:29.012370  6945 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:19:29.035257  7123 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:29.040251  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.054926  7074 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:29.086547  4041 catalog_manager.cc:5697] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 2 to 4, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.098011  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:29.116864  4147 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:29.082243  6766 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:29.090431  7153 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:19:29.051218  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:29.108512  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:29.081395  7127 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:29.108889  4292 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:29.105459  7115 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:29.097062  7133 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.119856  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:29.096022  7077 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:29.106863  7070 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.121330  4041 catalog_manager.cc:5697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 3 to 6, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 6 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.156818  4041 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 8, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 8 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.109237  6620 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.090219  6795 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:29.164463  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 198342us
I20260709 13:19:29.137168  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:29.119093  7074 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:29.159726  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.167321  4144 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.160473  4041 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 8, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 8 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.171025  4041 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 2 to 4, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.119406  6610 consensus_queue.cc:1059] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:19:29.188640  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88993.7us
I20260709 13:19:29.191438  4261 leader_election.cc:400] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
W20260709 13:19:29.189361  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.189287  4041 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 8, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 8 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.150408  7123 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:29.161509  7070 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.190953  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:29.157467  7077 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:29.162091  7159 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:19:29.197383  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 87569.7us
I20260709 13:19:29.199752  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:29.200145  4219 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:29.200222  4041 catalog_manager.cc:5697] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.213726  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:29.124447  7128 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:29.229430  7158 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
W20260709 13:19:29.213802  7150 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:19:29.211203  6964 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:29.253859  4892 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:29.348645  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47168.6us
I20260709 13:19:29.229688  7131 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:29.251698  7148 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.352183  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:29.302462  4261 leader_election.cc:400] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
W20260709 13:19:29.382400  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.258090  7041 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:29.355154  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 101424us
W20260709 13:19:29.413857  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62186.8us
I20260709 13:19:29.196033  7096 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:19:29.261500  4924 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:29.350041  7094 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.432976  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:29.207015  7123 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.254637  7146 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 13:19:29.210021  6766 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.361162  7131 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:29.413640  7148 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:29.425652  7044 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:29.419932  7041 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.425299  6933 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:29.442597  6570 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:29.256965  7115 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:29.489367  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 187407us
I20260709 13:19:29.490778  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:29.477293  7044 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:29.463223  7148 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.463346  7131 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:29.478569  7083 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.819s	user 0.014s	sys 0.000s
I20260709 13:19:29.464248  6554 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:29.477543  7041 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:29.513043  4288 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:29.515552  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:29.501436  4922 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:29.465229  7129 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:19:29.526333  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 98293.8us
W20260709 13:19:29.530901  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 51234.3us
I20260709 13:19:29.503777  7144 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:29.505425  6554 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.541406  4220 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:29.547079  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:29.548153  7151 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:29.548950  4261 leader_election.cc:400] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:29.551280  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:29.552101  7151 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.552727  4261 leader_election.cc:400] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 4.
I20260709 13:19:29.553798  4261 leader_election.cc:400] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:29.554054  4261 leader_election.cc:403] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:19:29.535843  7083 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:29.538260  6905 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:29.522140  7168 consensus_queue.cc:1059] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:29.543362  6554 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.554646  7151 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5.
I20260709 13:19:29.535413  7102 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:29.581239  4144 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:29.572975  7044 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:29.561347  6905 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:29.619445  4216 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:19:29.602537  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48824.7us
I20260709 13:19:29.620594  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:29.620939  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:29.642795  4261 leader_election.cc:400] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 3. Current term is 5.
W20260709 13:19:29.626269  4187 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.531s (SENT)
I20260709 13:19:29.620059  4219 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:19:29.612056  6899 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.000s
W20260709 13:19:29.645144  4187 leader_election.cc:336] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.533s (SENT)
I20260709 13:19:29.645624  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:29.608572  6902 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.659061  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:29.620566  7169 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:29.622926  7130 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:29.651947  7168 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:29.656881  6902 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:29.623653  7070 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:29.635627  7133 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.625088  6620 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:29.686362  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.645653  6899 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:29.695218  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47857.8us
I20260709 13:19:29.696275  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:29.696578  4187 leader_election.cc:336] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.669s (SENT)
I20260709 13:19:29.628813  6795 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.687754  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:29.699820  4187 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.725s (SENT)
W20260709 13:19:29.700953  4187 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.838s (SENT)
W20260709 13:19:29.667974  7132 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.002s
I20260709 13:19:29.659883  7123 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:29.635408  6554 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.664633  6905 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.704282  6905 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.705593  6554 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:29.706056  6902 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:29.706800  7132 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:29.708225  4296 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:29.681907  7151 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:29.709223  7151 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:29.709746  7133 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:29.709695  7151 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:29.701372  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:29.709841  7070 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:29.724694  7123 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:29.725481  7123 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:29.726085  7123 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.726238  6620 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:29.738173  6899 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:29.713862  6795 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:29.748864  7045 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:29.749805  7045 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:29.751085  7045 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.752992  7140 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:29.753607  7140 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:29.754797  7140 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.681433  7130 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:29.681433  7169 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:29.801771  7151 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:29.795069  7074 consensus_meta.cc:287] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.008s
I20260709 13:19:29.761087  7169 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:29.761808  6795 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.909417  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 208478us
W20260709 13:19:29.910928  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 227641us
W20260709 13:19:29.910178  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.756315  7140 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:29.910358  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:29.911800  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:29.911183  4187 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.846s (SENT)
W20260709 13:19:29.914973  4187 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.880s (SENT)
I20260709 13:19:29.915570  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:29.916213  4291 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:29.918468  4216 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:29.920745  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.928963  4187 leader_election.cc:336] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.962s (SENT)
W20260709 13:19:29.929908  4187 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.021s (SENT)
W20260709 13:19:29.866123  7127 consensus_meta.cc:287] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.008s
I20260709 13:19:29.943673  4214 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.830193  7045 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.946805  4220 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:29.942332  4291 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:29.914688  6620 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:29.814718  7151 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:29.927466  7077 consensus_meta.cc:287] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.696s	user 0.015s	sys 0.002s
I20260709 13:19:29.921726  7132 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:29.959615  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47925.6us
I20260709 13:19:29.947337  7083 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:29.966192  7123 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.922546  6795 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.867210  7041 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:29.972530  7070 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.996641  7070 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:29.973948  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.947206  7127 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.001330  4928 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:29.980813  7130 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:29.981161  7058 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:29.867477  7131 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.913398  7074 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.957926  7077 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:29.983659  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.013020  4220 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.988464  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:29.804472  7148 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.004966  7127 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.002816  4259 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:30.009979  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49616.1us
W20260709 13:19:29.998471  7107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.010s	sys 0.010s
I20260709 13:19:30.015007  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:30.006297  7083 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.024610  7144 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.025638  4294 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:30.027767  7077 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.046758  7123 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:30.009521  7058 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:30.010792  7151 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:30.017460  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:30.022965  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:30.051712  4289 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:30.038019  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:30.039287  4222 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:30.039471  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:30.040807  7070 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:30.002236  7176 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:30.063723  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:30.034140  7107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.010s	sys 0.010s
I20260709 13:19:30.054040  4293 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:30.055392  7148 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:30.055975  6570 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:30.072970  6570 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.073418  7058 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.074615  7058 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.056646  7077 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:30.075569  7077 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.056874  7144 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:30.057406  7151 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.017972  7130 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:30.056053  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:30.070120  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50074.7us
I20260709 13:19:30.074111  6570 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.042117  7169 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.047959  7083 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:30.077101  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.077469  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:30.106524  4220 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:30.103845  4287 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.076447  7131 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:30.111358  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.113780  4261 leader_election.cc:400] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 8.
I20260709 13:19:30.077117  7070 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.102933  7130 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:30.114846  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.122538  4261 leader_election.cc:400] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 8.
I20260709 13:19:30.118237  4289 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:30.131942  4287 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:30.110790  6754 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.115803  6570 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.113144  7109 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.113221  7169 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.130265  4186 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:30.153945  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.129555  7130 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.151871  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:30.077129  7176 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.157341  4287 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:30.106666  7132 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:19:30.162626  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:30.175854  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.147678  7148 consensus_queue.cc:1059] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:19:30.128750  7070 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.182264  4220 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:30.076701  7077 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.182792  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:30.185560  4222 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:30.190893  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:30.172325  7046 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:30.198082  7046 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:30.198385  4287 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:30.198603  7046 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.199873  4287 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:30.152691  6754 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.204144  6754 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.159812  7109 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.206847  7109 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.206941  7083 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:30.186802  6795 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.161245  7196 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.186224  7182 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:30.237560  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54888.2us
I20260709 13:19:30.243157  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.244932  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:30.253850  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.254300  4214 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.255913  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:30.256598  4287 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:30.257937  7164 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.781s	user 0.000s	sys 0.004s
W20260709 13:19:30.259215  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.208154  7074 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.210394  7132 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:30.247918  7182 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.260797  7182 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.194257  7041 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:30.264525  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2118) took 1389 ms. Trace:
I20260709 13:19:30.237228  7083 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:30.265053  4217 rpcz_store.cc:276] 0709 13:19:28.874674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.874800 (+   126us) service_pool.cc:224] Handling call
0709 13:19:28.875131 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.883857 (+  8726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.883889 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.897718 (+ 13829us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.150841 (+253123us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:29.150899 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.150998 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.570919 (+419921us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b48000fe358. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:19:30.257288 (+686369us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:30.264157 (+  6869us) raft_consensus.cc:1685] finished
0709 13:19:30.264186 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.264437 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39405,"raft.queue_time_us":10021,"raft.run_cpu_time_us":4054,"raft.run_wall_time_us":681129,"spinlock_wait_cycles":74630272,"thread_start_us":175733,"threads_started":1,"wal-append.queue_time_us":534918}
I20260709 13:19:30.266058  7083 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.267508  7176 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.253683  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:30.269398  4293 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.267607  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.275748  4287 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:30.277285  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 60726.7us
I20260709 13:19:30.277900  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:30.278527  4287 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:30.278772  4261 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.104s (SENT)
I20260709 13:19:30.279248  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:30.240832  7096 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:30.238706  7189 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.172530  7144 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.305372  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:30.288551  4293 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:30.284677  7196 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:30.277981  7127 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:19:30.299567  7096 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.289876  7041 consensus_queue.cc:1059] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:19:30.300760  7070 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:30.301023  7189 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.301229  7130 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.299760  4222 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:19:30.257965  7151 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:30.332984  4222 pending_rounds.cc:85] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 4
I20260709 13:19:30.333374  4222 pending_rounds.cc:107] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:19:30.333693  4222 raft_consensus.cc:2889] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:30.325448  7046 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.310397  4214 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:30.311371  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:30.311396  4186 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:30.340588  4293 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.318825  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:30.342640  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:30.320317  4261 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.154s (SENT)
I20260709 13:19:30.322582  7096 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.344775  7127 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:30.344923  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.345578  7127 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.346371  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:30.324182  7041 raft_consensus.cc:3055] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:30.347529  4220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:30.268386  7169 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.313122  6902 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.346944  7127 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.347687  7041 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.318077  4287 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:30.355119  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:30.357053  7074 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.357720  7074 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.358804  7074 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.359349  7189 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.361086  6902 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.362421  6902 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.349259  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:30.355122  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:30.348763  4220 raft_consensus.cc:606] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:30.366065  4220 raft_consensus.cc:614] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:30.377585  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.406018  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:30.407197  4287 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:30.420943  4293 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:30.440145  4293 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:30.444048  4220 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:19:30.444937  7163 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.021s	user 0.000s	sys 0.003s
I20260709 13:19:30.446899  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2116) took 1690 ms. Trace:
I20260709 13:19:30.447453  4218 rpcz_store.cc:276] 0709 13:19:28.756192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.757169 (+   977us) service_pool.cc:224] Handling call
0709 13:19:28.846593 (+ 89424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.877903 (+ 31310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.877935 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.885940 (+  8005us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.084764 (+198824us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:29.084803 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.084865 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.444091 (+1359226us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:30.446477 (+  2386us) raft_consensus.cc:1685] finished
0709 13:19:30.446511 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.446812 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3580,"raft.queue_time_us":26035,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":13662,"spinlock_wait_cycles":149138176,"thread_start_us":137722,"threads_started":1,"wal-append.queue_time_us":302937}
I20260709 13:19:30.364149  7083 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:30.491770  7041 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.409551  7151 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:30.540468  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 220170us
W20260709 13:19:30.544171  4261 leader_election.cc:336] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.173s (SENT)
I20260709 13:19:30.555965  4186 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:30.558842  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.492574  6795 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.542145  7083 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.536687  7176 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:30.548244  7041 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:30.592732  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48626.9us
I20260709 13:19:30.555085  7148 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.492329  7182 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.582813  6570 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.583142  7181 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:30.595950  7151 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.625481  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:30.630236  4295 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:30.583045  7070 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:30.647740  4220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:30.648644  4220 raft_consensus.cc:606] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:30.649035  4220 raft_consensus.cc:614] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:30.650301  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:30.651027  4295 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.592972  7119 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:19:30.613308  7198 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.653995  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:30.593693  6795 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:30.679349  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.626044  6734 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:30.600695  7083 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.631237  6570 raft_consensus.cc:697] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:30.603418  7176 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.629823  7130 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.613651  7148 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.677541  7121 raft_consensus.cc:993] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:30.690567  4295 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:30.634241  7151 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.632007  7181 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:30.733592  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 176545us
I20260709 13:19:30.738714  7107 raft_consensus.cc:1081] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:30.741532  4294 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:30.744621  7148 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:30.746575  7146 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:30.686060  7122 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.750635  7176 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:30.752453  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:30.645218  7144 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.084s
W20260709 13:19:30.754528  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 115814us
I20260709 13:19:30.745000  6570 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:30.756844  4187 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.761s (SENT)
W20260709 13:19:30.763003  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.768374  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.738848  7167 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.381s	user 0.000s	sys 0.012s
I20260709 13:19:30.781296  7059 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:30.781580  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 268) took 1773 ms. Trace:
I20260709 13:19:30.781859  7059 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:30.686156  7198 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.782018  4143 rpcz_store.cc:276] 0709 13:19:29.007821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.007924 (+   103us) service_pool.cc:224] Handling call
0709 13:19:29.008153 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.008507 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.008531 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.008939 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.069232 (+ 60293us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:29.209217 (+139985us) log.cc:844] Serialized 14 byte log entry
0709 13:19:29.254991 (+ 45774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.255105 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.580954 (+1325849us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:30.781182 (+200228us) raft_consensus.cc:1685] finished
0709 13:19:30.781318 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.781504 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100279,"prepare.queue_time_us":375157,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":47,"raft.queue_time_us":40138,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":40122,"spinlock_wait_cycles":157272960,"thread_start_us":171709,"threads_started":2,"wal-append.queue_time_us":192401}
I20260709 13:19:30.783023  7059 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.786015  6902 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.786664  6902 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.778618  7123 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:30.788583  7123 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:19:30.789505  7170 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.311s	user 0.003s	sys 0.006s
I20260709 13:19:30.789798  7123 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:30.791353  7123 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.793911  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 270) took 1785 ms. Trace:
I20260709 13:19:30.794921  7198 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:30.803485  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:30.733184  7046 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:30.692329  6734 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:30.722054  7196 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:19:30.821281  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:30.811335  7201 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:19:30.763684  7119 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:30.770735  7148 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:30.822023  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:30.766950  7122 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.794384  4145 rpcz_store.cc:276] 0709 13:19:29.008403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.010284 (+  1881us) service_pool.cc:224] Handling call
0709 13:19:29.010685 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.020467 (+  9782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.020508 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.027749 (+  7241us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.155886 (+128137us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:29.430562 (+274676us) log.cc:844] Serialized 14 byte log entry
0709 13:19:29.446235 (+ 15673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.446321 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.788589 (+1342268us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:30.793566 (+  4977us) raft_consensus.cc:1685] finished
0709 13:19:30.793682 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.793838 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59942,"prepare.queue_time_us":375643,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3096,"raft.queue_time_us":15696,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":22098,"spinlock_wait_cycles":46068992,"thread_start_us":363362,"threads_started":2,"wal-append.queue_time_us":317370}
I20260709 13:19:30.822649  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:30.837625  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.842840  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 399010us
W20260709 13:19:30.836457  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 112370us
W20260709 13:19:30.846371  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.850921  4928 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:19:30.851902  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.853524  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:30.856269  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.859887  4214 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:19:30.863077  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:30.863822  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:30.864570  4921 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:30.856976  4215 raft_consensus.cc:2376] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6. Re-sending same reply.
I20260709 13:19:30.885315  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:30.886601  4922 raft_consensus.cc:2393] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:30.847366  7122 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.905603  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.906498  4218 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.855747  7045 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.910919  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:30.912665  4215 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:30.922479  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:30.924178  4921 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:19:31.006925  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 97767.6us
I20260709 13:19:31.007800  4291 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:31.007745  4187 leader_election.cc:336] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.858s (SENT)
I20260709 13:19:30.870714  7074 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.020285  4261 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.029s (SENT)
I20260709 13:19:31.024281  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:19:31.027326  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.009621  4187 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.880s (SENT)
W20260709 13:19:31.032599  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.045924  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:31.047338  4921 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:31.049216  7215 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:31.049497  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:30.847134  7119 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.054551  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:30.903508  7070 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.055451  4215 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
W20260709 13:19:31.032480  4187 leader_election.cc:336] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.926s (SENT)
I20260709 13:19:31.069476  4185 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:31.071537  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.074015  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.080493  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.006278  6902 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:31.119971  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.847433  7148 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.141588  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.142041  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.142620  4215 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:31.143429  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 73966.9us
I20260709 13:19:31.142962  4289 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:31.057822  7144 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:31.145197  4185 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:31.177290  4185 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:31.154852  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 86594.1us
W20260709 13:19:31.187528  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.058923  7182 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:31.135857  7207 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:19:31.008745  7045 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:31.258152  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.052145  7074 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.161415  6610 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.213826  7217 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 13:19:31.214761  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.199136  7046 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:31.233932  7176 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.236109  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:31.144431  7134 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.170560  6902 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:31.329016  4293 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:31.330114  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:31.208881  4187 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.218s (SENT)
I20260709 13:19:31.334841  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:31.270891  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 93756.7us
I20260709 13:19:31.273305  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.209201  4924 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:19:31.208132  6795 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:31.118777  7070 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:31.298069  7220 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:19:31.301239  7162 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 2.181s	user 0.018s	sys 0.019s
I20260709 13:19:31.300909  6610 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.274792  7151 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:31.245965  7083 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:31.304507  7166 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 2.006s	user 0.016s	sys 0.008s
I20260709 13:19:31.272804  7182 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:31.341012  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 388) took 2205 ms. Trace:
I20260709 13:19:31.312646  7144 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.304296  7181 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:31.344220  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2002) took 1069 ms. Trace:
I20260709 13:19:31.371591  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:31.380712  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.328810  6902 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:31.394227  6902 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.395658  7070 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:31.398270  6610 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:31.400532  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2008) took 1059 ms. Trace:
I20260709 13:19:31.402351  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 267) took 2394 ms. Trace:
I20260709 13:19:31.406225  7182 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.407405  7144 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:31.409708  7161 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 2.257s	user 0.012s	sys 0.012s
I20260709 13:19:31.411605  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2115) took 2686 ms. Trace:
I20260709 13:19:31.411994  4213 rpcz_store.cc:276] 0709 13:19:28.724786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.724913 (+   127us) service_pool.cc:224] Handling call
0709 13:19:28.750201 (+ 25288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.825446 (+ 75245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.825475 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.837628 (+ 12153us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.988614 (+150986us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:28.988650 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.988714 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.381170 (+2392456us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:31.411238 (+ 30068us) raft_consensus.cc:1685] finished
0709 13:19:31.411263 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.411516 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30532,"raft.queue_time_us":74867,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":13982,"spinlock_wait_cycles":823324288,"thread_start_us":106551,"threads_started":1,"wal-append.queue_time_us":244354}
I20260709 13:19:31.415370  7146 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.335959  7176 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.390458  4294 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:31.418929  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.419787  4294 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:31.421727  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:31.383023  4288 rpcz_store.cc:276] 0709 13:19:29.129241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.129415 (+   174us) service_pool.cc:224] Handling call
0709 13:19:29.129810 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.513811 (+384001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.334186 (+1820375us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540042b8d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:31.334498 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879940352}
I20260709 13:19:31.390112  4287 rpcz_store.cc:276] 0709 13:19:30.274793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.408180 (+133387us) service_pool.cc:224] Handling call
0709 13:19:30.412701 (+  4521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.413033 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:30.768905 (+355872us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.343803 (+574898us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.343861 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:31.343926 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.344006 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.344141 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":223526,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2757,"raft.queue_time_us":196173,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":5531,"thread_start_us":807165,"threads_started":3,"wal-append.queue_time_us":611821}
W20260709 13:19:31.416587  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.425289  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 389) took 1893 ms. Trace:
I20260709 13:19:31.426234  7176 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:31.427172  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2122) took 2414 ms. Trace:
I20260709 13:19:31.429586  4221 rpcz_store.cc:276] 0709 13:19:29.012484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.012619 (+   135us) service_pool.cc:224] Handling call
0709 13:19:29.012901 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.094468 (+ 81567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.094497 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.635996 (+541499us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b2c00010988. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:19:29.636598 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.651103 (+ 14505us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:29.651825 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.105081 (+453256us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b48000fe358. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:19:31.426675 (+1321594us) spinlock_profiling.cc:243] Waited 79.4 ms on lock 0x7b54003c5ad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:31.426757 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.426847 (+    90us) raft_consensus.cc:1685] finished
0709 13:19:31.426867 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.427084 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5093,"raft.queue_time_us":2059,"raft.run_cpu_time_us":6210,"raft.run_wall_time_us":1009351,"spinlock_wait_cycles":206184064,"thread_start_us":13925,"threads_started":1,"wal-append.queue_time_us":14638,"wal-append.run_cpu_time_us":2763,"wal-append.run_wall_time_us":1112202}
I20260709 13:19:31.425804  4296 rpcz_store.cc:276] 0709 13:19:29.532025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.532202 (+   177us) service_pool.cc:224] Handling call
0709 13:19:29.532592 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.708638 (+176046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.424701 (+1716063us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54003548d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:31.425212 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403401472}
I20260709 13:19:31.415980  7146 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.402789  4139 rpcz_store.cc:276] 0709 13:19:29.007534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.007666 (+   132us) service_pool.cc:224] Handling call
0709 13:19:29.008027 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:29.008416 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.008444 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:29.008943 (+   499us) log.cc:844] Serialized 52 byte log entry
0709 13:19:29.071429 (+ 62486us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:29.214399 (+142970us) log.cc:844] Serialized 14 byte log entry
0709 13:19:29.252364 (+ 37965us) log.cc:844] Serialized 14 byte log entry
0709 13:19:29.252542 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.252607 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.747353 (+1494746us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b180027eb00. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:19:31.303557 (+556204us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:31.402056 (+ 98499us) raft_consensus.cc:1685] finished
0709 13:19:31.402079 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.402252 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62919,"prepare.queue_time_us":702552,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":2670,"raft.queue_time_us":44920,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":351,"spinlock_wait_cycles":517762560,"thread_start_us":156414,"threads_started":2,"wal-append.queue_time_us":184974}
I20260709 13:19:31.428567  7144 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:31.439817  4218 consensus_meta.cc:287] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.004s
I20260709 13:19:31.390332  4293 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.459043  4218 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:31.335696  6620 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:31.445971  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.401247  4290 rpcz_store.cc:276] 0709 13:19:30.341265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.581662 (+240397us) service_pool.cc:224] Handling call
0709 13:19:30.582201 (+   539us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:30.596255 (+ 14054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.596289 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:30.606498 (+ 10209us) log.cc:844] Serialized 52 byte log entry
0709 13:19:30.836990 (+230492us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:30.837048 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.837188 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.400107 (+562919us) raft_consensus.cc:1685] finished
0709 13:19:31.400142 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.400404 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4938,"raft.queue_time_us":13611,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":7932,"thread_start_us":186255,"threads_started":1,"wal-append.queue_time_us":763003}
W20260709 13:19:31.443760  7041 consensus_meta.cc:287] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.002s
I20260709 13:19:31.471257  4922 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:31.340163  7134 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.438962  6734 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:31.466356  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:31.482913  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.484319  4295 raft_consensus.cc:2410] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:31.486711  4295 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:31.487720  4295 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:19:31.477043  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.479357  4294 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:31.490301  4891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.011s	sys 0.044s
W20260709 13:19:31.490655  4891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.011s	sys 0.044s
I20260709 13:19:31.499215  4293 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:31.501267  4294 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:19:31.488833  7127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.006s	sys 0.049s
I20260709 13:19:31.463428  6620 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:31.509078  4214 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:31.514654  4294 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:31.508070  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:31.536616  4294 pending_rounds.cc:85] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 3
I20260709 13:19:31.537292  4294 pending_rounds.cc:107] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:31.537727  4294 raft_consensus.cc:2889] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:31.507141  7127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.006s	sys 0.049s
W20260709 13:19:31.551519  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43571.3us
W20260709 13:19:31.559662  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 350788us
I20260709 13:19:31.547533  7168 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.569348  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.572678  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 190577us
I20260709 13:19:31.574237  4218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57a7dac49b784166afd62631b44900c8"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
W20260709 13:19:31.574469  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 225629us
I20260709 13:19:31.574941  4218 raft_consensus.cc:606] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:31.575292  4218 raft_consensus.cc:614] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:31.558435  7127 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:31.556247  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:31.559058  7045 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:31.569749  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:31.564600  7148 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:31.596299  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.585155  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.595531  4919 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:31.560695  7096 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:19:31.576231  7168 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.580652  7046 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:31.633621  4296 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:19:31.652276  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69339.1us
I20260709 13:19:31.635260  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:31.653060  4261 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.290s (SENT)
I20260709 13:19:31.640839  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:31.675817  4219 raft_consensus.cc:606] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:19:31.626451  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.597101  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:31.588641  7223 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
W20260709 13:19:31.631309  7234 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:31.673750  7046 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.679085  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.679554  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.689963  4218 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:31.679966  4221 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
W20260709 13:19:31.680888  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83869.9us
I20260709 13:19:31.583205  7127 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:31.661527  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:31.691645  4187 leader_election.cc:336] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.233s (SENT)
I20260709 13:19:31.698148  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.692198  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:31.692277  4893 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:31.620684  7146 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:31.692910  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.690488  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.698837  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.705066  4289 raft_consensus.cc:2410] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:31.596792  7233 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:19:31.707809  4289 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:31.585793  7182 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:19:31.708438  4296 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:31.687731  7197 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.505s	user 0.004s	sys 0.024s
I20260709 13:19:31.711017  4289 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:31.682322  4924 raft_consensus.cc:2410] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:31.716126  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:31.695102  6734 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:31.722966  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:31.719098  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.724386  4214 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:31.724599  7046 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:31.723006  6734 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:31.729627  6734 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.725520  7127 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:31.726747  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 73853.3us
I20260709 13:19:31.719540  7241 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.732946  7241 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.735736  7241 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:31.737239  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.738066  4214 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:31.721333  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.739697  4289 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:31.740803  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:31.741639  4289 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:31.748281  4296 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:31.684567  7148 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:19:31.767867  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:31.739243  7146 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:31.769942  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:31.753074  7232 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:31.766835  4289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:31.696148  7237 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:19:31.779779  7198 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:31.780789  7198 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.767913  7144 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:31.783769  7144 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.763736  7123 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:31.774125  7196 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:31.777858  7146 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:31.805891  7146 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.818310  4221 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:31.820981  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:31.837683  4893 leader_election.cc:336] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.565s (SENT)
W20260709 13:19:31.844882  4187 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.633s (SENT)
I20260709 13:19:31.848697  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.849926  4219 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:31.852108  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.770147  7151 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:31.861442  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 1983) took 1841 ms. Trace:
I20260709 13:19:31.771795  7228 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.859479  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.860076  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.861922  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 405) took 1003 ms. Trace:
I20260709 13:19:31.861883  4292 rpcz_store.cc:276] 0709 13:19:30.019545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.020131 (+   586us) service_pool.cc:224] Handling call
0709 13:19:30.040736 (+ 20605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.041012 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.041040 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.041605 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.095841 (+ 54236us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:30.095903 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.096021 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.548938 (+1452917us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:31.859986 (+311048us) raft_consensus.cc:1685] finished
0709 13:19:31.860009 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.861363 (+  1354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9424640,"thread_start_us":50627,"threads_started":1,"wal-append.queue_time_us":95940}
I20260709 13:19:31.867334  4221 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:31.866005  4216 rpcz_store.cc:276] 0709 13:19:30.858196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.858335 (+   139us) service_pool.cc:224] Handling call
0709 13:19:30.858687 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:30.871514 (+ 12827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.871564 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:30.890427 (+ 18863us) log.cc:844] Serialized 52 byte log entry
0709 13:19:31.341283 (+450856us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:31.673845 (+332562us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.675716 (+  1871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.675793 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.861696 (+185903us) raft_consensus.cc:1685] finished
0709 13:19:31.861718 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.861862 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16318,"prepare.queue_time_us":329925,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":21526,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":34185,"thread_start_us":548367,"threads_started":2,"wal-append.queue_time_us":509694}
I20260709 13:19:31.868635  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:31.790951  7209 log.cc:927] Time spent T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.068s	user 0.005s	sys 0.008s
I20260709 13:19:31.869709  4221 raft_consensus.cc:2410] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:31.870209  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.772805  7222 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:31.790486  7122 consensus_meta.cc:287] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.781s	user 0.014s	sys 0.000s
W20260709 13:19:31.808033  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.873803  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.830513  7083 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.879948  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.792850  7196 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:31.786962  7168 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:31.786530  7144 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:31.858912  7148 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.784479  7198 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:31.864281  7134 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:31.790585  7123 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.888852  7196 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.887991  7222 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:31.917265  4289 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:31.917830  4289 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:31.918358  4296 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:31.873610  7151 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.908872  7134 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.873991  7228 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.887287  7083 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.902666  7148 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.916867  7198 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:31.883345  7122 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.930874  7222 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.939513  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.900947  6902 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:31.950140  7123 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:31.952891  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2139) took 1902 ms. Trace:
I20260709 13:19:31.992794  4928 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:31.992700  4222 rpcz_store.cc:276] 0709 13:19:30.050437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.198035 (+147598us) service_pool.cc:224] Handling call
0709 13:19:30.198287 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.334454 (+136167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.952545 (+1618091us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400024ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:31.952805 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232246656}
I20260709 13:19:31.956903  4289 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:31.959481  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:31.959807  4219 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:19:31.939426  7242 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.246s	user 0.001s	sys 0.001s
I20260709 13:19:31.966439  7198 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.014752  7198 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:31.989442  4214 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:31.968945  4213 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:32.009712  4215 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:19:32.011173  6902 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:32.023144  7250 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:19:32.025671  7254 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:19:32.026554  7228 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:32.029208  7059 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:31.941603  7134 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.038383  7134 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.038578  7122 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.042917  7148 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.047169  7119 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:32.054214  6620 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.057756  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:32.059056  7083 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:32.060853  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:32.061560  4290 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:32.068828  4187 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.060s (SENT)
I20260709 13:19:32.069535  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:32.067330  4893 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:32.073215  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:32.073370  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:32.074795  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:32.077359  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:32.089610  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.092532  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:32.093065  4290 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:32.077791  6902 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.095026  7182 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.095772  7219 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:32.096236  7219 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:32.096072  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:32.097261  4213 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:32.083961  7241 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:32.099105  7241 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.099500  7241 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.103825  7232 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.107692  7232 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.105623  7096 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:32.109578  7096 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.082948  7243 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.110072  7096 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.110311  7243 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.110801  7243 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.082885  7235 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.112923  7235 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.105545  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:32.059773  7218 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:32.106487  7246 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:19:32.106624  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:19:32.114650  4187 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.117s (SENT)
I20260709 13:19:32.113325  7235 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.078438  7229 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:32.138435  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:32.132962  7233 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:32.168869  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:32.097206  7219 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.174209  7219 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.181783  7151 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:32.183758  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:32.188906  4921 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:32.205721  7196 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.215692  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:32.219864  6795 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.220636  6795 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.221536  7132 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.222137  7132 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.223169  6795 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.224211  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:32.225239  4920 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:32.226616  7176 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:32.225425  7239 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.262266  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 303272us
W20260709 13:19:32.279309  4261 leader_election.cc:336] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.627s (SENT)
I20260709 13:19:32.279822  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:32.227248  7176 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:32.265714  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 129632us
I20260709 13:19:32.283712  4259 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:32.250622  6610 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.271350  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.287367  4185 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:32.262151  6795 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.253839  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.268049  7215 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:32.280589  7233 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:32.303737  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:32.303742  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.288780  7222 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.291421  7083 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.292124  7132 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:32.309098  7148 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 13:19:32.328765  4261 leader_election.cc:336] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.707s (SENT)
I20260709 13:19:32.329355  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:32.336169  7264 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.336247  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1917) took 1140 ms. Trace:
I20260709 13:19:32.337060  7264 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.337764  4186 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:32.288604  6610 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.318030  7134 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:32.321309  7196 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:32.348873  4287 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:32.366557  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1909) took 1220 ms. Trace:
I20260709 13:19:32.367107  4287 rpcz_store.cc:276] 0709 13:19:31.146248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.425443 (+279195us) service_pool.cc:224] Handling call
0709 13:19:32.348135 (+922692us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b5800082598. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:19:32.348486 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.366081 (+ 17595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.366468 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94297984}
I20260709 13:19:32.336997  4295 rpcz_store.cc:276] 0709 13:19:31.196527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.488313 (+291786us) service_pool.cc:224] Handling call
0709 13:19:31.493617 (+  5304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.494813 (+  1196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.494848 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.509110 (+ 14262us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.711811 (+202701us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:31.729739 (+ 17928us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.730020 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.730109 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.105806 (+375697us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:32.335844 (+230038us) raft_consensus.cc:1685] finished
0709 13:19:32.335980 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.336174 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3939,"prepare.queue_time_us":16497,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":62,"raft.queue_time_us":1181,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":26655,"spinlock_wait_cycles":5115136,"thread_start_us":156664,"threads_started":1,"wal-append.queue_time_us":212253}
I20260709 13:19:32.294124  6795 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.314679  6762 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:32.357053  4261 leader_election.cc:336] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.741s (SENT)
I20260709 13:19:32.288262  7239 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.375168  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:32.327320  7131 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:32.376458  4261 leader_election.cc:336] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.857s (SENT)
I20260709 13:19:32.359735  7132 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.377101  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:32.334244  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:32.379244  4187 leader_election.cc:336] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 3.284s (SENT)
I20260709 13:19:32.390147  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:32.331459  7198 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:32.353938  7222 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:32.399397  4187 leader_election.cc:336] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.211s (SENT)
I20260709 13:19:32.373521  6570 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:32.406038  7224 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.300s	user 0.000s	sys 0.006s
W20260709 13:19:32.407182  7263 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:32.384188  6762 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.378573  7151 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:32.417102  4922 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:32.297952  7215 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.381155  7134 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:32.474156  4289 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:32.467368  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.408306  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 278) took 3307 ms. Trace:
I20260709 13:19:32.383469  7131 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:32.475828  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75109.8us
I20260709 13:19:32.324474  7241 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:32.410090  7261 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:19:32.492877  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:46860 (request call id 1932) took 1110 ms. Trace:
W20260709 13:19:32.489500  4187 leader_election.cc:336] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.339s (SENT)
I20260709 13:19:32.419781  7269 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.534991  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:32.530846  4289 rpcz_store.cc:276] 0709 13:19:31.372400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.764453 (+392053us) service_pool.cc:224] Handling call
0709 13:19:32.419005 (+654552us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400295ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ecd9a3d 00007fee43ca9cd0 00007fee3d22e254 00007fee3d22e1e2 00007fee3d22e111 00007fee3d22e08c 00007fee3d22d342 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:32.482480 (+ 63475us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":227,"spinlock_wait_cycles":334420224}
I20260709 13:19:32.411664  7231 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.474623  6570 raft_consensus.cc:697] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:32.537793  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:32.538236  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:32.541227  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:32.537009  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:32.416908  7176 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:32.542485  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:32.548434  4923 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:32.549116  4222 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:32.400550  7198 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.539634  4214 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 3.
I20260709 13:19:32.473429  7083 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:32.495438  7131 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:32.418426  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:32.413143  7264 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.412544  7225 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.224s
I20260709 13:19:32.590623  6610 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.591789  4928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 409) took 1738 ms. Trace:
I20260709 13:19:32.592222  4928 rpcz_store.cc:276] 0709 13:19:30.853012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.853157 (+   145us) service_pool.cc:224] Handling call
0709 13:19:32.591565 (+1738408us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540062cfd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:32.591721 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2614888704}
W20260709 13:19:32.599807  7260 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:19:32.401598  7233 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.604779  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 404) took 1229 ms. Trace:
I20260709 13:19:32.605307  4293 rpcz_store.cc:276] 0709 13:19:31.375244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.793612 (+418368us) service_pool.cc:224] Handling call
0709 13:19:31.793895 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.961987 (+168092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.962022 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.962070 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:31.962117 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.604484 (+642367us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400259ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:32.604538 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.604699 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385975552}
I20260709 13:19:32.531602  7182 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:32.384109  7132 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.571750  7272 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:32.572050  7074 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.563501  7265 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.576491  7255 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:19:32.576979  7266 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:32.577849  7258 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.220s	user 0.000s	sys 0.002s
I20260709 13:19:32.420027  7235 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.413374  7239 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.492784  7065 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.541706  6795 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:32.709513  7256 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.376s	user 0.003s	sys 0.000s
W20260709 13:19:32.735239  7261 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:32.763536  7065 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.709232  7225 consensus_queue.cc:1059] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:19:32.708958  7182 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.549863  7231 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.755290  7266 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:32.785724  7232 consensus_meta.cc:287] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.000s
I20260709 13:19:32.785986  7241 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.786314  7232 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.787753  7231 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:32.788092  7266 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.722323  7272 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.788949  7198 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:32.729506  7265 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.788931  7232 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:32.793006  7265 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.792776  7215 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:32.795866  7243 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.002s
W20260709 13:19:32.790686  7219 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.003s
I20260709 13:19:32.799121  7235 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:32.800477  7272 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:32.800549  7243 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.802522  7243 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:32.841539  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 495905us
W20260709 13:19:32.842672  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.847288  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:32.483640  4138 rpcz_store.cc:276] 0709 13:19:29.100702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.100853 (+   151us) service_pool.cc:224] Handling call
0709 13:19:29.115842 (+ 14989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.121438 (+  5596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.121478 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.779813 (+1658335us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b2c00000c88. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:19:30.780406 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.846464 (+ 66058us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:31.295775 (+449311us) log.cc:844] Serialized 14 byte log entry
0709 13:19:32.219488 (+923713us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b1800443c80. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee3bbf7a40 00007fee3bbf24e4 00007fee3bbf2455 00007fee3ecda060 00007fee3ecec716 00007fee3ecfd287 00007fee3ecfd208
0709 13:19:32.314494 (+ 95006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.314604 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.321380 (+  6776us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:32.407996 (+ 86616us) raft_consensus.cc:1685] finished
0709 13:19:32.408027 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.408229 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52117,"prepare.queue_time_us":482138,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3582,"raft.queue_time_us":949529,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":9013,"spinlock_wait_cycles":94742912,"thread_start_us":569769,"threads_started":3,"wal-append.queue_time_us":122920}
I20260709 13:19:32.856848  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.858564  4139 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:32.860785  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:32.865959  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.866581  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.868443  4139 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 4: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:32.869827  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.870571  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:32.871662  4138 raft_consensus.cc:2410] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:32.872018  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.873381  4143 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:32.873239  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.874037  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.874123  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:32.875128  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.876214  4146 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:32.877787  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.878842  4144 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:32.869946  7279 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:19:32.883422  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.885500  4146 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:19:32.888674  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.890793  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.891062  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.897401  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:32.898634  4213 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.908227  4921 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:32.908624  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2013) took 1379 ms. Trace:
I20260709 13:19:32.916990  6795 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:32.924468  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 69934.2us
I20260709 13:19:32.916085  7182 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:32.909294  4292 rpcz_store.cc:276] 0709 13:19:31.529424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.871211 (+341787us) service_pool.cc:224] Handling call
0709 13:19:31.873805 (+  2594us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:31.880552 (+  6747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.880610 (+    58us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:31.884395 (+  3785us) log.cc:844] Serialized 78 byte log entry
0709 13:19:32.084272 (+199877us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:32.084576 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.084813 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.587577 (+502764us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:32.907555 (+319978us) raft_consensus.cc:1685] finished
0709 13:19:32.907618 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.908278 (+   660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5607,"raft.queue_time_us":327,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":7481,"spinlock_wait_cycles":28914560,"thread_start_us":170971,"threads_started":1,"wal-append.queue_time_us":387120}
I20260709 13:19:32.964074  7239 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:32.965510  6570 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:32.967315  7096 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.005s
I20260709 13:19:32.968274  7096 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:32.968276  7264 consensus_queue.cc:1059] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:19:32.968551  7265 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:32.970970  7196 raft_consensus.cc:3055] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:32.971611  7196 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:32.973287  6762 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:32.764595  7134 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.973870  7196 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:32.976819  7266 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:32.978134  7144 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:32.979534  7144 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.023135  7196 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.024857  7283 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.025943  7283 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.032207  7279 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:33.034549  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:33.037336  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:33.038338  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.039433  4292 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:32.952498  6795 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:33.037472  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:33.042531  6795 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.054984  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.057248  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.057474  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:33.058779  4295 raft_consensus.cc:2410] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:32.951206  7132 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:33.042567  7279 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:33.042480  4924 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:33.122035  6610 raft_consensus.cc:3055] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:33.132493  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.157716  4140 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:33.122787  6610 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:33.162657  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:32.965587  7239 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:33.161247  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 72935us
W20260709 13:19:33.170281  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83166.5us
I20260709 13:19:33.171245  7283 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:33.188830  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.190219  4143 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:33.193166  7096 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:33.195389  7233 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:33.196497  7281 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:33.197240  7281 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:33.198725  7281 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.200685  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:33.202396  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:33.202965  7283 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:33.203559  7283 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.204080  7283 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.207041  7272 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:33.186664  6610 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.208976  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.209988  4295 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:33.210139  6610 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:33.185745  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.212150  7218 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:33.213081  4147 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:33.213240  7218 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.219271  7182 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:33.219350  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.220625  4144 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:33.220361  7182 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.222369  7239 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:33.222615  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.223529  7182 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:33.223780  4139 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9.
I20260709 13:19:33.224793  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.226745  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.226955  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:33.228137  4143 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:33.228157  4924 raft_consensus.cc:2368] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7.
I20260709 13:19:33.230492  4110 leader_election.cc:400] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7.
I20260709 13:19:33.230851  4110 leader_election.cc:403] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:33.231827  7239 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.212868  7233 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:33.239282  7233 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:33.241379  7144 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:33.244903  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.246042  4140 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:19:33.240228  7131 consensus_meta.cc:287] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.668s	user 0.016s	sys 0.006s
I20260709 13:19:33.186622  4145 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:33.173774  7266 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:33.252292  4147 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:33.259058  4213 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:19:33.251870  7218 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:33.254885  7266 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:33.271966  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.275022  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:33.280222  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.301834  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.310437  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.310806  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.288420  7281 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:33.313788  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.262234  7131 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:33.344689  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.341799  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.354903  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.356716  4295 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:33.369624  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.371812  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.372224  4292 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:33.372905  4141 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:33.374996  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.378022  4187 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 4.394s (SENT) [suppressed 55 similar messages]
W20260709 13:19:33.379724  4187 leader_election.cc:336] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.531s (SENT)
I20260709 13:19:33.348678  7283 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.388080  4112 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:33.390827  7283 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:33.391285  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:33.392329  4287 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:33.394935  4147 raft_consensus.cc:2410] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:33.396643  4292 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:19:33.402534  4215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 411) took 2391 ms (client timeout 2108 ms). Trace:
I20260709 13:19:33.408059  7065 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:33.411588  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.414937  4215 rpcz_store.cc:269] 0709 13:19:31.010932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.148163 (+137231us) service_pool.cc:224] Handling call
0709 13:19:33.401959 (+2253796us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54000249d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:33.402210 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641349504}
I20260709 13:19:33.432811  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.440938  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.442013  4140 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:33.442330  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.442987  4141 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:33.443262  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.443302  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.445915  4147 raft_consensus.cc:2410] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:33.446211  7279 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.454097  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.456099  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.457398  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.458318  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.466536  4145 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:33.473038  6620 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:33.354413  7266 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.482045  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.487422  4140 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:33.392380  7280 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:33.496932  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.497201  4141 raft_consensus.cc:2410] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:33.498709  4140 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:33.499524  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.500671  4290 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:33.501268  4295 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:33.503430  4288 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:33.505012  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:33.505366  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 125727us
I20260709 13:19:33.505857  4291 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:33.506177  4187 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.558s (SENT)
I20260709 13:19:33.425901  7284 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.189s
I20260709 13:19:33.508669  4147 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:33.509330  7065 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:33.510210  7266 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:33.508180  4187 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.607s (SENT)
I20260709 13:19:33.522879  4187 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:33.480791  7239 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7.
I20260709 13:19:33.527904  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.508123  7284 consensus_queue.cc:1243] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:33.505017  7285 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:33.541777  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.538482  4145 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:33.548270  7169 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.549096  7169 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.551803  7169 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:33.552495  7065 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:33.555819  4215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:33.556552  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:33.556972  4215 raft_consensus.cc:606] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:33.557552  4296 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.561704  4287 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:33.563061  4147 raft_consensus.cc:2368] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9.
I20260709 13:19:33.566332  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.569510  4291 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:33.570072  7169 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:33.574090  7283 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:33.574630  7283 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:33.576429  4922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 418) took 1763 ms (client timeout 2224 ms). Trace:
W20260709 13:19:33.576977  4922 rpcz_store.cc:269] 0709 13:19:31.714883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.715857 (+   974us) service_pool.cc:224] Handling call
0709 13:19:33.468094 (+1752237us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54002b2354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:33.468331 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602741120}
I20260709 13:19:33.578665  7131 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:33.579728  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.580674  4144 raft_consensus.cc:2368] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:19:33.593876  4140 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:33.595353  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.596215  4147 raft_consensus.cc:2376] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
W20260709 13:19:33.604568  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 213490us
I20260709 13:19:33.606115  4921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 423) took 1391 ms. Trace:
I20260709 13:19:33.614315  4921 rpcz_store.cc:276] 0709 13:19:32.214530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.214735 (+   205us) service_pool.cc:224] Handling call
0709 13:19:32.215343 (+   608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.909136 (+693793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.605587 (+696451us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400156154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:33.605907 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591318272}
I20260709 13:19:33.616601  7279 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.618916  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.620453  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.611339  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.620818  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.575618  7283 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.611897  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.567896  7280 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:33.613173  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:33.606782  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:33.610209  7290 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.205s	user 0.003s	sys 0.001s
I20260709 13:19:33.643684  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.646189  4296 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:33.647570  4294 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:33.648041  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.651880  4140 raft_consensus.cc:2376] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:33.634627  7132 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.659768  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.668490  4139 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:33.668258  7132 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.671182  7132 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:33.667109  4143 raft_consensus.cc:2410] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:33.674129  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.676741  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.677222  7267 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.678170  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.677984  7267 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:33.679098  4146 raft_consensus.cc:2368] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
I20260709 13:19:33.680898  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:33.681763  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.681928  4215 raft_consensus.cc:2410] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:33.657655  4145 raft_consensus.cc:2376] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:33.680038  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.683645  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.685911  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.686707  4147 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:33.684103  4146 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:33.691399  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:33.692471  4213 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:33.607180  7285 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:33.705978  4141 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:33.707566  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.710292  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.721819  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.726892  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.740044  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.741257  4146 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:33.726123  6610 consensus_meta.cc:287] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.004s
I20260709 13:19:33.758420  4147 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:33.762605  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.764262  4143 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:33.768543  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.739022  7283 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:33.776590  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.775825  4294 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:33.743710  7267 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:33.778489  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:33.773568  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.781078  4288 raft_consensus.cc:2410] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:33.784225  4147 raft_consensus.cc:2376] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9. Re-sending same reply.
I20260709 13:19:33.779165  4215 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:33.785547  4291 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:33.785885  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:33.767305  7264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.019s	sys 0.018s
I20260709 13:19:33.791407  4141 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:33.808403  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.809813  4147 raft_consensus.cc:2368] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
I20260709 13:19:33.779474  7065 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:19:33.791405  7264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.019s	sys 0.018s
I20260709 13:19:33.814714  4293 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:33.786319  7196 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:33.822293  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.781844  6610 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:19:33.828581  4141 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:33.828902  4288 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:33.838577  4291 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:19:33.842612  4215 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:33.839102  4291 pending_rounds.cc:85] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:19:33.849557  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:33.850503  4222 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.852537  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:33.855871  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:33.856801  4292 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:33.858101  7215 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.858704  7215 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:33.814607  7065 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:19:33.861181  7289 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.467s	user 0.002s	sys 0.002s
I20260709 13:19:33.861577  7065 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:33.863144  7065 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:33.865190  7297 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:19:33.845520  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:33.870189  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52622.1us
I20260709 13:19:33.870846  6620 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:33.871291  6620 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.871649  6620 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:33.873389  6610 consensus_queue.cc:1243] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:33.876691  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.842258  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:33.885594  4139 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:33.886739  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:33.887331  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.888036  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.888736  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:33.887457  4141 raft_consensus.cc:2376] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:33.890153  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:33.887269  4139 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:33.887964  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:33.892997  4218 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.894245  4145 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:33.898842  4294 raft_consensus.cc:2410] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:33.871987  4186 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:33.918437  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.919283  4145 raft_consensus.cc:2376] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10. Re-sending same reply.
I20260709 13:19:33.844203  4291 pending_rounds.cc:107] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:19:33.925246  4291 raft_consensus.cc:2889] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:33.929250  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 421097us
W20260709 13:19:33.922920  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 51057.6us
I20260709 13:19:33.931520  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:33.933789  4215 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:33.938164  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.926842  7290 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:19:33.941586  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:33.920674  7144 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.951366  4139 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:19:33.952123  4139 pending_rounds.cc:85] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 2
I20260709 13:19:33.952489  4139 pending_rounds.cc:107] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:19:33.952821  4139 raft_consensus.cc:2889] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.954656  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:33.965317  4145 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:33.970631  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.974633  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.977058  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:33.978060  4219 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
W20260709 13:19:33.981873  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.983722  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.984301  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.985034  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.986601  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:33.987469  4221 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:19:34.005311  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:34.010483  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 66433.1us
I20260709 13:19:33.943138  7196 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:34.016392  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:34.017771  4222 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:34.015774  7267 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:19:34.021934  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.028682  4142 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:34.029086  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:34.030295  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.030840  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.036738  7196 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:34.042754  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:33.981366  7131 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:34.051568  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.055500  4141 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:33.966794  7144 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:34.071844  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:34.076301  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:34.078616  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 67310.2us
I20260709 13:19:34.082810  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.089007  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:34.084789  4222 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:34.090804  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:34.096163  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 159771us
I20260709 13:19:34.105744  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.106544  4141 raft_consensus.cc:2376] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:34.109138  4214 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:34.122555  7168 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.123322  7168 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.123688  7168 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.127591  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.174032  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 61116.6us
I20260709 13:19:34.115172  7267 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:34.178941  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:34.186583  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4637090220001028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:19:34.187114  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.143865  4893 connection.cc:256] RPC call timeout handler was delayed by -1.1943513070000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3052s for a response
W20260709 13:19:34.191171  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 463455us
W20260709 13:19:34.194836  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.181814  7267 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:34.199361  4187 leader_election.cc:336] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.743s (SENT)
I20260709 13:19:34.200102  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.206741  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 145006us
I20260709 13:19:34.209055  4139 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:34.213688  6734 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:19:34.216739  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:34.225620  4145 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:34.216952  4261 leader_election.cc:336] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.559s (SENT)
I20260709 13:19:34.236585  4144 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:34.218760  7267 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.252228  4221 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:34.249151  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 129887us
W20260709 13:19:34.259172  4892 connection.cc:256] RPC call timeout handler was delayed by -1.0798432869999033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 13:19:34.266525  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 72287.1us
I20260709 13:19:34.269104  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.271924  4187 leader_election.cc:336] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.763s (SENT)
I20260709 13:19:34.216256  6734 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:19:34.275982  7144 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:34.276468  7320 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.276573  4214 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:34.276763  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.277416  4138 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:34.278375  7077 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:34.278409  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.294041  4143 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:34.230569  6620 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:34.332389  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 71943.1us
I20260709 13:19:34.344313  4145 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
W20260709 13:19:34.362768  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 66893.1us
W20260709 13:19:34.361037  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 159330us
W20260709 13:19:34.365793  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4214090220000344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:19:34.374464  7309 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
I20260709 13:19:34.372279  6620 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:34.379920  4145 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:34.380650  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:34.385443  4138 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:19:34.376746  7313 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:19:34.389406  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.390316  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.394119  4214 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:19:34.390318  4213 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:34.398813  4142 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:34.401371  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:34.407380  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.388458  7065 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.005s
W20260709 13:19:34.405192  4261 leader_election.cc:336] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.015s (SENT)
I20260709 13:19:34.418035  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.420601  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.434508  4145 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
W20260709 13:19:34.425858  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.423343  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.277050  7320 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:34.462169  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.438014  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:34.437897  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:34.440325  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:34.471557  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 239815us
W20260709 13:19:34.438539  7310 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
W20260709 13:19:34.481612  4215 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.000s
I20260709 13:19:34.483795  4215 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:34.466499  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:34.495298  4219 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
W20260709 13:19:34.497794  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.510231  4218 consensus_meta.cc:287] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.002s
I20260709 13:19:34.510654  4218 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:34.445214  7215 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:34.521273  4213 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:34.521412  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:34.529595  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.527104  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:34.530809  4143 raft_consensus.cc:2368] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
W20260709 13:19:34.533645  4187 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.545s (SENT)
I20260709 13:19:34.535151  4138 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:34.538928  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:34.523949  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:34.544117  4214 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:34.554219  4222 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:34.558825  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.523348  7332 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:34.558579  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.561604  4893 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:34.541213  6620 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:19:34.562621  7338 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:34.563199  7338 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.563735  7338 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:34.563211  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 161348us
I20260709 13:19:34.575605  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.578015  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 85979.2us
I20260709 13:19:34.556329  7327 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:34.584808  4221 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:34.586738  4215 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:34.590773  4216 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:34.592236  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.593075  4143 raft_consensus.cc:2376] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:34.600548  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.559755  7264 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:34.619043  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.603075  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69497.3us
I20260709 13:19:34.604257  7094 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:34.607580  7330 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:34.607954  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:34.619817  4138 raft_consensus.cc:2376] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:34.588979  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:34.557479  7144 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.538021  7168 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:34.620734  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 262256us
I20260709 13:19:34.625873  4112 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:34.625196  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.634187  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 45719.2us
I20260709 13:19:34.634922  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:34.631634  4187 leader_election.cc:336] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.705s (SENT)
I20260709 13:19:34.636197  4143 raft_consensus.cc:2376] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:34.639104  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.638772  7284 raft_consensus.cc:2764] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:34.641505  7077 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:34.643254  7306 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.661s	user 0.004s	sys 0.022s
I20260709 13:19:34.644068  7168 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:34.624701  6734 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.653069  6734 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:34.653522  6734 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.653926  7330 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:34.654568  7330 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:34.655521  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2041) took 1157 ms. Trace:
I20260709 13:19:34.615491  7327 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:34.657192  4187 leader_election.cc:336] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.731s (SENT)
I20260709 13:19:34.656072  4289 rpcz_store.cc:276] 0709 13:19:33.497694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.500229 (+  2535us) service_pool.cc:224] Handling call
0709 13:19:33.535429 (+ 35200us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:33.548946 (+ 13517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.548997 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:33.549732 (+   735us) log.cc:844] Serialized 52 byte log entry
0709 13:19:33.700782 (+151050us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:33.723001 (+ 22219us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.726506 (+  3505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.726619 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.550626 (+824007us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b1800413ec0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:19:34.654938 (+104312us) raft_consensus.cc:1685] finished
0709 13:19:34.655074 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.655265 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22564,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":14648,"raft.queue_time_us":11615,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":11228,"spinlock_wait_cycles":12243200,"thread_start_us":150486,"threads_started":1,"wal-append.queue_time_us":213152}
W20260709 13:19:34.658397  4187 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.747s (SENT)
I20260709 13:19:34.660565  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:34.662196  7329 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:34.662824  7329 raft_consensus.cc:697] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:34.662860  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:34.663707  4924 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:34.635797  7144 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:34.662078  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.668812  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3743256170000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26110000000000005s for a response
I20260709 13:19:34.666985  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:34.668617  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:34.675311  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:34.687428  6620 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:34.692888  4928 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:19:34.693658  4187 leader_election.cc:336] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.825s (SENT)
I20260709 13:19:34.694923  4924 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:34.695781  4187 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.868s (SENT)
I20260709 13:19:34.655608  7330 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:34.702092  4924 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:34.702484  7144 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:34.707253  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.640726  7283 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:34.663978  7329 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:34.715332  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:34.672447  7340 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:19:34.717312  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.720117  7320 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:34.721961  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:34.724382  7264 consensus_queue.cc:1059] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:19:34.727447  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.766674  4146 raft_consensus.cc:2376] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:34.768860  4142 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:34.688484  7279 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.065s	user 0.014s	sys 0.003s
I20260709 13:19:34.734403  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.688862  7338 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:34.670616  7327 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:34.692873  6620 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:34.740689  4261 leader_election.cc:336] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.707s (SENT)
I20260709 13:19:34.745273  7325 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:34.746690  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:34.650645  7267 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:34.756107  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.761255  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.658s (SENT)
I20260709 13:19:34.770185  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:34.770987  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:34.770869  4138 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:34.763206  7281 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
W20260709 13:19:34.783227  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 113576us
I20260709 13:19:34.787884  4140 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:34.940856  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.943182  4143 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:34.889531  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1785) took 1250 ms. Trace:
I20260709 13:19:34.939790  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:34.946334  4144 rpcz_store.cc:276] 0709 13:19:33.617803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.620500 (+  2697us) service_pool.cc:224] Handling call
0709 13:19:34.867707 (+1247207us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400018bd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:34.867923 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410183936}
I20260709 13:19:34.824790  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:34.901434  4920 raft_consensus.cc:2368] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:19:34.962841  4217 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: [6.5-8.6]
W20260709 13:19:34.963186  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 198272us
I20260709 13:19:34.962847  4289 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:19:34.959306  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 211825us
I20260709 13:19:34.819478  7127 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:34.980382  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.011409  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:34.873800  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.013852  4146 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:34.964655  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.015587  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:34.989333  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.016602  4294 raft_consensus.cc:2410] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:34.822117  4919 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:34.895517  7196 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.016510  4143 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:34.991153  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:34.844657  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 148899us
I20260709 13:19:34.948053  7094 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:35.020486  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.020594  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:19:35.021474  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 274888us
I20260709 13:19:35.022042  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:34.786866  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:35.023682  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.027256  4144 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:34.822543  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:35.040236  4893 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.857s (SENT)
I20260709 13:19:35.041360  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:35.012637  7127 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:35.042563  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 255782us
I20260709 13:19:34.991374  7281 consensus_queue.cc:1243] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:35.052326  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.049901  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:35.049901  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:35.053052  4288 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:35.053488  4143 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:35.051551  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:35.054392  4146 raft_consensus.cc:2376] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4. Re-sending same reply.
W20260709 13:19:35.055006  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.822474  7323 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.207s
W20260709 13:19:35.050978  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.050051  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:35.055540  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.053341  4144 raft_consensus.cc:2376] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:35.059244  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:35.016031  7320 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.030670  7340 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:35.073832  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.074519  4139 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:35.072587  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:35.075116  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.075664  4138 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:35.077908  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:35.049974  7077 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:35.081907  4187 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.899s (SENT)
I20260709 13:19:35.084950  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.090586  4288 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:35.090788  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:35.088614  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 130954us
I20260709 13:19:35.089367  7077 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.096235  7264 consensus_queue.cc:1243] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:35.096537  7077 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.097072  7264 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:35.097869  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.098433  7347 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:35.098591  4143 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:35.098949  7347 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:35.099855  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.100036  7347 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:35.101229  7343 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:19:35.101649  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.103921  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.105367  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:35.105641  4187 leader_election.cc:336] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.914s (SENT)
W20260709 13:19:35.106529  7344 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
I20260709 13:19:35.106809  7127 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:35.107518  4187 leader_election.cc:336] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.938s (SENT)
I20260709 13:19:35.073417  6620 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.065812  7281 consensus_queue.cc:1059] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:19:35.114243  4140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1788) took 1495 ms (client timeout 1743 ms). Trace:
I20260709 13:19:35.114518  6795 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:35.063339  7196 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.213544  6795 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:35.141304  4147 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:35.214762  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 474186us
I20260709 13:19:35.206303  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.128669  4143 raft_consensus.cc:2376] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:35.177790  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.180667  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:35.225399  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 117969us
W20260709 13:19:35.214068  4140 rpcz_store.cc:269] 0709 13:19:33.618958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.653041 (+ 34083us) service_pool.cc:224] Handling call
0709 13:19:35.114037 (+1460996us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400286754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:35.114168 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537782528}
I20260709 13:19:35.227526  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.142813  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:35.143399  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:35.087381  7144 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.229324  4139 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:35.108191  7127 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.229518  4291 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:35.230113  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3512090220001483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:19:35.230669  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2621174020000581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:19:35.231087  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2207174019999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:19:35.233871  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.234633  4289 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
W20260709 13:19:35.238073  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 197913us
I20260709 13:19:35.079020  7345 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:35.241581  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2108090220001486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:19:35.164681  7281 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:35.079183  7320 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.252450  4139 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:19:35.253545  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.253955  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1154090219999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 13:19:35.254312  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1061256170000888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2909s for a response
W20260709 13:19:35.254750  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0695090220001475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2276s for a response
I20260709 13:19:35.255867  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:35.261711  4139 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:35.263181  4142 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:35.264297  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 238835us
W20260709 13:19:35.252867  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 188721us
I20260709 13:19:35.266120  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:35.267616  4140 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.268955  4139 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:35.171046  7323 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:19:35.270217  4143 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:35.277807  4146 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:35.278436  4187 leader_election.cc:336] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.003s (SENT)
I20260709 13:19:35.267702  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:35.279469  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.280323  4287 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:35.284590  4139 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:35.278391  4146 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:35.244622  7338 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:35.248525  7281 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:35.310982  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 215501us
I20260709 13:19:35.269881  7144 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.116622  7094 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.285074  7314 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.288002  7267 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:35.302556  7341 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.332604  4146 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.347750  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:35.350620  4290 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.350661  4146 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:35.351436  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.352110  4288 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
W20260709 13:19:35.361534  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.365104  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 95692us
I20260709 13:19:35.320648  7065 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:19:35.369412  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1830) took 1172 ms. Trace:
I20260709 13:19:35.370079  4141 rpcz_store.cc:276] 0709 13:19:34.197513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.234460 (+ 36947us) service_pool.cc:224] Handling call
0709 13:19:34.867897 (+633437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.869017 (+  1120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.869050 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.869098 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:34.869141 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.869235 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.369062 (+499827us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b5400018bd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:35.369271 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664,"raft.queue_time_us":34696,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":1423577856}
I20260709 13:19:35.364224  4291 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:35.329572  7144 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.394434  7144 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:35.395121  7144 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:35.359717  6734 consensus_meta.cc:287] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.005s
I20260709 13:19:35.396867  6734 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.397995  7284 raft_consensus.cc:3055] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:35.398564  7284 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:35.399544  6734 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:35.401506  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1835) took 1132 ms. Trace:
I20260709 13:19:35.402169  4147 rpcz_store.cc:276] 0709 13:19:34.269383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.281749 (+ 12366us) service_pool.cc:224] Handling call
0709 13:19:35.114904 (+833155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.223969 (+109065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.401210 (+177241us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b5400286750. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:35.401423 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759409408}
W20260709 13:19:35.404505  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.310606  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:35.399511  7284 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:35.417248  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 155373us
I20260709 13:19:35.359717  7351 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:35.339726  7314 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.395676  7144 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.359594  7077 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.414024  4140 raft_consensus.cc:2410] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:35.469120  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 201494us
I20260709 13:19:35.431768  7196 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:35.430783  7284 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.357470  6795 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.486773  4290 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:35.489972  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.438097  7351 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:35.496465  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.497290  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.480957  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.506735  4187 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.194s (SENT)
W20260709 13:19:35.508142  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.510910  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.513954  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.517112  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.477557  7353 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:35.491201  7196 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:35.598642  4215 raft_consensus.cc:1217] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Deduplicated request from leader. Original: 3.2->[5.3-5.3]   Dedup: 5.3->[]
I20260709 13:19:35.604983  4215 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:35.488152  7279 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:19:35.490813  7350 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:19:35.627357  4146 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:35.597218  7320 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:35.643229  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.408s (SENT)
W20260709 13:19:35.636286  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 129613us
I20260709 13:19:35.635165  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1866) took 1022 ms. Trace:
I20260709 13:19:35.646627  4146 rpcz_store.cc:276] 0709 13:19:34.612908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.242770 (+629862us) service_pool.cc:224] Handling call
0709 13:19:35.269335 (+ 26565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.634380 (+365045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.635048 (+   668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.648311  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.624926  6795 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.652014  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:35.645699  7283 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:19:35.665524  4287 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:35.599356  7353 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:35.686489  4138 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.610s	user 0.015s	sys 0.000s
I20260709 13:19:35.694387  4138 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:35.627635  7196 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.653085  7320 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:35.671638  7329 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:35.716714  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.713073  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:35.706533  7340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.011s	sys 0.011s
W20260709 13:19:35.731185  4187 connection.cc:256] RPC call timeout handler was delayed by -1.0686423650001871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:19:35.741943  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 115123us
I20260709 13:19:35.746623  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:35.747620  4293 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:35.753288  7355 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260709 13:19:35.753450  7372 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.754251  7372 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.755035  7144 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:35.755879  7144 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:35.756417  7144 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.757164  7366 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:35.757777  7366 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.758674  7144 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:35.759578  7077 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:35.760298  7314 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:35.765654  7357 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:19:35.766471  7196 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:35.768311  4187 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.996s (SENT)
W20260709 13:19:35.769513  4187 leader_election.cc:336] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.169s (SENT)
I20260709 13:19:35.769641  7353 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
W20260709 13:19:35.770720  4187 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.238s (SENT)
W20260709 13:19:35.770862  7354 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.330s	user 0.002s	sys 0.000s
I20260709 13:19:35.771222  4187 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:35.741844  7348 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.772804  7348 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.775125  7356 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.775992  7356 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:35.670672  7351 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.772825  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:35.777091  4287 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.776660  7356 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:35.729396  7340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.011s	sys 0.011s
I20260709 13:19:35.779179  7356 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:35.760083  7366 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:35.784960  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1848) took 1185 ms. Trace:
I20260709 13:19:35.788305  4217 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:35.791047  4187 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.283s (SENT)
I20260709 13:19:35.795745  4213 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:35.714907  7320 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.776268  7348 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:35.783042  7340 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:35.791538  4144 rpcz_store.cc:276] 0709 13:19:34.599461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.239241 (+639780us) service_pool.cc:224] Handling call
0709 13:19:35.270555 (+ 31314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.278388 (+  7833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.278421 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.301597 (+ 23176us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.412379 (+110782us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:35.658885 (+246506us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.659335 (+   450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.659544 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.784591 (+125047us) raft_consensus.cc:1685] finished
0709 13:19:35.784624 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.784864 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":323737,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":84932,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":45419,"thread_start_us":338744,"threads_started":2,"wal-append.queue_time_us":256175}
I20260709 13:19:35.810158  7348 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:35.818570  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 429) took 1155 ms. Trace:
I20260709 13:19:35.819326  7348 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.820168  4920 rpcz_store.cc:276] 0709 13:19:34.663429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.674761 (+ 11332us) service_pool.cc:224] Handling call
0709 13:19:35.805217 (+1130456us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54002b2354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:35.818457 (+ 13240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505177472}
I20260709 13:19:35.822312  7348 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:35.823014  7348 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:35.803371  7264 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.825356  7264 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.827723  4145 raft_consensus.cc:2376] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:35.828800  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1873) took 1158 ms. Trace:
W20260709 13:19:35.832203  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.832551  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:35.833460  4294 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:35.833951  7340 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.836653  7347 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:35.827961  7264 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:35.837577  7264 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:35.838317  7264 consensus_queue.cc:1243] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:35.829311  4145 rpcz_store.cc:276] 0709 13:19:34.670615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.105059 (+434444us) service_pool.cc:224] Handling call
0709 13:19:35.827410 (+722351us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b54000696a8. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44abf924 00007fee43ca8227 00007fee43ca7ab8 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:35.828583 (+  1173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310912}
I20260709 13:19:35.839360  7320 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:35.840583  4187 leader_election.cc:336] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.306s (SENT)
W20260709 13:19:35.852046  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.823669  7348 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.856817  4293 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:35.867185  6620 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:35.869532  7362 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:35.870056  7362 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:35.871032  7362 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.872807  7372 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:35.867934  6620 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:35.883307  6620 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:35.884013  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:35.884509  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.884857  4220 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:35.885015  7362 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.886250  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:35.887039  4295 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.840024  7264 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:19:35.888723  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:35.889678  4292 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:35.890590  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:35.891158  4292 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.870074  7348 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:35.893922  7348 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:35.894297  7348 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:35.895162  7348 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.896786  7377 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:35.897445  7377 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:35.898940  4295 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:35.927783  4294 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:35.917367  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:35.992818  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 174880us
I20260709 13:19:35.816995  7281 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:35.977785  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.005554  4293 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:36.006444  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:35.900085  7377 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:36.006762  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:35.900179  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:36.012372  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.013155  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.013648  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.014003  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.014575  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:35.903195  7127 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.006s
I20260709 13:19:36.021781  4216 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:36.022603  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 122502us
I20260709 13:19:36.024237  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:35.999987  7283 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:35.978351  6620 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:36.021283  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:36.035749  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.036219  4292 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:19:36.036985  4295 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.035764  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:36.036599  4923 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
W20260709 13:19:36.047480  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.047885  4287 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
W20260709 13:19:36.047946  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.049201  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.920152  7376 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:19:36.037241  7281 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:36.053791  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:36.034965  7377 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:36.034600  7356 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:36.047086  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.058362  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.064652  7341 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:36.069720  4920 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:36.070860  4111 connection.cc:256] RPC call timeout handler was delayed by -4.23781655699986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 13:19:36.068403  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:36.050237  6620 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:36.049849  6734 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:19:36.099947  4290 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:19:36.096446  4111 connection.cc:256] RPC call timeout handler was delayed by -4.178416556999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 13:19:36.097702  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.098060  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.099056  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.100600  7341 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:36.100826  6795 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:36.110819  6795 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.104501  7390 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:19:36.111344  7341 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:36.112557  7390 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:36.113075  7390 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:36.114280  7390 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:36.101383  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.116537  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.097179  7284 consensus_meta.cc:287] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.004s
I20260709 13:19:36.094290  7356 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.045405  7345 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:36.120110  7356 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:36.120626  7345 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.121083  7345 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:36.058766  7127 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 13:19:36.106783  4111 connection.cc:256] RPC call timeout handler was delayed by -4.1451165569999375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:19:36.124684  4111 connection.cc:256] RPC call timeout handler was delayed by -4.0929165569998531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
I20260709 13:19:36.111351  6795 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:36.125149  4111 connection.cc:256] RPC call timeout handler was delayed by -3.9696165569998811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:19:36.125590  4111 connection.cc:256] RPC call timeout handler was delayed by -3.9426165569998375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 13:19:36.125967  4111 connection.cc:256] RPC call timeout handler was delayed by -3.8472165569999106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 13:19:36.126299  4111 connection.cc:256] RPC call timeout handler was delayed by -3.8229165569998713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 13:19:36.126605  4111 connection.cc:256] RPC call timeout handler was delayed by -3.7878165569998146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:19:36.126886  4111 connection.cc:256] RPC call timeout handler was delayed by -3.7482165569997505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 13:19:36.127161  4111 connection.cc:256] RPC call timeout handler was delayed by -3.6492165569998178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
W20260709 13:19:36.127480  4111 connection.cc:256] RPC call timeout handler was delayed by -3.4710165569997571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23950000000000002s for a response
W20260709 13:19:36.127759  4111 connection.cc:256] RPC call timeout handler was delayed by -3.46651655699975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24s for a response
W20260709 13:19:36.106838  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.039422  7283 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:36.129927  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 95942.4us
I20260709 13:19:36.116003  7390 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.091400  7377 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.147706  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.104177  6620 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:36.130401  7267 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:36.153017  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 117353us
I20260709 13:19:36.146209  7377 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.176401  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:36.179949  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:36.182027  6734 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:36.182687  6734 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:36.184576  7267 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:36.185973  7267 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:36.191666  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 190275us
I20260709 13:19:36.191048  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:36.202163  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.202999  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.213857  4219 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:19:36.176429  7350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.003s
I20260709 13:19:36.183736  6734 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:36.227483  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.236129  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.204543  7347 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:36.221119  7350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.011s	sys 0.003s
I20260709 13:19:36.238584  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:36.251065  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.246483  7345 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:36.247612  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:36.218386  7392 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.254532  7356 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:36.229696  7396 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:36.256237  7376 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:36.256946  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 101405us
I20260709 13:19:36.256422  7077 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:19:36.249994  7350 consensus_queue.cc:1243] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:36.288794  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:36.285385  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67404.8us
I20260709 13:19:36.288857  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:36.292222  7347 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:36.292944  4111 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:36.293787  7347 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:36.298421  7356 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:36.299428  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:36.300321  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:36.281143  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52947.8us
I20260709 13:19:36.300467  7350 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:36.304600  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 74035.9us
I20260709 13:19:36.307020  4185 leader_election.cc:400] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:19:36.308099  4185 leader_election.cc:403] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:36.309932  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:36.319799  4928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42928 (request call id 246) took 1598 ms (client timeout 1946 ms). Trace:
I20260709 13:19:36.280555  7389 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:36.294952  7396 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:36.289861  7144 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:36.322043  4928 rpcz_store.cc:269] 0709 13:19:34.721389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.721574 (+   185us) service_pool.cc:224] Handling call
0709 13:19:36.319512 (+1597938us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003e9754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:36.319718 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2779011456}
I20260709 13:19:36.350268  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:36.291357  7392 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:36.331295  7401 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:36.353348  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.328159  7374 raft_consensus.cc:2764] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:36.337150  7283 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:36.361714  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 120369us
I20260709 13:19:36.362686  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:36.336181  7356 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:36.375175  4213 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:36.359304  7350 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.373234  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:36.376557  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:36.378054  7411 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:36.379184  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:36.383750  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49201.9us
I20260709 13:19:36.385138  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:36.354244  6795 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:36.393869  4213 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:36.355587  7408 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:19:36.394124  4187 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:36.404095  7397 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:19:36.416249  7348 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.417836  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:36.418979  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:36.407676  7410 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:36.420302  7410 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:36.422572  7375 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:36.423241  7375 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:36.424245  7376 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:36.397576  7403 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:19:36.387599  7411 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:36.406447  7374 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:36.440843  7374 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:36.442938  7374 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:36.445710  7350 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:36.421639  7410 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:36.452189  7279 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:36.463892  7279 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:36.465183  7279 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:36.456086  7411 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:36.467957  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:36.469547  7350 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:36.470041  7350 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.399187  7396 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:36.458989  7404 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:36.471460  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:36.424288  7375 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:36.472182  4294 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:36.460587  7345 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:36.461594  7402 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:19:36.462075  4295 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:19:36.473191  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.479583  6795 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:36.470506  7350 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.482164  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:36.532383  4925 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.532799  4294 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:36.490175  7389 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:36.493208  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 106901us
I20260709 13:19:36.495918  7065 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:36.495980  4219 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:36.526872  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.548470  7094 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:36.503253  4295 pending_rounds.cc:85] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
W20260709 13:19:36.550710  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 131813us
I20260709 13:19:36.550829  4295 pending_rounds.cc:107] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:19:36.555155  4295 raft_consensus.cc:2889] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:36.555902  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 58221.6us
I20260709 13:19:36.537777  7389 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:36.559748  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.547842  7392 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:36.571964  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.541743  7376 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:19:36.542378  7127 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:36.577755  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:36.577986  4925 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:19:36.592794  4923 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:36.503022  7279 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:36.589169  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 74501.5us
I20260709 13:19:36.593659  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:36.593015  4928 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:36.585764  7350 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:36.594434  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:36.555033  7264 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.594237  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:36.565387  7144 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:36.570832  7408 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:19:36.615669  7362 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.730s	user 0.012s	sys 0.006s
W20260709 13:19:36.660817  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 83001.2us
I20260709 13:19:36.602511  7392 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:36.666604  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.614248  7144 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:36.693300  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.598600  7340 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:19:36.597584  7065 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:19:36.654192  7390 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:36.705965  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 147025us
W20260709 13:19:36.711309  4261 connection.cc:256] RPC call timeout handler was delayed by -2.6492297960000997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:19:36.711820  4261 connection.cc:256] RPC call timeout handler was delayed by -2.5231960430000981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 13:19:36.712234  4261 connection.cc:256] RPC call timeout handler was delayed by -2.5096960430000763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260709 13:19:36.676647  7341 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:36.614807  7264 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:36.723875  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.698905  7144 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:36.734949  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.634845  7363 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:19:36.696909  7392 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:36.720216  7362 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.771103  4217 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:19:36.771557  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:36.771919  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:36.772652  4218 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:36.771564  4221 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:36.745476  7341 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:36.755618  7363 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:36.806229  4893 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.108s (SENT)
I20260709 13:19:36.807125  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:36.812077  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:36.835245  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 98919.9us
I20260709 13:19:36.756595  7376 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:19:36.802546  7281 consensus_meta.cc:287] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.712s	user 0.016s	sys 0.000s
W20260709 13:19:36.836095  4261 leader_election.cc:336] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.627s (SENT)
I20260709 13:19:36.849382  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:36.786770  7425 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.860162  7350 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:36.860508  7425 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:36.867182  7412 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.264s	user 0.002s	sys 0.000s
W20260709 13:19:36.870172  7413 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:36.854561  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:36.871111  7376 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:36.871752  7376 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:36.855923  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:36.873939  4292 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:36.801548  7363 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:36.817497  7359 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.834683  6795 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:36.893072  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.858315  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.877358  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.765470  7362 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:36.848706  7367 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:36.887394  7350 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:36.872844  7376 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:36.837348  7345 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:37.001099  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 129131us
W20260709 13:19:36.889807  7417 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:19:37.031062  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 465193us
I20260709 13:19:36.883096  7425 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:37.030066  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 193973us
I20260709 13:19:36.781445  7392 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:37.042908  4261 leader_election.cc:336] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.639s (SENT)
I20260709 13:19:36.884471  7390 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:37.017483  7379 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:19:37.033521  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 439338us
I20260709 13:19:37.060209  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:37.064321  4292 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
W20260709 13:19:37.105271  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.118533  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.005061  6795 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:37.057502  7320 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:37.068666  7376 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.001915  7359 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:37.185210  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 87007.7us
I20260709 13:19:36.888305  7363 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:37.163177  7382 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:19:37.062273  7390 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:37.148886  7345 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:19:37.017896  7341 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:37.224921  7264 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:37.309170  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 266238us
W20260709 13:19:37.342399  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.340238  4261 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.670s (SENT)
I20260709 13:19:37.352528  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:37.358906  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 302971us
W20260709 13:19:37.387252  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.313302  7363 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:37.372231  4187 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.519s (SENT)
W20260709 13:19:37.417352  7440 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:19:37.349267  7431 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:19:37.427601  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.439193  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 67056.3us
W20260709 13:19:37.440114  4187 leader_election.cc:336] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.597s (SENT)
I20260709 13:19:37.439972  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:37.440809  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:37.442425  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.515024  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:37.515981  4218 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:19:37.518601  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:37.523059  7279 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.919s	user 0.014s	sys 0.002s
I20260709 13:19:37.541782  7359 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:37.545011  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 104955us
W20260709 13:19:37.545753  4187 connection.cc:256] RPC call timeout handler was delayed by -1.2091514060000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:19:37.551266  4187 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.054s (SENT)
W20260709 13:19:37.523443  7388 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:19:37.567865  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:37.562467  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 249763us
I20260709 13:19:37.519935  7350 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:37.519495  7362 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:37.576579  4928 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:37.579053  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:37.541882  7279 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.543695  7267 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.635123  4112 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:37.640923  7264 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:37.641726  7264 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:37.642239  7437 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:19:37.642266  7264 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.648797  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 441) took 1089 ms. Trace:
I20260709 13:19:37.649554  4220 rpcz_store.cc:276] 0709 13:19:36.558932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.559045 (+   113us) service_pool.cc:224] Handling call
0709 13:19:36.587187 (+ 28142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:36.606615 (+ 19428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.606672 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.607419 (+   747us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.031958 (+424539us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:37.032004 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.032078 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:37.648270 (+616192us) raft_consensus.cc:1685] finished
0709 13:19:37.648395 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.648659 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25253,"raft.queue_time_us":66803,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":16856,"thread_start_us":363339,"threads_started":1,"wal-append.queue_time_us":548435}
I20260709 13:19:37.635428  7362 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:37.649951  7389 consensus_meta.cc:287] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.060s	user 0.007s	sys 0.011s
I20260709 13:19:37.595053  7350 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:37.672453  7281 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:37.711623  7281 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:37.713503  7281 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:37.715444  7281 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.677043  7446 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:37.719455  7350 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:37.680138  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 367021us
I20260709 13:19:37.680295  7374 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:37.682585  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.722934  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:37.723945  4222 raft_consensus.cc:2410] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:37.659395  6795 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:37.724684  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:37.726294  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:37.728456  7419 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.153s	user 0.010s	sys 0.000s
W20260709 13:19:37.687848  7144 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.000s
I20260709 13:19:37.667784  7389 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:37.691542  7356 consensus_meta.cc:287] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.325s	user 0.014s	sys 0.002s
I20260709 13:19:37.666980  7458 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:19:37.692747  7457 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:37.697194  4292 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:37.701097  7407 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:37.710104  7377 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.509s	user 0.018s	sys 0.004s
W20260709 13:19:37.745771  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 166823us
I20260709 13:19:37.628968  7279 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:37.720260  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:37.720872  4261 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.802s (SENT)
I20260709 13:19:37.730612  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:37.708038  7436 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
W20260709 13:19:37.697222  7452 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:19:37.782377  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.784917  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:37.747110  4187 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.415s (SENT)
I20260709 13:19:37.751068  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:37.761366  7455 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:19:37.761809  4928 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:37.762039  7414 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.946s	user 0.008s	sys 0.007s
I20260709 13:19:37.751703  7407 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:37.810704  7407 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:37.811688  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 440) took 1253 ms. Trace:
I20260709 13:19:37.746685  7356 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:19:37.811833  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:37.778287  7362 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.813977  7362 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.814098  4292 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:37.814440  7362 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.811954  7407 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:37.833166  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 112334us
I20260709 13:19:37.741813  7144 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:37.769557  7418 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.966s	user 0.007s	sys 0.008s
I20260709 13:19:37.815281  4219 rpcz_store.cc:276] 0709 13:19:36.558505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.558633 (+   128us) service_pool.cc:224] Handling call
0709 13:19:36.587506 (+ 28873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:36.587898 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.587927 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.597758 (+  9831us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.031066 (+433308us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:37.031113 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.031211 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:37.707109 (+675898us) spinlock_profiling.cc:243] Waited 8.83 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:37.786468 (+ 79359us) raft_consensus.cc:1685] finished
0709 13:19:37.786492 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.811578 (+ 25086us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17186,"raft.queue_time_us":69925,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":17596,"spinlock_wait_cycles":20299520,"thread_start_us":420124,"threads_started":1,"wal-append.queue_time_us":675168}
I20260709 13:19:37.834102  7356 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.847396  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:37.844702  7341 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:19:37.761090  4042 catalog_manager.cc:5697] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:37.768270  7390 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:37.856318  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.594s (SENT)
I20260709 13:19:37.853950  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2092) took 1043 ms. Trace:
I20260709 13:19:37.770407  7389 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:37.816799  7374 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:37.877010  4110 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:37.862334  4288 rpcz_store.cc:276] 0709 13:19:36.810622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.810769 (+   147us) service_pool.cc:224] Handling call
0709 13:19:36.849514 (+ 38745us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:36.996879 (+147365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.996932 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:37.012159 (+ 15227us) log.cc:844] Serialized 52 byte log entry
0709 13:19:37.385648 (+373489us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:37.385723 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.385845 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:37.853694 (+467849us) raft_consensus.cc:1685] finished
0709 13:19:37.853718 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.853877 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144008,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":24875,"spinlock_wait_cycles":12928,"thread_start_us":301434,"threads_started":1,"wal-append.queue_time_us":471543}
W20260709 13:19:37.882019  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.771929  7346 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:19:37.755839  7377 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:37.882723  4186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.014s	sys 0.035s
I20260709 13:19:37.883782  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:37.895116  4186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.015s	sys 0.035s
I20260709 13:19:37.895895  4221 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:37.887755  4261 leader_election.cc:336] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.848s (SENT)
I20260709 13:19:37.897354  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:37.898720  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:37.854482  7356 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:37.896248  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 833472us
W20260709 13:19:37.886529  4893 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.667s (SENT)
I20260709 13:19:37.902290  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:37.899600  4922 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:37.904489  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:37.875521  7458 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.917659  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2103) took 1089 ms. Trace:
I20260709 13:19:37.888140  7279 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:37.884044  7460 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.892107  7390 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:37.935345  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:37.940176  4216 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:37.941269  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:37.943892  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:37.907835  7356 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.911257  7359 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.914651  7389 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:37.921062  7434 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:37.952531  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:37.952847  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65151.9us
I20260709 13:19:37.915987  7350 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:19:37.947702  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 200615us
W20260709 13:19:37.938402  7363 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.006s
I20260709 13:19:37.952392  7279 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:37.962682  4186 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:37.974797  7427 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.937s	user 0.000s	sys 0.006s
I20260709 13:19:37.970028  7390 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:37.975286  4261 leader_election.cc:336] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.963s (SENT)
I20260709 13:19:37.975864  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:37.975600  7264 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:37.959182  7376 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.766s	user 0.016s	sys 0.002s
I20260709 13:19:37.979310  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:37.935958  7458 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:37.968796  6795 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:37.989626  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:37.995831  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:37.997258  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 87535.1us
W20260709 13:19:38.000536  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.771s (SENT)
I20260709 13:19:37.977550  7408 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.005642  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.007069  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.008069  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.011113  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.017285  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.017661  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.021306  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.026569  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:37.993209  7433 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:38.030444  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 86647us
W20260709 13:19:38.032656  4187 leader_election.cc:336] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.736s (SENT)
W20260709 13:19:38.033373  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.033337  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:37.998317  6795 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.993636  7463 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.044919  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.045835  4296 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:38.045921  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 70732.8us
I20260709 13:19:37.977833  7350 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:38.028093  4213 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:38.041574  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.042109  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.049166  4289 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:38.053933  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.910s (SENT)
I20260709 13:19:38.016816  7376 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:38.059367  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:38.059885  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 107465us
I20260709 13:19:38.024112  7279 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.063220  4290 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:38.063620  4261 connection.cc:256] RPC call timeout handler was delayed by -2.46562979600003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:19:38.046536  6795 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.039593  7390 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:38.077940  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:38.095386  4893 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.035s (SENT)
I20260709 13:19:38.096482  7458 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:38.098451  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.100893  7439 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:38.101649  7439 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:38.106318  7264 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:38.072582  7376 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:38.113188  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 80600.8us
I20260709 13:19:38.113619  7376 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:38.114324  4187 leader_election.cc:336] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.770s (SENT)
I20260709 13:19:38.116648  7449 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:38.119056  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.120582  4922 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:38.123282  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.126071  7377 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:38.107635  4261 connection.cc:256] RPC call timeout handler was delayed by -2.4529960429999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260709 13:19:38.094725  7392 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.144466  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:38.145596  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 84814.6us
I20260709 13:19:38.149546  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:38.150616  4214 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.152550  4111 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:38.153064  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:38.153617  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.106880  7350 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:38.161079  4261 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.225s (SENT)
I20260709 13:19:38.164314  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:38.143045  7439 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:38.167905  7392 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:38.173556  7392 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:38.174043  7392 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.177600  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:38.180815  4261 leader_election.cc:336] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.276s (SENT)
W20260709 13:19:38.181720  4261 connection.cc:256] RPC call timeout handler was delayed by -2.4394960429999628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:19:38.182260  4261 leader_election.cc:336] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.310s (SENT)
W20260709 13:19:38.183400  4261 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.611s (SENT)
I20260709 13:19:38.183774  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:38.156123  7430 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:19:38.192765  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:38.201508  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:38.204494  7281 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.161842  7421 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:38.198958  7454 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.190419  7363 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.176249  7356 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:38.195757  7359 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:38.216693  4214 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:38.226894  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:38.220767  7264 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:38.215005  7281 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.253790  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:38.258069  4261 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.909s (SENT)
I20260709 13:19:38.200579  7449 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:19:38.264070  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 71820.4us
I20260709 13:19:38.235006  7144 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:38.265933  7279 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:38.240583  7458 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:38.269449  7476 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:38.277606  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:38.281049  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.281510  4138 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:38.281806  4146 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:38.283046  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.283159  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.284549  7077 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:38.285187  7077 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:38.285648  4261 connection.cc:256] RPC call timeout handler was delayed by -2.3153297960000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 13:19:38.286077  4261 connection.cc:256] RPC call timeout handler was delayed by -2.2712297959999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 13:19:38.286374  4261 connection.cc:256] RPC call timeout handler was delayed by -2.25682979599992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 13:19:38.286696  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8284297959999094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2725s for a response
I20260709 13:19:38.287657  7077 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:38.288546  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.289212  7390 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.289578  4145 raft_consensus.cc:2376] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 9. Re-sending same reply.
I20260709 13:19:38.290215  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.290825  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.291653  4144 raft_consensus.cc:2368] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6.
I20260709 13:19:38.251910  7264 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:38.293269  7264 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.293431  7127 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:38.294098  4187 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.788s (SENT)
I20260709 13:19:38.294117  7127 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:38.295156  4187 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.859s (SENT)
W20260709 13:19:38.296054  4187 leader_election.cc:336] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.891s (SENT)
W20260709 13:19:38.297125  4187 leader_election.cc:336] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.902s (SENT)
W20260709 13:19:38.297232  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.297120  7127 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:38.298501  4187 leader_election.cc:336] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.037s (SENT)
I20260709 13:19:38.298696  7356 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:38.299814  4187 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.177s (SENT)
I20260709 13:19:38.230089  7359 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.275681  7458 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:38.318423  7458 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.318605  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.319612  4145 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:38.319840  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.320518  4147 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:38.320596  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.320849  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.321452  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.321693  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.321977  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.321630  4138 raft_consensus.cc:2368] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8.
I20260709 13:19:38.322072  4147 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
W20260709 13:19:38.324213  7436 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:19:38.339414  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.340245  4146 raft_consensus.cc:2368] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8.
W20260709 13:19:38.340647  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 75534.7us
I20260709 13:19:38.341202  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.341470  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.342208  4142 raft_consensus.cc:2368] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6.
I20260709 13:19:38.338539  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.343366  4143 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.260937  7281 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.360881  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.364248  7483 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:38.365052  7483 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:38.365953  7281 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:38.367492  7483 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:38.370909  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.336774  7480 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.376051  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:38.351361  7362 consensus_meta.cc:287] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.536s	user 0.015s	sys 0.009s
I20260709 13:19:38.343765  7279 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.375106  6795 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:38.377729  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:38.384907  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.385572  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.385874  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.387528  4145 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:38.347245  7408 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.393888  7458 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:38.392270  7460 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:38.416982  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.398406  7392 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:38.416556  4144 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:38.400563  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.401134  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:38.417119  4287 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:38.403566  4216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 432) took 2035 ms (client timeout 1722 ms). Trace:
I20260709 13:19:38.403987  4139 raft_consensus.cc:2368] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 6.
I20260709 13:19:38.417658  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:38.404145  4215 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:38.430294  4216 rpcz_store.cc:269] 0709 13:19:36.368196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.368424 (+   228us) service_pool.cc:224] Handling call
0709 13:19:38.403306 (+2034882us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54002f0154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:38.403460 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3295724800}
I20260709 13:19:38.433678  4140 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:38.407608  4143 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:38.410722  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.411079  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.436455  4142 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:38.437094  4138 raft_consensus.cc:2410] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:38.393679  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:38.432014  7281 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.411274  4296 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:38.437676  4928 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.439769  4145 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:38.398257  4042 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 4 to 8, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.440943  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:38.411760  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.415446  7458 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:38.409638  4147 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.929584  4293 rpcz_store.cc:276] 0709 13:19:36.827816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.044494 (+216678us) service_pool.cc:224] Handling call
0709 13:19:37.045224 (+   730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.045715 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:37.061291 (+ 15576us) log.cc:844] Serialized 14 byte log entry
0709 13:19:37.674789 (+613498us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b1800350c20. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee3bbf7a40 00007fee3bbf24e4 00007fee3bbf2455 00007fee3ecda060 00007fee3ecec716 00007fee3ecfd287 00007fee3ecfd208
0709 13:19:37.901256 (+226467us) log.cc:844] Serialized 14 byte log entry
0709 13:19:37.915735 (+ 14479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:37.915810 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:37.915858 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.917383 (+  1525us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.917574 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139137,"prepare.queue_time_us":39984,"prepare.run_cpu_time_us":161,"prepare.run_wall_time_us":20053,"raft.queue_time_us":636241,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"spinlock_wait_cycles":8617728,"thread_start_us":223617,"threads_started":1}
I20260709 13:19:38.448239  4292 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:38.401487  7279 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.401237  7362 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.423986  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:38.435765  7392 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:38.436914  4041 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 173) took 12823 ms (client timeout 15000 ms). Trace:
I20260709 13:19:38.411360  6795 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:38.393721  7359 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:38.443562  4042 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.462363  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:38.463029  4147 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:38.467118  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.472608  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:38.484475  4187 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 4.394s (SENT)
I20260709 13:19:38.485213  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:38.486639  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.489149  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.490453  4292 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:38.492782  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:38.500823  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:38.501842  4216 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.503695  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.504972  4290 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:38.506935  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:38.420814  7421 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:19:38.516206  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.518916  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.411425  7408 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:38.521286  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:38.508701  7479 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.212s	user 0.004s	sys 0.001s
I20260709 13:19:38.527289  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.525931  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.534122  4042 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 4 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 5 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:38.525318  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:38.531548  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.536999  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:38.549006  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:38.552170  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.537892  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.550683  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.556973  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.558882  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.559650  4138 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:38.498773  7426 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:38.437994  7281 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.564172  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:38.452304  4041 rpcz_store.cc:269] 0709 13:19:25.577114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.580603 (+  3489us) service_pool.cc:224] Handling call
0709 13:19:38.396177 (+12815574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:29.544891 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:29.584572 (+ 39681us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:29.584610 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:19:29.584629 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:29.595874 (+ 11245us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:29.595967 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:29.596010 (+    43us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:19:29.597719 (+  1709us) tablet.cc:701] Row locks acquired
0709 13:19:29.597744 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:19:29.597923 (+   179us) write_op.cc:270] Start()
0709 13:19:29.598068 (+   145us) write_op.cc:276] Timestamp: P: 1783603169597866 usec, L: 0
0709 13:19:29.598092 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:19:29.654663 (+ 56571us) log.cc:844] Serialized 8233 byte log entry
0709 13:19:29.973545 (+318882us) op_driver.cc:464] REPLICATION: finished
0709 13:19:30.129927 (+156382us) write_op.cc:301] APPLY: starting
0709 13:19:30.139281 (+  9354us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:30.241862 (+102581us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:30.242015 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:30.244464 (+  2449us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:30.244935 (+   471us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:19:30.244986 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:30.245574 (+   588us) log.cc:844] Serialized 144 byte log entry
0709 13:19:30.269166 (+ 23592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:30.281876 (+ 12710us) write_op.cc:454] Released schema lock
0709 13:19:30.284620 (+  2744us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:30.291283 (+  6663us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:30.291322 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":165796,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":139303,"apply.run_cpu_time_us":6508,"apply.run_wall_time_us":176151,"num_ops":21,"prepare.queue_time_us":296295,"prepare.run_cpu_time_us":15428,"prepare.run_wall_time_us":164206,"raft.queue_time_us":170317,"raft.run_cpu_time_us":46277,"raft.run_wall_time_us":75070,"replication_time_us":375255,"thread_start_us":460026,"threads_started":4,"wal-append.queue_time_us":107185,"wal-append.run_cpu_time_us":38982,"wal-append.run_wall_time_us":1495898}]]}
I20260709 13:19:38.516263  6795 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.583950  4928 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:38.565819  4147 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:38.586143  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.587150  4147 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:38.566740  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.537935  4893 leader_election.cc:400] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6.
I20260709 13:19:38.567796  4923 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:38.588054  4893 leader_election.cc:403] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:19:38.589160  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 165419us
I20260709 13:19:38.533368  7473 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.570070  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.570595  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:38.570842  7430 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:38.571666  4110 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:38.572419  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.573348  7408 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:38.573896  7481 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:38.573938  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:38.597515  4143 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:38.599925  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.576165  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.595410  4216 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:19:38.523774  7407 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.525279  7458 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.486841  7434 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:19:38.568750  7340 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:38.589825  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.613497  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:38.614382  4922 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.521188  7392 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:38.598721  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.595825  4290 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:38.525508  7377 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.622723  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:38.604240  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.625411  4138 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:38.605216  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.525812  7390 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:38.605507  4042 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 6 to 8, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 8 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:38.589778  7454 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.608551  4289 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:38.609634  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:38.630162  4294 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:38.564867  7374 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.566776  7426 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:38.560787  7267 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:19:38.627921  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:38.607398  4139 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:38.603600  7345 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6.
I20260709 13:19:38.632937  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.650573  4143 raft_consensus.cc:2376] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 6. Re-sending same reply.
I20260709 13:19:38.639604  4042 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:38.651654  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.652468  4143 raft_consensus.cc:2376] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4. Re-sending same reply.
I20260709 13:19:38.653088  4293 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:38.532966  7482 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:19:38.613794  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:38.640614  4287 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:38.647109  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.655133  4145 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:38.655656  4147 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:38.656553  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.656327  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.647702  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.657310  4138 raft_consensus.cc:2376] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 6. Re-sending same reply.
I20260709 13:19:38.658584  4145 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:38.594081  6795 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.659381  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.663240  4145 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:38.666204  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:38.661461  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47758.9us
I20260709 13:19:38.660729  4147 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:38.669514  7281 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:38.670187  7281 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:38.609082  7449 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:19:38.647056  7144 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:38.672770  4042 catalog_manager.cc:5697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 5 to 8, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.674610  4145 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:38.666409  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.682324  4143 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:38.610663  7462 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 13:19:38.678578  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 145728us
I20260709 13:19:38.612888  7458 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:38.684479  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84099.2us
I20260709 13:19:38.675066  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.686334  4147 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:38.687980  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.692675  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.693821  4138 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
W20260709 13:19:38.694001  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.696564  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.698277  4147 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:38.633457  7392 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.666932  7407 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:38.709731  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.711118  4145 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:38.712631  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.716363  4143 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:19:38.700101  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.702085  4042 catalog_manager.cc:5697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.638926  7377 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.652462  7390 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.687423  7144 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:38.733800  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 162205us
W20260709 13:19:38.734781  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50278.4us
I20260709 13:19:38.735067  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:38.740770  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.741619  4138 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.743873  4145 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:38.768283  4147 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
W20260709 13:19:38.777962  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 62898.8us
I20260709 13:19:38.783823  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.784724  4143 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:38.713826  7407 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:38.782825  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.742615  7144 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.803851  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.804731  4147 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:38.806134  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.807206  4147 raft_consensus.cc:2368] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:19:38.808496  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.809329  4138 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:38.809602  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:38.784791  7314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.030s	sys 0.026s
I20260709 13:19:38.776372  7359 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.827373  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.837709  4294 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:19:38.838824  7314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.031s	sys 0.027s
I20260709 13:19:38.839159  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:38.839911  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:38.839911  4294 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:38.837668  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:38.842603  4294 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:19:38.787412  7407 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.834504  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:38.768378  7345 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:19:38.842872  4187 leader_election.cc:400] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
W20260709 13:19:38.843732  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.844211  4294 pending_rounds.cc:85] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 4
I20260709 13:19:38.849766  4294 pending_rounds.cc:107] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:38.849464  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:38.786274  7281 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:19:38.850142  4294 raft_consensus.cc:2889] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.830313  4147 raft_consensus.cc:2368] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6.
I20260709 13:19:38.810608  7498 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.852807  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.857553  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:38.865171  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.869576  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.870589  4140 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:38.857316  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.874185  4138 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:38.881994  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.884701  4140 raft_consensus.cc:2376] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:38.885830  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:38.888986  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.886081  4143 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:38.888293  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.848560  7421 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:38.889041  4140 raft_consensus.cc:2376] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:38.897934  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.898350  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.866369  7483 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:38.880692  7464 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.804s	user 0.004s	sys 0.000s
I20260709 13:19:38.919409  4143 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:38.903445  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:38.868032  7458 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:38.923336  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.923918  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:38.924817  4928 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.891433  4147 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:19:38.926649  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.927285  4138 raft_consensus.cc:2376] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5. Re-sending same reply.
I20260709 13:19:38.926666  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.928169  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.928784  4138 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:38.929051  4147 raft_consensus.cc:2410] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:38.929744  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.933637  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.936758  4138 raft_consensus.cc:2376] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:38.938143  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:38.945266  4140 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 4: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:38.900184  7421 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:19:38.922411  7495 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:19:38.907912  7483 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:38.961267  4922 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:38.959978  4928 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:38.942448  7264 consensus_meta.cc:287] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.004s
I20260709 13:19:38.960577  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:38.960484  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 134021us
I20260709 13:19:38.961366  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.965624  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:38.962253  4925 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:19:38.966257  4143 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:38.957845  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.966015  4921 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:19:38.963553  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.964744  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:38.968319  4147 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:38.968915  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:38.959342  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.979866  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:38.952713  7421 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.988052  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.994766  4143 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:38.989085  4140 raft_consensus.cc:2393] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:38.989571  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:38.971626  7264 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:38.991613  4216 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:38.970844  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:38.997730  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:38.998226  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.838s (SENT) [suppressed 51 similar messages]
I20260709 13:19:38.998651  4213 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:38.949388  6795 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:38.997810  4147 raft_consensus.cc:2376] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:38.992784  4185 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:39.000430  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.004787  4140 raft_consensus.cc:2410] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:38.964458  7483 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:39.007324  4214 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:39.010190  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:39.013724  4140 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:38.970152  7449 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:39.015007  4147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:38.882644  7498 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.015605  4140 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:39.025326  4147 raft_consensus.cc:606] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.025828  4147 raft_consensus.cc:614] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:39.027423  4143 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:39.031745  7390 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.033311  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2105) took 1793 ms. Trace:
I20260709 13:19:39.034011  7449 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:39.033809  4291 rpcz_store.cc:276] 0709 13:19:37.240081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.240278 (+   197us) service_pool.cc:224] Handling call
0709 13:19:37.284370 (+ 44092us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:37.679718 (+395348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.679749 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:37.680497 (+   748us) log.cc:844] Serialized 52 byte log entry
0709 13:19:37.906643 (+226146us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:37.906694 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.907619 (+   925us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.679233 (+771614us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:39.032933 (+353700us) raft_consensus.cc:1685] finished
0709 13:19:39.032960 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.033241 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":394716,"raft.queue_time_us":395052,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":148,"spinlock_wait_cycles":17297792,"thread_start_us":225678,"threads_started":1,"wal-append.queue_time_us":342832}
I20260709 13:19:39.004616  7392 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.035784  7449 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:39.036741  4292 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:39.037915  7506 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.607642  7473 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.039991  4138 raft_consensus.cc:2410] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:39.041138  7473 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.007539  7433 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:38.738472  7426 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:39.058276  4290 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:39.008419  7377 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.016105  6795 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:39.016281  7502 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:39.073149  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 102428us
W20260709 13:19:39.068912  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 70701.4us
I20260709 13:19:39.064584  7433 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.076066  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.093021  7279 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.085552  7433 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:39.103189  4261 leader_election.cc:336] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.916s (SENT)
I20260709 13:19:39.110028  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:39.113032  7264 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.114130  4144 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:39.116536  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.125465  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.128818  7264 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:39.129406  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 46029us
I20260709 13:19:39.130334  7264 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.132670  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.136824  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:39.137380  7501 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:19:39.137881  7359 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.141736  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.143077  7362 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.143204  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.143947  7362 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.144639  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.145474  4144 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:19:39.165438  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.145584  7454 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:39.172158  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:39.173190  7359 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:39.173713  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:39.146589  4141 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:39.127303  7507 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:39.152585  7498 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.158273  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:39.162055  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 445) took 1460 ms. Trace:
I20260709 13:19:39.182313  4215 rpcz_store.cc:276] 0709 13:19:37.701169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.704060 (+  2891us) service_pool.cc:224] Handling call
0709 13:19:38.403784 (+699724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.432109 (+ 28325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.161780 (+729671us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54002f0150. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:39.161981 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608339840}
I20260709 13:19:39.146611  7460 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:39.176003  7496 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.179144  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:39.184501  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.187556  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:39.204311  7498 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:39.211146  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:39.212594  4111 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.213809  7502 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.214218  7502 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.214577  7502 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:39.214865  7499 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
I20260709 13:19:39.216691  7267 consensus_queue.cc:1059] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:39.218093  7267 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:39.218540  7267 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:39.176618  7279 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:39.190491  7497 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.286s	user 0.006s	sys 0.000s
W20260709 13:19:39.231876  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47575.7us
I20260709 13:19:39.237939  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:39.184947  7359 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:39.219527  7267 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:39.202555  7363 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.246730  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:39.249266  4215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:39.208197  7094 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:19:39.230852  7460 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:39.256687  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:39.250512  4215 raft_consensus.cc:606] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.265755  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:39.251772  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:39.240031  7504 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.256255  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:39.268136  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:19:39.274386  4187 leader_election.cc:336] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.222s (SENT)
I20260709 13:19:39.278101  7363 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.278663  7363 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.279033  7363 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.282187  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:39.253500  7267 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:39.253266  7374 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.254040  7264 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:39.280573  7454 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.276286  4187 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.291404  4112 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.291857  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:39.235057  7507 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:19:39.305119  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:39.308531  4292 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:39.319439  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:39.323355  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.340095  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:39.341269  4289 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:39.326972  7460 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:39.326839  7496 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:39.358589  4292 raft_consensus.cc:2410] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:39.370318  7449 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:39.288504  7433 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:39.333340  7374 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:39.377501  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.304162  7346 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:19:39.301128  7341 consensus_queue.cc:1059] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:19:39.381678  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 107349us
I20260709 13:19:39.293358  7381 consensus_queue.cc:1059] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:19:39.306893  7483 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:39.393771  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.297013  7505 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 13:19:39.386942  7489 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.648s	user 0.003s	sys 0.003s
I20260709 13:19:39.414691  7408 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:39.415289  7408 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:39.415381  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 287) took 1133 ms. Trace:
I20260709 13:19:39.416059  4141 rpcz_store.cc:276] 0709 13:19:38.282099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.282230 (+   131us) service_pool.cc:224] Handling call
0709 13:19:39.415157 (+1132927us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400077454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:39.415307 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967840512}
I20260709 13:19:39.417443  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.418357  4141 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:39.419337  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:39.420140  4141 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:39.421408  7512 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:19:39.421500  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.422559  4140 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:39.423465  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.425208  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.425976  4147 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:39.426923  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.417443  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.427523  4147 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:39.429649  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.430153  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.431042  4147 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:39.424134  4140 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:39.455685  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 302) took 1112 ms. Trace:
I20260709 13:19:39.428223  4139 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:39.390120  7496 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:39.456192  4142 rpcz_store.cc:276] 0709 13:19:38.343219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.344702 (+  1483us) service_pool.cc:224] Handling call
0709 13:19:38.436012 (+ 91310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.436885 (+   873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.455443 (+1018558us) spinlock_profiling.cc:243] Waited 85.4 ms on lock 0x7b5400265a50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:39.455618 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196476288}
I20260709 13:19:39.469095  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.469985  4146 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:19:39.482239  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:39.468672  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 72526.5us
W20260709 13:19:39.473925  7144 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.005s
I20260709 13:19:39.512291  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:39.517079  7496 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.521095  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1753) took 1126 ms. Trace:
I20260709 13:19:39.555608  4138 rpcz_store.cc:276] 0709 13:19:38.394923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.957410 (+562487us) service_pool.cc:224] Handling call
0709 13:19:39.520837 (+563427us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b540010fc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:39.521021 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166728448}
I20260709 13:19:39.557392  4138 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:39.559948  4138 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:19:39.524835  7523 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.560724  7523 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.562614  4921 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:39.563194  7523 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:39.530265  7433 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:39.565562  7279 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.541900  4141 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:39.550805  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:39.567320  4925 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:39.486647  7407 consensus_meta.cc:287] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.003s
I20260709 13:19:39.568568  4138 pending_rounds.cc:85] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 3
I20260709 13:19:39.572278  4145 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:19:39.576617  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 92706.1us
W20260709 13:19:39.583638  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 189950us
I20260709 13:19:39.540251  7483 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:39.569252  7421 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.007s
I20260709 13:19:39.566210  7279 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.587594  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.579821  7523 consensus_queue.cc:1059] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:19:39.593995  7537 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:39.605755  4288 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:39.568923  7144 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.609822  4147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40b291caa9a64e83948693294f96069d"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:39.627333  4147 raft_consensus.cc:606] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.627866  4147 raft_consensus.cc:614] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:39.585034  7503 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.611858  4143 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:19:39.631999  4143 pending_rounds.cc:85] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 5
I20260709 13:19:39.632316  4143 pending_rounds.cc:107] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:19:39.632644  4143 raft_consensus.cc:2889] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.572326  4138 pending_rounds.cc:107] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:39.634756  4138 raft_consensus.cc:2889] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.613972  4145 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:39.615422  4290 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:39.618726  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 336602us
I20260709 13:19:39.622839  4925 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:19:39.574541  7390 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.577090  7473 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.636140  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:19:39.638024  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50540.5us
I20260709 13:19:39.644304  4138 pending_rounds.cc:107] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:39.644848  4138 raft_consensus.cc:2889] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.646272  4187 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:39.649935  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:39.651813  7523 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:39.654830  7523 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.655546  7523 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:39.658385  4144 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:39.659017  4144 pending_rounds.cc:85] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 5
I20260709 13:19:39.659349  4144 pending_rounds.cc:107] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:39.659677  4144 raft_consensus.cc:2889] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.656129  7523 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.654294  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:39.614154  7314 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:39.664160  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:39.625005  7537 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:39.578329  7407 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:39.736901  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 72816.8us
W20260709 13:19:39.739332  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 75438.2us
I20260709 13:19:39.686269  4147 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:39.743003  4147 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:39.669109  7522 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:39.746629  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 92452.8us
I20260709 13:19:39.748833  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:39.662747  7077 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:39.772171  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:39.773175  4142 raft_consensus.cc:606] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:19:39.773573  4142 raft_consensus.cc:614] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:39.773855  7526 consensus_queue.cc:1059] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:39.746263  7449 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:39.765741  7500 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.757s	user 0.003s	sys 0.002s
I20260709 13:19:39.771561  7430 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:39.779367  4143 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:39.644429  7356 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:39.617143  7421 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.720777  7314 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:39.715279  7144 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:39.814765  7530 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:39.881384  7530 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:39.819501  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:39.821592  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.822216  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:39.885023  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 62917.8us
W20260709 13:19:39.831645  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.736055  7537 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:39.845978  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 106927us
I20260709 13:19:39.657155  7390 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.894762  4220 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:39.846575  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.668790  6795 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:39.857924  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 109250us
I20260709 13:19:39.758189  7374 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:39.662758  7473 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.880110  7532 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:39.734675  7363 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.901722  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:39.890228  7507 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:39.903419  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:39.872313  7522 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:39.908735  4143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:39.959265  4143 raft_consensus.cc:606] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:39.959717  4143 raft_consensus.cc:614] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:39.916550  4147 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:39.910693  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:39.896657  4031 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a35e1cee8a15436dbfaf75dd67824aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 32ebd3bc4af5446f94d9f3ac7c8cf53c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:39.960915  4144 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
W20260709 13:19:39.961516  4031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 135464us
I20260709 13:19:39.902387  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:39.920081  4215 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:39.925236  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:39.925776  7426 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:39.926673  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:39.644747  7503 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:39.979182  4147 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:39.918433  6795 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:39.982913  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 80669.9us
I20260709 13:19:39.990338  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:39.869237  7356 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:40.003046  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:39.995497  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:40.035377  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:39.896946  7462 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:19:39.898403  7127 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:19:39.917831  7532 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:40.057487  4219 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:39.991787  7434 raft_consensus.cc:3055] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:39.995839  7144 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:40.141644  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1807) took 1173 ms. Trace:
I20260709 13:19:40.142680  4220 rpcz_store.cc:276] 0709 13:19:38.967974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.968114 (+   140us) service_pool.cc:224] Handling call
0709 13:19:38.968433 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.897185 (+928752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.141211 (+244026us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54000258d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:40.141524 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129842944}
I20260709 13:19:39.989364  7507 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:40.151367  4214 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:40.180059  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 177127us
I20260709 13:19:40.205742  4139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:40.206779  4139 raft_consensus.cc:606] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:40.207226  4139 raft_consensus.cc:614] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.210865  7456 raft_consensus.cc:3055] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:40.211614  7456 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:40.212965  7456 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:40.214318  7456 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:40.217669  7390 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:40.221242  7421 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:40.223878  7356 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:40.154446  7144 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:40.225598  7144 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:40.228844  7374 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:40.229710  7374 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:40.233229  7407 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:40.234313  7279 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:39.980060  7314 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:40.237577  7314 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:40.095192  7532 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:40.263594  4141 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:40.267230  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:40.272912  4145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.005s	sys 0.007s
W20260709 13:19:40.273540  4145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.005s	sys 0.007s
W20260709 13:19:40.145995  4290 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.007s	sys 0.005s
I20260709 13:19:40.148022  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:40.037317  7496 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.277489  4290 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.007s	sys 0.006s
I20260709 13:19:40.284266  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:40.285923  4220 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:39.988260  7522 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:40.329957  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:40.332863  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:39.920395  7530 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:40.141939  7434 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:40.354739  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:40.333457  7340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.022s	sys 0.070s
I20260709 13:19:40.327219  7279 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:40.303954  7363 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:40.381083  4295 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.109s	sys 0.210s
W20260709 13:19:40.381655  4295 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.109s	sys 0.210s
I20260709 13:19:40.339152  7374 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:40.390403  4186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.008s	sys 0.005s
W20260709 13:19:40.391551  4186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.009s	sys 0.005s
W20260709 13:19:40.392373  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 623565us
W20260709 13:19:40.385284  7487 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.007s	sys 0.007s
W20260709 13:19:40.399031  7487 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.008s	sys 0.007s
W20260709 13:19:40.375694  7340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.023s	sys 0.070s
I20260709 13:19:40.420315  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:40.421370  4139 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:40.386583  4138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.011s	sys 0.002s
W20260709 13:19:40.426918  4138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.011s	sys 0.002s
W20260709 13:19:40.385881  4146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.006s	sys 0.008s
W20260709 13:19:40.428398  4146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.006s	sys 0.008s
I20260709 13:19:40.402370  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:40.329130  7496 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:40.510538  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 85175.4us
I20260709 13:19:40.512780  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:40.517342  4112 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:40.520938  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:40.399649  7077 consensus_meta.cc:287] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.618s	user 0.012s	sys 0.001s
W20260709 13:19:40.332983  7515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.004s	sys 0.009s
W20260709 13:19:40.396091  7451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.004s	sys 0.008s
W20260709 13:19:40.453812  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.416889  7480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.045s	sys 0.042s
W20260709 13:19:40.531991  4142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.004s	sys 0.010s
W20260709 13:19:40.532670  4142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.005s	sys 0.010s
W20260709 13:19:40.443449  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.534951  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.535602  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.384260  7530 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:40.542598  4185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.006s	sys 0.010s
W20260709 13:19:40.543197  4185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.006s	sys 0.010s
I20260709 13:19:40.387020  7381 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:40.525396  7515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.024s	sys 0.029s
W20260709 13:19:40.530176  7451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.004s	sys 0.009s
I20260709 13:19:40.525308  7077 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:40.541018  7480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.046s	sys 0.042s
I20260709 13:19:40.527849  7498 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:40.578603  7518 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:40.414382  7363 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:40.553606  7536 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:19:40.554947  7374 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:40.567792  7390 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:40.593416  4287 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.003s	sys 0.010s
I20260709 13:19:40.559127  7381 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:40.596911  7381 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:40.599574  4293 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:40.585984  4147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.045s	sys 0.093s
W20260709 13:19:40.603713  4147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.046s	sys 0.093s
I20260709 13:19:40.384465  7279 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:40.609611  4294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.020s	sys 0.020s
I20260709 13:19:40.581761  7473 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:40.588930  7267 consensus_meta.cc:287] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.298s	user 0.010s	sys 0.006s
W20260709 13:19:40.612810  4294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.021s	sys 0.020s
I20260709 13:19:40.403335  7507 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:40.594542  7374 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:40.641036  4139 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:40.646647  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:40.648108  4288 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.003s	sys 0.008s
W20260709 13:19:40.653786  4288 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.004s	sys 0.008s
W20260709 13:19:40.594792  4287 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.003s	sys 0.010s
I20260709 13:19:40.571765  4142 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:40.622210  7504 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:40.592562  7363 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:40.645955  7502 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.431s	user 0.013s	sys 0.005s
W20260709 13:19:40.672425  4143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.011s
W20260709 13:19:40.681375  4143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.008s	sys 0.011s
I20260709 13:19:40.531394  7434 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:40.652696  7374 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.697119  4185 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:40.698596  4259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.016s	sys 0.030s
W20260709 13:19:40.698982  4259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.016s	sys 0.030s
I20260709 13:19:40.699572  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1984) took 1323 ms. Trace:
I20260709 13:19:40.705174  4213 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:40.710649  7363 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:40.712201  4921 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:40.721943  7279 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:40.732718  7546 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:40.671375  7473 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:40.769531  7395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.001s	sys 0.031s
I20260709 13:19:40.700013  4295 rpcz_store.cc:276] 0709 13:19:39.375849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.376050 (+   201us) service_pool.cc:224] Handling call
0709 13:19:39.376508 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.377278 (+   770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.377309 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.377848 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.616993 (+239145us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.382111 (+765118us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.699251 (+317140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.699335 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.699386 (+    51us) raft_consensus.cc:1685] finished
0709 13:19:40.699397 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.699516 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339,"prepare.queue_time_us":571769,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":11884,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8172,"thread_start_us":1273826,"threads_started":3,"wal-append.queue_time_us":362162}
I20260709 13:19:40.688823  7503 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:40.736403  7551 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:19:40.735152  7549 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:40.695748  7502 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:40.764074  7522 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:40.811628  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2157) took 1206 ms. Trace:
W20260709 13:19:40.763392  7541 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:19:40.887413  4291 rpcz_store.cc:276] 0709 13:19:39.605159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.608476 (+  3317us) service_pool.cc:224] Handling call
0709 13:19:40.810650 (+1202174us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b5800082598. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:19:40.810937 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.811230 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.811258 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.811307 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:40.811348 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.811413 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.811550 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10535296}
W20260709 13:19:40.868563  4187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.008s	sys 0.052s
I20260709 13:19:40.862362  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:40.891918  4187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.009s	sys 0.052s
I20260709 13:19:40.848573  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:40.896034  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.897090  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.898996  4261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.016s	sys 0.040s
W20260709 13:19:40.899397  4261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.016s	sys 0.040s
I20260709 13:19:40.902252  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:40.758117  7279 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.909101  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 641959us
W20260709 13:19:40.772712  7395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.001s	sys 0.031s
I20260709 13:19:40.910185  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:40.913010  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 100665us
I20260709 13:19:40.914363  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:40.915661  4139 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:40.917024  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:40.918051  4139 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:40.857067  7547 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:19:40.920140  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:40.773072  7421 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:40.938534  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.954627  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:40.955017  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:40.941027  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 426410us
I20260709 13:19:40.854400  7363 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:40.900816  7449 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.959241  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:40.905150  7496 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:40.957288  4112 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:40.767060  7473 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:40.857354  7439 consensus_queue.cc:1059] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:19:40.972534  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1914) took 2274 ms. Trace:
I20260709 13:19:40.989835  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:40.988832  4146 rpcz_store.cc:276] 0709 13:19:38.698406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.487614 (+789208us) service_pool.cc:224] Handling call
0709 13:19:39.570569 (+ 82955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.632170 (+ 61601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.632212 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.632886 (+   674us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.428998 (+796112us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:40.963520 (+534522us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.971926 (+  8406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.972069 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.972164 (+    95us) raft_consensus.cc:1685] finished
0709 13:19:40.972185 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.972437 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166827,"raft.queue_time_us":73785,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":23077,"thread_start_us":1102318,"threads_started":2,"wal-append.queue_time_us":930219}
I20260709 13:19:40.851588  7549 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.003891  4139 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:41.009029  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50222.9us
I20260709 13:19:41.027468  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:41.015694  7545 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:19:41.033469  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.904261  7279 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:41.043560  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.044651  4138 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.007s	sys 0.028s
I20260709 13:19:40.971633  7363 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.003262  7564 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:40.961827  7376 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:19:41.019057  7561 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:41.036492  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46778.2us
W20260709 13:19:41.046381  4138 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.007s	sys 0.028s
I20260709 13:19:41.057471  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.023991  7356 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:41.045512  7507 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:41.061036  7503 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:41.064024  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1946) took 1820 ms. Trace:
I20260709 13:19:40.986380  7449 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:41.055123  7426 consensus_meta.cc:287] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.065s	user 0.009s	sys 0.006s
I20260709 13:19:41.064952  4138 rpcz_store.cc:276] 0709 13:19:39.243429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.663885 (+420456us) service_pool.cc:224] Handling call
0709 13:19:39.664368 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.664866 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.664911 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.739217 (+ 74306us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.427693 (+688476us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:41.062953 (+635260us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.063271 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.063356 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.063404 (+    48us) raft_consensus.cc:1685] finished
0709 13:19:41.063421 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.063951 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4149,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":70243,"thread_start_us":1111626,"threads_started":2,"wal-append.queue_time_us":811041}
W20260709 13:19:41.064528  4145 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.018s	sys 0.027s
W20260709 13:19:41.070292  4145 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.018s	sys 0.027s
I20260709 13:19:41.099593  4146 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.087442  4923 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:41.069262  7559 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:19:41.132172  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 72812.3us
W20260709 13:19:41.104933  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 252206us
W20260709 13:19:41.111007  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 267891us
I20260709 13:19:41.067898  7498 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.080669  7555 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:41.068276  7563 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:41.154307  4138 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:41.107510  7565 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:41.063165  7561 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:41.136483  7523 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.336s	user 0.010s	sys 0.007s
I20260709 13:19:41.164630  4146 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:41.106684  7345 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.061774  7564 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:41.154289  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.130832  7390 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:41.160063  7552 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:19:41.066721  7356 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.182862  4112 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.131788  7502 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.160521  7555 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:41.220827  4031 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a35e1cee8a15436dbfaf75dd67824aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 32ebd3bc4af5446f94d9f3ac7c8cf53c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:41.224298  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.163805  7563 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.244323  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1954) took 1329 ms. Trace:
I20260709 13:19:41.246498  4147 rpcz_store.cc:276] 0709 13:19:39.914889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.985085 (+ 70196us) service_pool.cc:224] Handling call
0709 13:19:39.985592 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.985906 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.985946 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.986665 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.604334 (+617669us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:40.921253 (+316919us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.925913 (+  4660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.926045 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.243964 (+317919us) raft_consensus.cc:1685] finished
0709 13:19:41.243999 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.244224 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4187,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":15507,"thread_start_us":916034,"threads_started":2,"wal-append.queue_time_us":887699}
I20260709 13:19:41.257748  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:41.258864  4222 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.189580  7523 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.165514  7498 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.294791  7264 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:41.296036  7264 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.296762  7264 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.299898  7264 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.216761  7345 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:41.326864  7544 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.651s	user 0.006s	sys 0.000s
I20260709 13:19:41.318774  7484 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:41.185132  7460 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:19:41.318125  4215 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:19:41.320878  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.319275  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.378456  4214 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:41.180586  7567 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:19:41.224931  7571 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:41.325899  7421 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:41.251488  7563 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:41.387638  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.387814  7592 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:41.261068  7487 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:19:41.374353  7484 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:41.388482  7592 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.293560  7496 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:41.389199  7592 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:41.292371  7502 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:41.305539  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 346375us
I20260709 13:19:41.390069  7421 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.391206  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.391618  7564 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:41.389778  7484 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.390053  7502 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.393565  7484 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:41.394589  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1945) took 2151 ms. Trace:
I20260709 13:19:41.395129  7502 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.395285  4145 rpcz_store.cc:276] 0709 13:19:39.243061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.636663 (+393602us) service_pool.cc:224] Handling call
0709 13:19:39.640003 (+  3340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.663399 (+ 23396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.663435 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.663980 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.274116 (+610136us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:41.084022 (+809906us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.115917 (+ 31895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.116024 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.308253 (+192229us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:41.394222 (+ 85969us) raft_consensus.cc:1685] finished
0709 13:19:41.394341 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.394511 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43904,"prepare.queue_time_us":797018,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":53852,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":48695,"spinlock_wait_cycles":19555456,"thread_start_us":1296797,"threads_started":2,"wal-append.queue_time_us":898381}
W20260709 13:19:41.398200  7519 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 2.011s	user 0.014s	sys 0.006s
I20260709 13:19:41.399817  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2142) took 2245 ms. Trace:
I20260709 13:19:41.401273  6795 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.400281  4296 rpcz_store.cc:276] 0709 13:19:39.154332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.157216 (+  2884us) service_pool.cc:224] Handling call
0709 13:19:39.157599 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.157985 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.158016 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.158529 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.208999 (+ 50470us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b48002001d8. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:19:39.287691 (+ 78692us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:39.287766 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.287883 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.186567 (+1898684us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:41.399518 (+212951us) raft_consensus.cc:1685] finished
0709 13:19:41.399546 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.399709 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3330,"raft.run_cpu_time_us":2393,"raft.run_wall_time_us":45907,"spinlock_wait_cycles":20989184,"thread_start_us":82942,"threads_started":1,"wal-append.queue_time_us":195706}
I20260709 13:19:41.402619  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:41.403033  7498 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.403318  4296 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.379202  7363 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.404541  7363 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.362313  4222 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:41.306002  7579 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:41.405153  7363 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.407714  7363 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:41.353159  7565 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:19:41.376313  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:41.410318  7426 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.410437  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1929) took 2598 ms. Trace:
I20260709 13:19:41.410951  7426 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.411095  4141 rpcz_store.cc:276] 0709 13:19:38.812518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.569388 (+756870us) service_pool.cc:224] Handling call
0709 13:19:39.589619 (+ 20231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.264308 (+674689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.410136 (+1145828us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54003db154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:41.410361 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548704000}
I20260709 13:19:41.303149  7408 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.412966  7408 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:41.413375  7579 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.414371  7579 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:41.413552  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:41.414862  7504 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:41.382854  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 141271us
I20260709 13:19:41.356879  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2158) took 1751 ms. Trace:
I20260709 13:19:41.417670  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.418663  7487 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:41.416810  4292 rpcz_store.cc:276] 0709 13:19:39.605482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.608947 (+  3465us) service_pool.cc:224] Handling call
0709 13:19:41.355889 (+1746942us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b5800082598. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:19:41.356147 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.356499 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.356537 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.356583 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:41.356620 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.356690 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.356812 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10717568}
I20260709 13:19:41.421671  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:41.421479  7563 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:41.422224  7562 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.342s	user 0.002s	sys 0.000s
I20260709 13:19:41.423060  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:41.361469  7127 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.424459  7127 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.427497  7127 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.428704  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1955) took 1513 ms. Trace:
I20260709 13:19:41.423929  4292 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:41.430441  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.431370  4292 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:19:41.433274  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.434789  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:41.451561  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.452384  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:41.454730  4145 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:19:41.456257  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.429476  4143 rpcz_store.cc:276] 0709 13:19:39.915613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.988717 (+ 73104us) service_pool.cc:224] Handling call
0709 13:19:39.989129 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.989527 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.989565 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.998808 (+  9243us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.682188 (+683380us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:41.085589 (+403401us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.114328 (+ 28739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.114581 (+   253us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.428425 (+313844us) raft_consensus.cc:1685] finished
0709 13:19:41.428448 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.428634 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54806,"prepare.queue_time_us":633788,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":7499,"raft.queue_time_us":48182,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":11426,"thread_start_us":906246,"threads_started":2,"wal-append.queue_time_us":862333}
W20260709 13:19:41.416644  7557 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:41.458765  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:41.467378  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.474541  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:41.480410  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:41.471776  7563 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.377295  7279 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:41.494228  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.444326  7549 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:41.448598  7473 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.495514  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.495712  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:41.496461  7566 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:19:41.496771  7560 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.496838  7586 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:41.497649  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:41.498129  7577 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:19:41.472759  6734 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.527659  7579 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.498780  7376 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:41.466289  7314 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.228s	user 0.008s	sys 0.009s
W20260709 13:19:41.499064  7578 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:19:41.443087  7487 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:41.494688  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.501945  6795 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.509248  7561 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.327167  7555 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.487572  7460 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:41.464484  7264 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:41.473673  7526 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:41.513039  7498 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.513960  7279 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.551981  7580 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.474241  7449 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:41.517234  7574 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:19:41.518465  7523 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:41.519929  7537 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.614s	user 0.014s	sys 0.000s
W20260709 13:19:41.499586  7144 consensus_meta.cc:287] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.273s	user 0.009s	sys 0.008s
W20260709 13:19:41.487670  7456 consensus_meta.cc:287] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.271s	user 0.016s	sys 0.004s
I20260709 13:19:41.521262  7426 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:41.522162  7532 consensus_meta.cc:287] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.277s	user 0.012s	sys 0.003s
W20260709 13:19:41.523197  7575 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:19:41.485989  7127 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:19:41.525244  7596 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:41.581552  7460 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:41.528477  7571 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.389782  7496 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.531926  4296 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:41.547035  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2169) took 1781 ms. Trace:
W20260709 13:19:41.548410  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47582us
W20260709 13:19:41.548627  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58354.4us
W20260709 13:19:41.551222  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 160083us
I20260709 13:19:41.551419  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.605931  4288 rpcz_store.cc:276] 0709 13:19:39.765305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.893035 (+127730us) service_pool.cc:224] Handling call
0709 13:19:39.895993 (+  2958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.896316 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:40.654565 (+758249us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.327641 (+673076us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.546529 (+218888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.546626 (+    97us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:41.546695 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.546779 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.546947 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":290869,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":16350,"raft.queue_time_us":460152,"raft.run_cpu_time_us":669,"raft.run_wall_time_us":66120,"thread_start_us":1580361,"threads_started":4,"wal-append.queue_time_us":562992}
I20260709 13:19:41.609846  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.557543  7560 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.558143  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2168) took 1899 ms. Trace:
I20260709 13:19:41.568310  4220 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:41.579679  4925 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:41.618724  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.619261  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.633621  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.638433  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.633663  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.646061  4141 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:41.599184  7563 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.577443  6734 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.587231  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.584470  6795 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.583678  7314 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.525442  7504 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:41.663347  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.589566  7264 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.593807  7580 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.593850  7498 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.590101  7526 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.593246  7279 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.662766  7571 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.621511  7127 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:19:41.694993  7264 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:41.695595  7571 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.670676  7579 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:41.617264  7374 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.005s
I20260709 13:19:41.618739  7449 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:19:41.696707  7374 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.697041  4288 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:41.642702  7408 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:19:41.661626  7493 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:41.697839  4295 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.698117  7493 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:41.670079  7574 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:19:41.683784  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 74019.9us
I20260709 13:19:41.699398  7498 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.699796  7374 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.683741  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:41.702263  7279 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.673050  7589 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:19:41.676522  7563 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.662025  7456 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.705114  7526 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.673494  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.706180  4296 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:41.670306  7381 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:41.706965  7381 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.707376  7381 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:41.707419  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.678956  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:41.708802  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 67639.5us
I20260709 13:19:41.710129  7484 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.710789  7484 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.711192  7484 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:41.676021  7530 consensus_meta.cc:287] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.123s	user 0.014s	sys 0.004s
I20260709 13:19:41.671675  7602 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:41.713474  4216 raft_consensus.cc:2410] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:41.713991  7451 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.714337  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 462) took 1015 ms. Trace:
I20260709 13:19:41.714596  7451 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.696980  7449 consensus_queue.cc:1243] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:41.642401  7531 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:19:41.716800  7531 consensus_queue.cc:1243] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:41.675030  7487 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.598886  7144 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.699723  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.662223  7433 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.720696  4294 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:41.721102  7456 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.720966  7433 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.721616  7456 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.605481  7532 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.721550  7314 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.634809  4287 rpcz_store.cc:276] 0709 13:19:39.658340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.888098 (+229758us) service_pool.cc:224] Handling call
0709 13:19:39.888549 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.888833 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:40.657807 (+768974us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.322208 (+664401us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.557799 (+235591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.557862 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:41.557907 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.557962 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.558078 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13806,"prepare.queue_time_us":302540,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":93,"raft.queue_time_us":447360,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":196,"thread_start_us":1640705,"threads_started":4,"wal-append.queue_time_us":584456}
I20260709 13:19:41.724812  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:41.666538  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80166.2us
I20260709 13:19:41.721627  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:41.725556  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 116059us
I20260709 13:19:41.698621  7493 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:41.597618  7537 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.741370  7314 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.678488  7496 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.742507  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:41.743643  7537 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.614770  7596 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.746167  7599 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:41.746860  7599 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.734612  4289 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:41.583046  7567 consensus_queue.cc:1243] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:41.747506  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:41.747800  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.748924  4296 raft_consensus.cc:2410] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:41.739161  7607 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.739614  7376 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:41.737586  4287 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:41.692682  6734 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.750391  7607 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.751170  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.707959  6795 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.754187  7607 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:41.732950  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:41.756469  7599 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.756999  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.758785  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.755635  7596 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:41.756027  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.760013  7596 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.760504  7596 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.760917  7596 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.761842  7532 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:19:41.681555  7560 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:41.724069  7144 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.714833  4219 rpcz_store.cc:276] 0709 13:19:40.698747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.699646 (+   899us) service_pool.cc:224] Handling call
0709 13:19:40.765558 (+ 65912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.876083 (+110525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.876132 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:41.430216 (+554084us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b2c00010988. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:19:41.430709 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:19:41.556408 (+125699us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:41.571717 (+ 15309us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.590897 (+ 19180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.591030 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.713963 (+122933us) raft_consensus.cc:1685] finished
0709 13:19:41.714086 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.714271 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162804,"prepare.queue_time_us":15366,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":129198,"raft.run_cpu_time_us":551,"raft.run_wall_time_us":21119,"spinlock_wait_cycles":31227264,"thread_start_us":125164,"threads_started":1,"wal-append.queue_time_us":173094}
I20260709 13:19:41.770131  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.776192  4921 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:19:41.776681  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55149.9us
I20260709 13:19:41.777876  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.778429  7430 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:41.778867  7430 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:41.779188  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.773859  7537 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:41.780632  7560 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.781183  7560 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.781641  7560 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.784893  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:41.785825  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.722247  7456 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.784448  7526 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:41.789466  7532 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:41.789966  7532 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.790374  7532 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:41.788722  7314 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.792045  7314 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.746272  7592 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.797658  7144 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.781194  7537 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:41.807934  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.807448  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:41.810413  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 72088.3us
I20260709 13:19:41.815193  4141 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:41.816179  4112 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.779757  7430 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.798779  7567 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.799024  7374 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:41.800575  6734 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:41.827278  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.829329  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.830243  4219 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:41.825008  7279 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:41.833590  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 461) took 1937 ms. Trace:
I20260709 13:19:41.828183  7528 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.834218  4222 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:41.834226  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.834015  4293 rpcz_store.cc:276] 0709 13:19:39.897453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.646675 (+749222us) service_pool.cc:224] Handling call
0709 13:19:40.647002 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.647251 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:40.673302 (+ 26051us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.781610 (+1108308us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b18000c6160. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a 00007fee3ececa2a
0709 13:19:41.833221 (+ 51611us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.833288 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:41.833345 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.833414 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.833533 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25729,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4199,"raft.queue_time_us":84,"spinlock_wait_cycles":8764672,"thread_start_us":51279,"threads_started":1}
I20260709 13:19:41.839133  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.836651  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.838274  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.844069  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.845288  4215 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:41.829690  7504 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.847802  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.829852  7430 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:41.853396  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.853819  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.854537  4141 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:41.854769  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.854981  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.855310  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.830125  7579 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.856074  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.857187  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.832208  7279 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:41.859838  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.855569  4140 raft_consensus.cc:2376] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4. Re-sending same reply.
I20260709 13:19:41.818900  7602 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:41.860566  4214 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:41.818732  7144 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.860114  4138 raft_consensus.cc:2410] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:41.863061  4147 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:41.869778  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.870442  4147 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:41.871942  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.863842  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.861136  4141 raft_consensus.cc:2410] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:41.865731  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.830217  7567 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.850881  7504 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.835521  6734 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.878374  4293 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:41.883152  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.863135  7264 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:19:41.892329  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.895362  4138 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:41.891479  7498 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.899305  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.894445  7264 consensus_queue.cc:1243] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:41.905025  7606 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:41.906252  7484 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.907255  7597 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:41.912139  7592 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.915889  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:41.917793  7484 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.921411  7560 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.923087  7586 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:41.923820  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.925664  4290 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:41.926463  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:41.923725  7586 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.924844  7560 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.929405  7586 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.859849  7374 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:19:41.926565  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.930495  4214 pending_rounds.cc:85] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 4
I20260709 13:19:41.930852  4214 pending_rounds.cc:107] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:19:41.931231  4214 raft_consensus.cc:2889] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:41.932212  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.932703  7599 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.934329  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.934577  4296 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:41.935372  4290 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:41.935441  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.936782  4892 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:41.937146  4141 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:41.937726  7484 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:41.938190  7484 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.938378  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:41.938593  7484 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:41.940686  7381 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:41.944010  7381 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.944435  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:41.945686  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.948357  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:41.952618  7144 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.956760  6734 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:41.957502  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.958510  4290 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:41.959970  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.842489  7528 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.933314  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.962150  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:41.963018  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3086495709999326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:19:41.963433  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.963934  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.890465  7504 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.972479  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.973490  4290 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:41.968792  4141 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:41.978065  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.980525  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.899886  7579 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.967834  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.977304  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:41.897826  7498 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.936010  7599 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:41.970681  4147 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:41.984208  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:41.995165  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.992905  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:41.996565  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.997282  4147 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:41.984124  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.986152  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:41.998663  4140 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:41.971640  7571 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.972244  7592 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:41.981702  7564 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:42.012457  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:42.016551  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:42.017230  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.018199  4138 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.018388  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:41.896819  7537 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.974471  7532 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:41.999701  7526 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:41.993705  7144 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:41.982189  7493 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.028520  4140 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:41.984093  7484 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.012394  7586 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:42.026157  7612 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:19:42.075991  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 108303us
I20260709 13:19:42.016598  7603 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:41.997689  7579 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.029949  4147 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:19:42.019614  7599 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.014628  7473 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:42.077703  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:41.993691  7374 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:42.024760  7560 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:42.082391  4138 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
W20260709 13:19:42.079622  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52429.9us
I20260709 13:19:42.084672  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:42.085328  4290 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.017328  7592 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.070513  7526 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:42.102181  7592 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:42.103569  7595 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.105626  7596 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.097211  7456 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.109771  4287 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:42.110811  7456 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:42.114760  7484 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.092494  7523 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:42.117359  7434 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.118069  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:42.119254  4222 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.122007  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.123384  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.123499  7144 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:42.127393  7493 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.098407  7473 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:42.129558  4216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2225) took 1799 ms (client timeout 2143 ms). Trace:
W20260709 13:19:42.130023  4216 rpcz_store.cc:269] 0709 13:19:40.330803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.333525 (+  2722us) service_pool.cc:224] Handling call
0709 13:19:42.129343 (+1795818us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540001ed54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:42.129494 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3121990912}
I20260709 13:19:42.122052  7526 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.134377  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:42.138849  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.019377  7279 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.108033  7596 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.140297  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.152813  4288 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:42.152235  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 437974us
I20260709 13:19:42.154572  4293 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:42.154874  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:42.160120  4290 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:19:42.166606  4288 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:42.091694  7603 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.104146  7532 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:42.181792  7613 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:19:42.188517  7521 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:42.189760  7408 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:42.190834  7521 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:42.193763  7579 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:42.195318  7498 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.124158  7144 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:42.152489  7563 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:42.164683  7395 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:42.208199  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 130664us
I20260709 13:19:42.209980  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:42.215006  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:42.173772  7451 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.218869  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:42.218748  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2177) took 1104 ms. Trace:
I20260709 13:19:42.223779  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:42.227967  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:42.232426  7456 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:42.201467  7579 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:42.247005  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.247925  4145 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.145885  7460 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.221618  7439 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:42.226717  7563 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:42.225181  7395 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:42.252892  4923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 441) took 3342 ms (client timeout 1776 ms). Trace:
I20260709 13:19:42.255107  7144 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.261123  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:42.261488  7563 raft_consensus.cc:697] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:42.261202  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:42.262593  7555 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:42.263063  7502 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:42.263577  7439 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:42.265693  7433 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.267242  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.285123  4214 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:42.244432  7596 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:42.238672  7560 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:42.199283  7603 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:42.266851  4923 rpcz_store.cc:269] 0709 13:19:38.902795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.902997 (+   202us) service_pool.cc:224] Handling call
0709 13:19:42.244585 (+3341588us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400039b54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:42.244726 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4978020096}
I20260709 13:19:42.224448  4288 rpcz_store.cc:276] 0709 13:19:41.114495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.165514 (+1051019us) service_pool.cc:224] Handling call
0709 13:19:42.166323 (+   809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.218091 (+ 51768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.218680 (+   589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.279309  4290 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:42.238864  7592 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:42.238178  7456 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:42.242019  7528 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.248055  7498 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.270418  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:42.282397  7460 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.297817  4145 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:42.372149  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.372816  4145 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:42.373416  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 176903us
I20260709 13:19:42.374151  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:42.299259  4222 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:42.298921  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2179) took 1148 ms. Trace:
I20260709 13:19:42.301105  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.300016  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.310142  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:42.376960  4147 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.377202  4138 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:42.377679  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 72108.1us
I20260709 13:19:42.378504  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:19:42.316531  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.248309  7579 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.302302  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.381348  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.382016  4140 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.298584  7597 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:42.365774  4110 connection.cc:256] RPC call timeout handler was delayed by -1.4035523249999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 13:19:42.310449  7144 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.369171  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:42.390899  4147 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:42.392073  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.393728  4147 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:19:42.394708  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.394968  4145 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:42.395272  4147 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:42.296737  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.287920  7532 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:42.379467  7390 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.379946  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:42.283758  7502 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:42.383427  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:42.363504  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 93194.7us
I20260709 13:19:42.392762  4290 rpcz_store.cc:276] 0709 13:19:41.150630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.278697 (+1128067us) service_pool.cc:224] Handling call
0709 13:19:42.279100 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.298616 (+ 19516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.298860 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.409515  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:42.384212  4219 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.367784  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:42.411590  4140 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:42.413074  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.414166  4140 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:42.415174  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.396837  4288 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:42.403852  4147 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:42.418766  4147 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:42.411360  4921 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:42.363227  7560 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:42.293459  7596 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.441432  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:42.382483  7473 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:42.375806  7592 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:19:42.435621  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55723.3us
W20260709 13:19:42.437824  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.457605  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:42.458442  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2159) took 2852 ms. Trace:
I20260709 13:19:42.396100  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.386826  7374 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:42.472664  7374 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.474900  4921 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:19:42.475911  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.477439  7526 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.479261  4216 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.481714  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 466) took 1718 ms. Trace:
I20260709 13:19:42.482142  7564 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:42.482563  7564 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:42.483439  7564 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.484732  7526 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.485875  7314 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.386942  7077 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:42.489909  7077 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.417588  7390 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:42.375356  7433 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.492794  7390 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.469764  4138 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:42.493348  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2174) took 1379 ms. Trace:
I20260709 13:19:42.415961  4140 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:42.493805  4294 rpcz_store.cc:276] 0709 13:19:41.113668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.113796 (+   128us) service_pool.cc:224] Handling call
0709 13:19:41.114057 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.721211 (+607154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.493011 (+771800us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540019c8d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:42.493261 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394529152}
I20260709 13:19:42.447237  7451 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:19:42.497676  7537 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:19:42.498028  7540 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.975s	user 0.001s	sys 0.013s
I20260709 13:19:42.498132  7537 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:42.499186  7537 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.387204  7586 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:42.501091  7537 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:42.501276  7586 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.504835  7503 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.482172  4213 rpcz_store.cc:276] 0709 13:19:40.763776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.768640 (+  4864us) service_pool.cc:224] Handling call
0709 13:19:40.768991 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.026437 (+257446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.026471 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.026518 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:41.026554 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.481439 (+1454885us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002ef754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:42.481492 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.481644 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591444352}
I20260709 13:19:42.506078  7503 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:42.507851  7503 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:42.436753  7493 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.512651  7456 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.437923  7563 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.443027  7439 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.516584  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1996) took 1010 ms. Trace:
I20260709 13:19:42.518348  7596 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:42.518996  7603 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.519443  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.570123  4290 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:42.521975  7077 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:42.438570  7595 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.521503  6734 consensus_queue.cc:1059] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:19:42.521517  7502 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:42.530207  7504 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.006s
I20260709 13:19:42.534047  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.534192  7564 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.535384  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.538564  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.577544  4214 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:42.559278  7493 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:42.492995  7433 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:42.545485  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 363098us
I20260709 13:19:42.557881  7503 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:42.378453  7498 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.480038  7496 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:42.565033  4296 rpcz_store.cc:276] 0709 13:19:41.446404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.756735 (+310331us) service_pool.cc:224] Handling call
0709 13:19:42.456473 (+699738us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400354dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:42.456743 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405874944}
I20260709 13:19:42.433343  7532 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.578167  4292 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:42.459095  4289 rpcz_store.cc:276] 0709 13:19:39.605834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.608919 (+  3085us) service_pool.cc:224] Handling call
0709 13:19:41.079144 (+1470225us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b5800082598. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:19:41.079400 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.750197 (+670797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.458063 (+707866us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54000eae54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:42.458322 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512417408}
I20260709 13:19:42.467909  4145 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:42.584323  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:42.591217  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.592115  4290 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:42.582918  7433 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.589857  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:42.594849  4289 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.596395  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1998) took 1149 ms. Trace:
I20260709 13:19:42.597049  4292 rpcz_store.cc:276] 0709 13:19:41.447168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.538190 (+1091022us) service_pool.cc:224] Handling call
0709 13:19:42.596264 (+ 58074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.598443  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:42.599502  4292 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:42.446029  7395 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.605134  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.583750  7493 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.608114  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:42.587021  7502 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.606989  4292 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:42.584439  4110 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:42.614177  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 156676us
I20260709 13:19:42.614930  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.578601  7504 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.593397  7603 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:42.618512  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2180) took 1463 ms. Trace:
I20260709 13:19:42.618798  4110 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:42.577584  7592 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.624100  4292 rpcz_store.cc:276] 0709 13:19:41.154943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.617506 (+1462563us) service_pool.cc:224] Handling call
0709 13:19:42.617889 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.618170 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.618201 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.618241 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:42.618273 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.618325 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.618450 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.577662  7595 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.626241  4110 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:42.633245  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 317) took 2208 ms. Trace:
I20260709 13:19:42.635347  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.636375  4145 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:42.637451  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.638697  4140 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.639626  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.617516  7496 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.639999  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.614338  7579 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:42.634275  4292 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.647733  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1985) took 1428 ms. Trace:
I20260709 13:19:42.648079  4292 rpcz_store.cc:276] 0709 13:19:41.218919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.633596 (+1414677us) service_pool.cc:224] Handling call
0709 13:19:42.634009 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.647444 (+ 13435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.647673 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.648736  4290 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:42.649216  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:42.649837  4292 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:42.634243  4144 rpcz_store.cc:276] 0709 13:19:40.418986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.425577 (+  6591us) service_pool.cc:224] Handling call
0709 13:19:40.426109 (+   532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.944299 (+518190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.944378 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:40.958030 (+ 13652us) log.cc:844] Serialized 26 byte log entry
0709 13:19:41.304816 (+346786us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:41.304854 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.620172 (+1315318us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400069354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:42.620231 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.620282 (+    51us) raft_consensus.cc:1685] finished
0709 13:19:42.620293 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.627050 (+  6757us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23505,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":295030144,"thread_start_us":686648,"threads_started":2,"wal-append.queue_time_us":439878,"wal-append.run_cpu_time_us":1774,"wal-append.run_wall_time_us":1001865}
I20260709 13:19:42.645813  4110 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:42.654281  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2171) took 1541 ms. Trace:
I20260709 13:19:42.657593  4291 rpcz_store.cc:276] 0709 13:19:41.112591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.112871 (+   280us) service_pool.cc:224] Handling call
0709 13:19:41.113358 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.257165 (+143807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.257228 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.257295 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:41.257353 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.654016 (+1396663us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400288a54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:42.654065 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.654219 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270973824}
I20260709 13:19:42.629940  7616 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:42.656941  4222 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:42.661079  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.601601  7560 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.658797  7390 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.659675  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1987) took 1436 ms. Trace:
I20260709 13:19:42.664541  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 313) took 3399 ms. Trace:
I20260709 13:19:42.671953  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.670229  4291 rpcz_store.cc:276] 0709 13:19:41.223211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.658794 (+1435583us) service_pool.cc:224] Handling call
0709 13:19:42.659095 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.659309 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.659339 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.659389 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:42.659429 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.659497 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.659613 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:42.671054  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 97197.3us
I20260709 13:19:42.673882  4291 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:42.670568  4142 rpcz_store.cc:276] 0709 13:19:39.265164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.774375 (+509211us) service_pool.cc:224] Handling call
0709 13:19:39.778933 (+  4558us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:39.812688 (+ 33755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.812737 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:39.883982 (+ 71245us) log.cc:844] Serialized 608 byte log entry
0709 13:19:40.533315 (+649333us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.780032 (+246717us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.193176 (+413144us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.217302 (+ 24126us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.652106 (+1434804us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b180026ea80. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee3e898d70 00007fee3e88c293 00007fee3e881cea 00007fee3e88223a 00007fee3ececa2a 00007fee3ecfc0bf 00007fee3ecfc038
0709 13:19:42.654156 (+  2050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.664203 (+ 10047us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.664264 (+    61us) raft_consensus.cc:1685] finished
0709 13:19:42.664278 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.664474 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1174667,"prepare.queue_time_us":554608,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":163227,"raft.run_cpu_time_us":504,"raft.run_wall_time_us":22215,"spinlock_wait_cycles":40064256,"thread_start_us":895659,"threads_started":2,"wal-append.queue_time_us":829904}
I20260709 13:19:42.674510  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2181) took 1359 ms. Trace:
I20260709 13:19:42.675156  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.655524  7596 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.674865  4291 rpcz_store.cc:276] 0709 13:19:41.314975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.673347 (+1358372us) service_pool.cc:224] Handling call
0709 13:19:42.673664 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.674257 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.674454 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.680546  4142 pending_rounds.cc:85] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 2
I20260709 13:19:42.681460  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.680892  4142 pending_rounds.cc:107] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:42.682119  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.682557  4142 raft_consensus.cc:2889] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.682399  4216 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:42.656322  7507 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:42.630792  7603 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.690922  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:42.680862  7616 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:42.698414  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1959) took 1801 ms. Trace:
I20260709 13:19:42.699545  4139 rpcz_store.cc:276] 0709 13:19:40.897062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.005337 (+108275us) service_pool.cc:224] Handling call
0709 13:19:41.005874 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.008848 (+  2974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.008882 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:41.018023 (+  9141us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.480919 (+1462896us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b180015d3c0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e8820d1 00007fee3ec9da0f
0709 13:19:42.655423 (+174504us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:42.684472 (+ 29049us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.686498 (+  2026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.686614 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.686662 (+    48us) raft_consensus.cc:1685] finished
0709 13:19:42.698019 (+ 11357us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.698304 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8571,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":8722,"spinlock_wait_cycles":17754880,"thread_start_us":195988,"threads_started":2,"wal-append.queue_time_us":1660777}
I20260709 13:19:42.703894  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.681607  7604 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:42.715934  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:42.634471  7503 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.705073  4139 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:42.688536  7607 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:42.727716  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:42.729501  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 83783.9us
I20260709 13:19:42.695511  7507 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:42.736464  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:42.816915  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.853524  4218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2229) took 1598 ms (client timeout 1951 ms). Trace:
W20260709 13:19:42.854166  4218 rpcz_store.cc:269] 0709 13:19:41.255463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.257062 (+  1599us) service_pool.cc:224] Handling call
0709 13:19:42.736299 (+1479237us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbdeee 0000000000375939 00007fee43c311e0 00007fee43cfa0c4 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:19:42.853453 (+117154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5453952}
W20260709 13:19:42.831434  4220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2227) took 2416 ms (client timeout 2354 ms). Trace:
W20260709 13:19:42.857141  4220 rpcz_store.cc:269] 0709 13:19:40.414816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.520509 (+105693us) service_pool.cc:224] Handling call
0709 13:19:42.830797 (+2310288us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001f7a54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:42.831131 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405166464}
I20260709 13:19:42.860031  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:42.752091  4146 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:42.752611  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.865260  7390 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.865445  4141 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:42.761221  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:42.867879  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.869408  4112 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:42.716447  7604 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.870497  4110 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:42.875860  7604 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:42.878069  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.876574  7264 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:42.752492  4289 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:42.881172  4292 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.881904  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:42.882723  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:42.878618  7390 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:42.878818  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:42.883786  4289 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:42.829255  7571 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.816s	user 0.013s	sys 0.000s
W20260709 13:19:42.764873  7624 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:42.892295  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:42.887990  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.885584  4110 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:42.829749  7567 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.900107  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:42.900646  4289 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:42.838236  7498 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:42.787442  7615 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:19:42.862171  7579 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:42.711118  7616 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.938793  4141 pending_rounds.cc:85] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 4
I20260709 13:19:42.753118  7532 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:42.867201  7597 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:42.921391  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.928823  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2183) took 1600 ms. Trace:
I20260709 13:19:42.950444  4289 rpcz_store.cc:276] 0709 13:19:41.328085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.926997 (+1598912us) service_pool.cc:224] Handling call
0709 13:19:42.927491 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.927774 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.928055 (+   281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.928130 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:42.928201 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.928306 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.928722 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.952723  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2184) took 1612 ms. Trace:
I20260709 13:19:42.953188  4289 rpcz_store.cc:276] 0709 13:19:41.340804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.951696 (+1610892us) service_pool.cc:224] Handling call
0709 13:19:42.952068 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.952294 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.952323 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.952403 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:42.952436 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.952513 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.952655 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.885893  7460 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:42.970953  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:42.888159  7502 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:42.938783  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:42.750258  7603 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.940626  4141 pending_rounds.cc:107] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:42.979173  4141 raft_consensus.cc:2889] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.896078  7571 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:42.909794  7434 consensus_meta.cc:287] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.008s
I20260709 13:19:42.901083  7504 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:42.907892  7264 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:42.973876  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2186) took 1619 ms. Trace:
W20260709 13:19:42.991174  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.996112  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.003245  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:43.004561  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.013312  4288 rpcz_store.cc:276] 0709 13:19:41.354281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.972505 (+1618224us) service_pool.cc:224] Handling call
0709 13:19:42.973034 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.973333 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.973375 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.973444 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:42.973503 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.973582 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.973783 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.014698  4218 raft_consensus.cc:2410] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:43.005302  7356 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:42.995357  7144 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.002s
I20260709 13:19:43.015507  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 465) took 1602 ms. Trace:
I20260709 13:19:42.971285  7589 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:43.036561  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.037153  7589 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.037911  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:42.970392  7077 raft_consensus.cc:3055] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:43.039294  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.017556  6734 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.036408  4288 rpcz_store.cc:276] 0709 13:19:41.412820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.014525 (+1601705us) service_pool.cc:224] Handling call
0709 13:19:43.014901 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.015127 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.015154 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.015211 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:43.015242 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.015308 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.015444 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.024966  7376 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:43.041858  7376 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.042532  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2190) took 1551 ms. Trace:
I20260709 13:19:42.951833  7595 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:43.031524  7616 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:42.945375  7579 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:42.971167  7597 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.010069  7567 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:43.033519  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:43.031083  7433 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.035416  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:43.035419  7555 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.000s
I20260709 13:19:43.043042  4288 rpcz_store.cc:276] 0709 13:19:41.490936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.041536 (+1550600us) service_pool.cc:224] Handling call
0709 13:19:43.041939 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.042157 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.042185 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.042233 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:43.042274 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.042341 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.042465 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.975764  7460 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:43.002074  7473 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.004s
I20260709 13:19:43.046432  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:43.046854  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:43.050622  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.040237  6734 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.039709  7077 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:43.062368  4140 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:43.085844  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.066833  4922 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:43.084482  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2172) took 1971 ms. Trace:
I20260709 13:19:43.086151  4221 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:42.968269  7493 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.087567  4295 rpcz_store.cc:276] 0709 13:19:41.113004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.113586 (+   582us) service_pool.cc:224] Handling call
0709 13:19:41.113903 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.698296 (+584393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.084077 (+1385781us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540042aed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:43.084392 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342523520}
I20260709 13:19:43.091930  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2001) took 1481 ms. Trace:
I20260709 13:19:43.092705  4295 rpcz_store.cc:276] 0709 13:19:41.610402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.090145 (+1479743us) service_pool.cc:224] Handling call
0709 13:19:43.090881 (+   736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.091426 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.091467 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.091530 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:43.091578 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.091653 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.091844 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.087749  4140 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:43.096395  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.096903  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.097995  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.098133  4140 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:43.114663  4216 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:43.088806  7595 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.118477  7433 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.082202  7460 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.116767  4222 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:43.122978  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:43.123283  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.166260  4289 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:43.142472  7589 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:43.173663  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.141215  7421 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:43.124243  4140 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:19:43.162424  4144 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [5.7-8.9]
I20260709 13:19:43.147480  4147 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:43.129408  4213 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:43.131399  4294 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:43.128218  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:43.142302  7488 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.137297  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.376394  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.229247  7579 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:43.133397  4925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 445) took 2487 ms (client timeout 1545 ms). Trace:
W20260709 13:19:43.228293  7631 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:19:43.379352  4925 rpcz_store.cc:269] 0709 13:19:40.646103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.646286 (+   183us) service_pool.cc:224] Handling call
0709 13:19:43.133172 (+2486886us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b540062dc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:43.133316 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130194304}
I20260709 13:19:43.140751  7484 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:43.060316  7567 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.412545  6795 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:43.414665  6795 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.102697  7616 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:43.092808  7473 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:43.118307  7507 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:43.176884  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.417968  7616 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.419489  4217 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:43.421319  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.163350  7077 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.422773  4217 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:43.423493  6734 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:43.149158  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 115737us
I20260709 13:19:43.144450  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.379259  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:43.344604  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.351866  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.241775  7493 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.401551  7579 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:43.403393  7449 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:43.403995  7604 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.005s
W20260709 13:19:43.375839  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 329327us
I20260709 13:19:43.423581  7077 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.424243  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:43.403466  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 275135us
I20260709 13:19:43.420095  7421 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:43.435727  4218 raft_consensus.cc:2410] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:43.438761  4892 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:43.160882  7526 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:43.283037  7639 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
W20260709 13:19:43.222759  7564 consensus_meta.cc:287] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.640s	user 0.013s	sys 0.000s
I20260709 13:19:43.442333  4140 pending_rounds.cc:85] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 9
I20260709 13:19:43.446370  4220 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:43.445845  7604 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.445878  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2188) took 1970 ms. Trace:
I20260709 13:19:43.443081  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.455534  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.456873  4217 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:43.458988  4140 pending_rounds.cc:107] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:19:43.459232  7376 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:43.461534  7526 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.463263  4141 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:43.165200  7345 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.463912  4222 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:43.468012  4222 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:43.459525  4140 raft_consensus.cc:2889] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:43.473706  7604 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:43.441501  7421 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:43.451916  4294 rpcz_store.cc:276] 0709 13:19:41.475467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.031277 (+1555810us) service_pool.cc:224] Handling call
0709 13:19:43.130728 (+ 99451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.444491 (+313763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.445458 (+   967us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.478327  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:43.478636  7421 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.479477  4925 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.439905  7579 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.485392  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:43.488790  7421 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.439980  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.479887  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:43.487830  7579 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:43.496891  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 52007us
I20260709 13:19:43.497779  4296 raft_consensus.cc:2410] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:19:43.495077  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 60417.3us
I20260709 13:19:43.497431  4294 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.505511  7652 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:43.508718  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.502856  4146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1791) took 1639 ms (client timeout 1724 ms). Trace:
I20260709 13:19:43.227399  7597 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:43.516305  4144 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:43.521559  4218 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:43.522586  4925 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:43.522823  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2241) took 1687 ms. Trace:
I20260709 13:19:43.523802  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:43.523535  4219 rpcz_store.cc:276] 0709 13:19:41.835299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.835426 (+   127us) service_pool.cc:224] Handling call
0709 13:19:41.835736 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.417958 (+582222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.509392 (+1091434us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54002f5154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:43.522522 (+ 13130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260810496}
W20260709 13:19:43.525012  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 150477us
I20260709 13:19:43.525621  7496 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:43.527797  7604 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:43.528932  4110 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:43.530613  7604 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:43.531790  4140 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:19:43.532361  7604 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:43.534003  7604 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:43.537721  4287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2005) took 1811 ms (client timeout 1712 ms). Trace:
W20260709 13:19:43.538293  4287 rpcz_store.cc:269] 0709 13:19:41.725787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.755707 (+ 29920us) service_pool.cc:224] Handling call
0709 13:19:43.536987 (+1781280us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400276fd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:43.537362 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803070336}
I20260709 13:19:43.538966  7616 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.542475  4144 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:43.544440  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2192) took 2043 ms. Trace:
W20260709 13:19:43.510141  4146 rpcz_store.cc:269] 0709 13:19:41.862673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.865433 (+  2760us) service_pool.cc:224] Handling call
0709 13:19:43.500138 (+1634705us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54003da754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:43.501662 (+  1524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017446144}
W20260709 13:19:43.549858  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.551041  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.556710  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.558724  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2185) took 2217 ms. Trace:
I20260709 13:19:43.559355  4289 rpcz_store.cc:276] 0709 13:19:41.341344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.954169 (+1612825us) service_pool.cc:224] Handling call
0709 13:19:42.954607 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.166750 (+212143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.557874 (+391124us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54002599d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:43.558415 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486232448}
I20260709 13:19:43.560063  4293 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:43.539938  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:43.545012  4288 rpcz_store.cc:276] 0709 13:19:41.500835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.060968 (+1560133us) service_pool.cc:224] Handling call
0709 13:19:43.061562 (+   594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.085839 (+ 24277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.085875 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.085922 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:43.085971 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.543914 (+457943us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54002594d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:43.543988 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.544217 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55131904}
I20260709 13:19:43.516227  7376 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:43.568094  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:43.570220  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:43.530879  7567 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.575907  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:43.549088  7634 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.530s	user 0.000s	sys 0.004s
W20260709 13:19:43.591673  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.598979  4031 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a35e1cee8a15436dbfaf75dd67824aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 32ebd3bc4af5446f94d9f3ac7c8cf53c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:19:43.608635  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 123493us
I20260709 13:19:43.609048  7580 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:43.609947  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:43.611141  4287 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:43.611459  7586 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:43.613713  7460 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.612705  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:43.615625  4139 raft_consensus.cc:2368] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
I20260709 13:19:43.617092  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:43.622227  4144 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:43.626464  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:43.629879  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:43.633116  7376 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:43.633980  7376 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.624053  7460 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.638839  7430 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:43.639460  7430 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.639889  7430 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.641424  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2249) took 1715 ms. Trace:
I20260709 13:19:43.629959  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:43.641942  4215 rpcz_store.cc:276] 0709 13:19:41.926026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.927917 (+  1891us) service_pool.cc:224] Handling call
0709 13:19:41.928303 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.994684 (+ 66381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.994716 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.000254 (+  5538us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.288152 (+287898us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:42.288196 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.640650 (+1352454us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b5400026cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:43.640760 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.640825 (+    65us) raft_consensus.cc:1685] finished
0709 13:19:43.640840 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.641182 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":708,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":10082,"spinlock_wait_cycles":151688960,"thread_start_us":261430,"threads_started":1,"wal-append.queue_time_us":389839,"wal-append.run_cpu_time_us":2542,"wal-append.run_wall_time_us":1096458}
I20260709 13:19:43.647570  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.649124  7408 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:43.650110  7408 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.647552  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:43.657491  7503 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.660579  7460 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.661653  7460 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.665222  7376 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:43.669075  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 118837us
I20260709 13:19:43.670614  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 1971) took 1034 ms. Trace:
I20260709 13:19:43.673298  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2012) took 1413 ms. Trace:
I20260709 13:19:43.673607  4291 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:43.673857  4290 rpcz_store.cc:276] 0709 13:19:42.260076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.601121 (+341045us) service_pool.cc:224] Handling call
0709 13:19:43.672728 (+1071607us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b5400353ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:43.673034 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91140992}
I20260709 13:19:43.674678  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:43.675459  4219 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.675298  7376 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:43.676067  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2182) took 2351 ms. Trace:
I20260709 13:19:43.671236  4138 rpcz_store.cc:276] 0709 13:19:42.635534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.640846 (+  5312us) service_pool.cc:224] Handling call
0709 13:19:42.641131 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.651626 (+ 10495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.651671 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.657135 (+  5464us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.722199 (+ 65064us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:42.995157 (+272958us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.016749 (+ 21592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.016865 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.526996 (+510131us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:43.669781 (+142785us) raft_consensus.cc:1685] finished
0709 13:19:43.669955 (+   174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.670344 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40491,"prepare.queue_time_us":230549,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":36127,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":30529,"spinlock_wait_cycles":8125696,"thread_start_us":249581,"threads_started":2,"wal-append.queue_time_us":223374}
I20260709 13:19:43.676558  4291 rpcz_store.cc:276] 0709 13:19:41.324651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.678939 (+1354288us) service_pool.cc:224] Handling call
0709 13:19:43.673035 (+994096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.674106 (+  1071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.675666 (+  1560us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400353ed0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:43.675988 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285129088}
I20260709 13:19:43.677244  7493 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:43.677762  7493 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:43.678050  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:43.679026  4138 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:43.679075  7493 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.650924  7408 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.675292  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:43.681496  4290 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.660709  6795 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.683399  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:43.681401  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.685918  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:43.686071  7619 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.076s	user 0.002s	sys 0.000s
W20260709 13:19:43.663877  4922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 460) took 1890 ms (client timeout 2015 ms). Trace:
I20260709 13:19:43.695375  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:43.690033  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:43.680478  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2178) took 2565 ms. Trace:
I20260709 13:19:43.700100  4293 rpcz_store.cc:276] 0709 13:19:41.114814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.168818 (+1054004us) service_pool.cc:224] Handling call
0709 13:19:43.549550 (+1380732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.566863 (+ 17313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.680152 (+113289us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400276fd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:43.680387 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3165302528}
I20260709 13:19:43.701633  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:43.702584  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:43.678092  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:43.699621  4922 rpcz_store.cc:269] 0709 13:19:41.773415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.775106 (+  1691us) service_pool.cc:224] Handling call
0709 13:19:43.663247 (+1888141us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540074fc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:43.663596 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826051840}
I20260709 13:19:43.718499  4288 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:43.729390  4291 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:43.735929  4144 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:43.732962  4287 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:43.740140  7530 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:43.742697  4141 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:43.745081  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2193) took 1954 ms. Trace:
I20260709 13:19:43.745622  4293 rpcz_store.cc:276] 0709 13:19:41.787421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.712225 (+1924804us) service_pool.cc:224] Handling call
0709 13:19:43.735209 (+ 22984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.735493 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.735519 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.741440 (+  5921us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:43.741499 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.741574 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.741706 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.747309  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2255) took 1472 ms. Trace:
I20260709 13:19:43.747820  4221 rpcz_store.cc:276] 0709 13:19:42.268378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.283157 (+ 14779us) service_pool.cc:224] Handling call
0709 13:19:42.283528 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.088084 (+804556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.740615 (+652531us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54000249d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:43.741020 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845120768}
I20260709 13:19:43.748709  4289 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:43.751083  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 467) took 1877 ms. Trace:
I20260709 13:19:43.755259  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 330) took 1500 ms. Trace:
I20260709 13:19:43.755736  4143 rpcz_store.cc:276] 0709 13:19:42.254427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.271460 (+ 17033us) service_pool.cc:224] Handling call
0709 13:19:42.271830 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.454135 (+182305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.454169 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.454215 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:42.454260 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.708850 (+1254590us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540022e2d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:43.725214 (+ 16364us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.754803 (+ 29589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418731904}
W20260709 13:19:43.754284  7628 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 1.017s	user 0.004s	sys 0.000s
I20260709 13:19:43.751823  4289 rpcz_store.cc:276] 0709 13:19:41.873335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.749626 (+1876291us) service_pool.cc:224] Handling call
0709 13:19:43.750204 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.750660 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.750699 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.750766 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:43.750801 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.750858 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.750996 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.761468  4294 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:43.762558  7530 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:43.754796  7408 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.742676  7460 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:43.772286  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:43.777913  7528 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:43.778568  7528 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:43.781359  4288 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:43.784166  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2194) took 1993 ms. Trace:
I20260709 13:19:43.784893  4288 rpcz_store.cc:276] 0709 13:19:41.790988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.731462 (+1940474us) service_pool.cc:224] Handling call
0709 13:19:43.780950 (+ 49488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.783735 (+  2785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.784054 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.790114  7530 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.793507  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2200) took 1955 ms. Trace:
I20260709 13:19:43.794013  4293 rpcz_store.cc:276] 0709 13:19:41.838039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.746736 (+1908697us) service_pool.cc:224] Handling call
0709 13:19:43.788469 (+ 41733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.788849 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.788879 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.793142 (+  4263us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:43.793212 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.793285 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.793441 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.794562  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1813) took 1149 ms. Trace:
I20260709 13:19:43.811154  7449 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:43.811873  4293 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:43.812669  7449 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:43.813300  7449 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:43.814469  7449 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.816144  7408 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.812718  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2209) took 1306 ms. Trace:
I20260709 13:19:43.816804  4293 rpcz_store.cc:276] 0709 13:19:42.505913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.800808 (+1294895us) service_pool.cc:224] Handling call
0709 13:19:43.811578 (+ 10770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.812372 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.812632 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:43.817500  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.818449  7563 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:43.779736  7528 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:43.829315  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.830029  4293 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:43.821126  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.820930  4144 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:43.830842  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:43.846917  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2203) took 1578 ms. Trace:
I20260709 13:19:43.847533  4288 rpcz_store.cc:276] 0709 13:19:42.268873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.808140 (+1539267us) service_pool.cc:224] Handling call
0709 13:19:43.831896 (+ 23756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.846425 (+ 14529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.846477 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.846546 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:43.846597 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.846680 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.846835 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.848830  7439 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.849274  7460 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:43.849493  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 179121us
I20260709 13:19:43.849690  7439 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.850167  7460 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:43.851568  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:43.853101  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:43.853978  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:43.854642  7439 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:43.854816  4220 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:43.855917  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:43.856669  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:43.857676  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2256) took 1348 ms. Trace:
I20260709 13:19:43.858162  7279 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:43.858115  4213 rpcz_store.cc:276] 0709 13:19:42.509270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.509470 (+   200us) service_pool.cc:224] Handling call
0709 13:19:42.509843 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.402141 (+892298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.857239 (+455098us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54003c37d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:43.857478 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424359808}
I20260709 13:19:43.858821  7279 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:43.859421  7279 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.797406  4217 rpcz_store.cc:276] 0709 13:19:42.637221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.458159 (+820938us) service_pool.cc:224] Handling call
0709 13:19:43.487110 (+ 28951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.509178 (+ 22068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.509217 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.574007 (+ 64790us) log.cc:844] Serialized 26 byte log entry
0709 13:19:43.722002 (+147995us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:43.722046 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.722128 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.781990 (+ 59862us) raft_consensus.cc:1685] finished
0709 13:19:43.782021 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.786133 (+  4112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16632,"raft.queue_time_us":22568,"raft.run_cpu_time_us":2954,"raft.run_wall_time_us":29458,"thread_start_us":117189,"threads_started":1,"wal-append.queue_time_us":187143}
I20260709 13:19:43.862861  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2015) took 1198 ms. Trace:
I20260709 13:19:43.867513  4293 rpcz_store.cc:276] 0709 13:19:42.644790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.817752 (+1172962us) service_pool.cc:224] Handling call
0709 13:19:43.829292 (+ 11540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.838808 (+  9516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.842672 (+  3864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.881264  4219 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:43.819351  7563 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:43.891041  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 386050us
I20260709 13:19:43.898870  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:43.880085  7449 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.914327  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:43.907291  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2211) took 1230 ms. Trace:
I20260709 13:19:43.916126  4288 rpcz_store.cc:276] 0709 13:19:42.677045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.848673 (+1171628us) service_pool.cc:224] Handling call
0709 13:19:43.849163 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.897748 (+ 48585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.897781 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.906961 (+  9180us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:43.907019 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.907081 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.907232 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.889751  7580 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:43.928485  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 469) took 1990 ms. Trace:
I20260709 13:19:43.879295  7586 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:19:43.934010  4289 rpcz_store.cc:276] 0709 13:19:41.938372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.782313 (+1843941us) service_pool.cc:224] Handling call
0709 13:19:43.842962 (+ 60649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.927940 (+ 84978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.927977 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.928042 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:43.928128 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.928218 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.928392 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.938274  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2201) took 1992 ms. Trace:
I20260709 13:19:43.929848  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 471) took 1076 ms. Trace:
I20260709 13:19:43.939901  4293 rpcz_store.cc:276] 0709 13:19:42.853811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.882770 (+1028959us) service_pool.cc:224] Handling call
0709 13:19:43.918749 (+ 35979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.924714 (+  5965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.924918 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.928933 (+  4015us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:43.929080 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.929292 (+   212us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.929633 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.956805  7528 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.930112  7530 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:43.959721  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:43.960994  4289 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:43.961759  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 473) took 1107 ms. Trace:
W20260709 13:19:43.964658  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 133984us
I20260709 13:19:43.966746  6734 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:43.968236  7627 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:43.971534  7627 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:43.972740  4287 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:43.973796  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2199) took 2138 ms. Trace:
I20260709 13:19:43.974195  4287 rpcz_store.cc:276] 0709 13:19:41.835644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.760440 (+1924796us) service_pool.cc:224] Handling call
0709 13:19:43.804119 (+ 43679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.972500 (+168381us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b54000b4da0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec59dc0 00007fee3ece41c0 00007fee3ece5231 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c
0709 13:19:43.973392 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.973705 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59449088}
I20260709 13:19:43.977591  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1986) took 2755 ms. Trace:
I20260709 13:19:43.978104  4921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 470) took 1014 ms. Trace:
I20260709 13:19:43.978036  4292 rpcz_store.cc:276] 0709 13:19:41.222276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.651158 (+1428882us) service_pool.cc:224] Handling call
0709 13:19:42.880956 (+229798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.881610 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.977136 (+1095526us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540042a4d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:43.977384 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523498368}
I20260709 13:19:43.978514  4921 rpcz_store.cc:276] 0709 13:19:42.937319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.937546 (+   227us) service_pool.cc:224] Handling call
0709 13:19:42.938077 (+   531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:42.938552 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.938601 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:42.950890 (+ 12289us) log.cc:844] Serialized 52 byte log entry
0709 13:19:43.126826 (+175936us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:43.382803 (+255977us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.791183 (+408380us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800165880. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee3bbf7a40 00007fee3bbf24e4 00007fee3bbf2455 00007fee3ecda060 00007fee3ecec716 00007fee3ecfd287 00007fee3ecfd208
0709 13:19:43.791791 (+   608us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.912752 (+120961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.913122 (+   370us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.941785 (+ 28663us) raft_consensus.cc:1685] finished
0709 13:19:43.941818 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.951670 (+  9852us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56600,"prepare.queue_time_us":375749,"prepare.run_cpu_time_us":187,"prepare.run_wall_time_us":20312,"raft.queue_time_us":413387,"raft.run_cpu_time_us":720,"raft.run_wall_time_us":60961,"spinlock_wait_cycles":35053312,"thread_start_us":338375,"threads_started":3,"wal-append.queue_time_us":248362}
I20260709 13:19:43.922379  4919 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:43.976999  7627 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.984472  4292 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:19:43.940361  7430 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:43.968567  4288 rpcz_store.cc:276] 0709 13:19:42.854569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.918311 (+1063742us) service_pool.cc:224] Handling call
0709 13:19:43.960895 (+ 42584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.961283 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.961311 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.961383 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:43.961442 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.961520 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.961679 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.920914  7652 raft_consensus.cc:697] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:44.001967  4287 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:44.013546  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2212) took 1037 ms. Trace:
I20260709 13:19:44.013957  4287 rpcz_store.cc:276] 0709 13:19:42.976279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.975384 (+999105us) service_pool.cc:224] Handling call
0709 13:19:43.975895 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.013127 (+ 37232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.013461 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.935456  7460 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:44.003166  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 195139us
W20260709 13:19:44.018925  7421 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.500s	user 0.021s	sys 0.000s
I20260709 13:19:43.994616  7430 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.041494  7507 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:44.041843  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 474) took 1180 ms. Trace:
I20260709 13:19:44.042419  7507 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.042289  4289 rpcz_store.cc:276] 0709 13:19:42.861531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.962154 (+1100623us) service_pool.cc:224] Handling call
0709 13:19:44.013400 (+ 51246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.036611 (+ 23211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.036649 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.041419 (+  4770us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:44.041489 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.041567 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.041738 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.044301  4288 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:44.045315  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.048543  7507 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:43.955976  7264 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:19:44.057288  4928 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:44.058003  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:44.027438  7526 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.071652  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.080668  4287 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:44.078429  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2195) took 2286 ms. Trace:
I20260709 13:19:44.091084  7563 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:44.066340  7652 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:44.094470  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.097226  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.097545  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.097385  4290 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:44.100566  7580 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:44.106218  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:44.107007  7077 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:44.107450  7670 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:44.092185  7374 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:44.108472  7670 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.109992  7670 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.098886  7526 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.113219  7526 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.114226  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.114569  4215 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:44.114936  4215 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:44.115001  4219 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:44.112082  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.121335  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.116258  4215 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.127848  7374 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:44.132915  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.133242  7374 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.134371  4290 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:44.134088  7664 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:44.136373  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.136755  7526 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:44.138515  4147 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:44.139053  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:44.139813  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 119568us
I20260709 13:19:44.136058  7374 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:44.140880  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:44.140645  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.144688  4290 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:44.144692  7374 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:44.146377  7374 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:44.145002  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:44.147370  4287 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.147820  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.144127  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:44.084398  4291 rpcz_store.cc:276] 0709 13:19:41.792433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.733998 (+1941565us) service_pool.cc:224] Handling call
0709 13:19:43.801623 (+ 67625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.861822 (+ 60199us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:44.013285 (+151463us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.078019 (+ 64734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.078088 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:44.078139 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.078219 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.078358 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":93518,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":11633,"thread_start_us":162401,"threads_started":2}
I20260709 13:19:44.161674  7374 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.164410  7564 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:44.164924  7564 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:19:44.165041  7662 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:19:44.166154  7564 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.166823  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.167680  4217 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:44.167945  7564 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:44.171593  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.107491  7077 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:44.168887  7503 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.006s
I20260709 13:19:44.179221  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:44.179970  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 242843us
I20260709 13:19:44.182842  4292 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:44.163817  7279 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.198915  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:44.201538  4215 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.183112  7484 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 11 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:44.201645  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:44.189780  7580 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:44.198800  7597 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:44.215981  4287 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:44.213212  6795 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.218401  4145 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:44.218509  4147 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:44.220144  4142 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:44.222287  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:44.211524  7650 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 13:19:44.224229  4111 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.67:40585 timed out after 1.987s (SENT) [suppressed 14 similar messages]
I20260709 13:19:44.198940  7627 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:44.257305  7627 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.257769  6795 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.260288  7449 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:44.260062  7627 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:44.262421  4145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1975) took 1625 ms (client timeout 1991 ms). Trace:
I20260709 13:19:44.262748  7597 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:44.263548  7597 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:44.216775  7563 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.264662  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 2206) took 1995 ms. Trace:
I20260709 13:19:44.209663  7460 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:44.265069  4296 rpcz_store.cc:276] 0709 13:19:42.269677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.606259 (+336582us) service_pool.cc:224] Handling call
0709 13:19:44.264308 (+1658049us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400288f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:44.264570 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021972736}
I20260709 13:19:44.234894  7279 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:44.236873  7580 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.237404  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.237845  4922 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:44.238734  7345 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:44.240840  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.244560  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.245030  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.247665  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:44.248584  4216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1815) took 1610 ms (client timeout 1894 ms). Trace:
I20260709 13:19:44.248442  7077 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.247713  4920 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:19:44.255618  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58480us
W20260709 13:19:44.263047  4145 rpcz_store.cc:269] 0709 13:19:42.637100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.637199 (+    99us) service_pool.cc:224] Handling call
0709 13:19:44.262094 (+1624895us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54003d8954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:44.262321 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3561037696}
I20260709 13:19:44.260025  6795 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.224124  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:44.265354  7460 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.271178  7563 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.274983  7493 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.275365  7264 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.279336  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:44.280611  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.281153  7595 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.284833  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.285220  7449 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:44.286409  7580 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:44.286682  6734 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
W20260709 13:19:44.299533  4216 rpcz_store.cc:269] 0709 13:19:42.637865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.690573 (+ 52708us) service_pool.cc:224] Handling call
0709 13:19:44.248134 (+1557561us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b540041a5d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:44.248359 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871871744}
I20260709 13:19:44.342839  6734 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:44.343367  6734 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:44.344871  6734 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.347012  6734 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:44.348824  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:44.305677  4215 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:19:44.273384  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.310263  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:44.311414  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.311875  7555 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:44.284154  7374 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.313028  7077 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.313567  7526 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:44.314388  7430 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:44.315239  7408 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:44.317700  7530 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:44.321695  4139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 1985) took 1636 ms (client timeout 2104 ms). Trace:
W20260709 13:19:44.331746  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 109539us
I20260709 13:19:44.327272  7460 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:44.333958  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 116348us
I20260709 13:19:44.253327  7484 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.338011  7376 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:44.337913  7264 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:44.361863  4139 rpcz_store.cc:269] 0709 13:19:42.684879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.760801 (+ 75922us) service_pool.cc:224] Handling call
0709 13:19:44.321427 (+1560626us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54003962d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:44.321620 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700142976}
I20260709 13:19:44.340206  7567 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:44.340852  7595 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.341826  7449 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:44.339043  7602 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.351248  4215 pending_rounds.cc:85] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 7
I20260709 13:19:44.371181  4215 pending_rounds.cc:107] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:19:44.355768  4926 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:44.371606  4215 raft_consensus.cc:2889] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:44.361258  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 137056us
I20260709 13:19:44.366006  4289 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:44.337297  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:44.373760  7460 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:44.375628  7602 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.376914  4215 pending_rounds.cc:107] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:19:44.378605  4215 raft_consensus.cc:2889] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.335731  7563 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.359843  7507 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:44.386327  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:44.391966  4185 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:44.392289  7675 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:44.392601  7421 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:44.392951  7675 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:44.393154  7421 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:44.394196  7675 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.394384  7421 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.395941  7675 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:44.396610  7667 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:44.397164  7667 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.397635  7667 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.397022  7421 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.391420  7449 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.391530  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:44.390415  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80361.1us
I20260709 13:19:44.407872  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:44.409102  4926 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:44.388070  7507 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:44.413198  7555 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:44.413467  7507 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.407930  7430 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:44.414846  7507 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.414960  7430 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:44.415611  7430 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.409188  7264 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.419723  7580 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:44.420274  7449 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.420269  7580 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:44.421121  7580 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.421622  7374 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:44.409797  4295 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:19:44.422354  4295 pending_rounds.cc:85] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:19:44.422055  7670 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.422663  4295 pending_rounds.cc:107] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:19:44.422971  4295 raft_consensus.cc:2889] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:44.424580  7673 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:19:44.427315  4185 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:44.430620  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:43.938694  4294 rpcz_store.cc:276] 0709 13:19:41.928296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.766354 (+1838058us) service_pool.cc:224] Handling call
0709 13:19:43.806446 (+ 40092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.830344 (+ 23898us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:43.875103 (+ 44759us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.919840 (+ 44737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.919903 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:43.919960 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.920041 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.920204 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":102931,"raft.queue_time_us":144,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":3616,"thread_start_us":74841,"threads_started":2}
I20260709 13:19:44.431849  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:44.432818  7564 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:44.433331  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:44.433425  7564 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:44.434939  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:44.434827  7564 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:44.440676  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.444010  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:44.431620  7374 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:44.448696  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.453831  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.460390  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.449492  7670 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.467989  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.464361  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:19:44.470263  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.462291  7586 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:44.473888  4214 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:44.476943  6795 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:44.477065  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:44.475229  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.455469  7264 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.484830  4925 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 11 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:44.485854  7620 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:44.399950  7597 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.453169  7580 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.509702  6795 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:44.510094  4142 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:44.510432  6795 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.498327  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.511813  4213 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:44.497391  7264 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.514251  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:44.518999  4139 raft_consensus.cc:2393] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:44.458244  7408 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:44.495642  7620 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:44.535197  7685 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:44.536078  7685 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.536789  7264 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.499495  7586 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:44.531402  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:44.538401  4145 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:44.540189  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.544251  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.544725  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.546188  6795 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:44.550051  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 69891.8us
I20260709 13:19:44.556318  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:44.558048  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:44.558840  4144 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:44.560607  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:44.562529  4144 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.562824  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:44.561592  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:44.563496  4146 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:44.563622  4140 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 3.
I20260709 13:19:44.566780  4146 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:44.568672  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:44.577059  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:44.572119  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:44.569980  7374 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:44.539230  7620 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.586772  4141 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:44.595871  4146 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.596231  7681 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:44.602368  6795 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:44.607474  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.602996  6795 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:44.608108  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.618045  4144 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:44.610802  7408 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:44.620110  7682 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:44.620301  7408 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:44.620785  7682 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.621263  7682 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.621621  7408 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.623236  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:44.623136  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.626235  7408 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.598299  7602 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.585119  7664 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:44.637578  4222 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:44.638682  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:44.640094  7677 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:19:44.640466  7680 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:44.642455  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:44.643852  7676 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.255s	user 0.000s	sys 0.002s
I20260709 13:19:44.681418  6795 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.687893  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.631601  7563 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:44.642481  7682 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.614084  7681 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.722244  4187 leader_election.cc:400] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
I20260709 13:19:44.722661  4187 leader_election.cc:403] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:19:44.726898  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.727689  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 256474us
I20260709 13:19:44.695693  7680 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:44.731954  6734 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
I20260709 13:19:44.720180  7685 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:44.748687  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:44.664357  7586 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.690160  7374 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.753867  7597 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:44.753998  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:44.746004  7580 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:44.782823  7682 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:44.785058  7681 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:44.765126  7597 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:44.788854  7597 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.795776  7680 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:44.782883  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52781.1us
I20260709 13:19:44.798854  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:44.807447  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.809737  4218 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:44.799779  7618 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:44.780560  7563 raft_consensus.cc:2764] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:44.807525  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.819742  4219 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:44.812131  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.823364  4222 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:44.831466  7421 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:44.833575  7600 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:44.832739  4044 catalog_manager.cc:5697] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 7 to 9, leader changed from <none> to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 9 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.834585  7600 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:44.834995  7600 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:44.836068  7600 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.838229  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:44.838537  7600 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.838930  4289 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.841869  7279 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.842494  7279 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:44.847929  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.846289  4112 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:44.859915  6795 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:44.864234  6795 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:44.867122  6795 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:44.858045  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 104155us
W20260709 13:19:44.857612  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 306401us
I20260709 13:19:44.791904  7430 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.869987  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:44.844043  7618 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.879140  6795 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:44.883426  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:44.794618  7667 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:44.923835  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:44.926764  4146 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:44.909303  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2002) took 3235 ms. Trace:
I20260709 13:19:44.912456  7264 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:44.913023  7493 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.006s
I20260709 13:19:44.918404  7421 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:44.930734  4213 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:44.872093  7602 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:44.920986  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:44.876278  7077 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.006s
W20260709 13:19:44.942462  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 57398.2us
I20260709 13:19:44.918601  7685 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:44.929387  4295 rpcz_store.cc:276] 0709 13:19:41.673522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.095215 (+1421693us) service_pool.cc:224] Handling call
0709 13:19:44.272706 (+1177491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.423586 (+150880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.906634 (+483048us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400288f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:44.908914 (+  2280us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400288f50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:44.909198 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996829824}
I20260709 13:19:44.940224  4222 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.946642  4217 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:44.954988  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:44.956153  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 157451us
I20260709 13:19:44.922394  7580 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:44.956611  4216 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
W20260709 13:19:44.943166  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3937889869998799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:19:44.963299  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:44.963909  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3878360339999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 13:19:44.964406  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3626360339999337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 13:19:44.964740  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3595889869998246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:19:44.965044  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2902889869999399s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:19:44.933189  7264 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.966576  4215 raft_consensus.cc:3055] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:44.967049  4215 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:44.968032  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.939962  7602 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.976423  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:44.981112  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:44.982177  4213 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:44.983279  4296 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:44.984541  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:44.985548  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:44.986515  4294 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:45.013511  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:44.987919  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.990628  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:44.985253  4295 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.993216  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:45.016238  4296 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:44.993450  7430 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:44.996887  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:45.025676  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 63643.8us
I20260709 13:19:44.974514  7077 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:45.000396  7702 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.002071  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.972990  7567 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.005261  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:45.007073  7507 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.003s
I20260709 13:19:45.012580  7460 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.007498  4259 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:45.007917  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.978214  7602 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.008666  7279 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:44.975370  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:44.985258  4215 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.014333  4218 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:45.014832  4288 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:44.962778  7580 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:44.970192  7264 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.026770  4145 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:45.027388  4289 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:45.028519  4214 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:45.029143  4222 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:45.035175  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:45.040441  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 69950.1us
I20260709 13:19:45.007158  7620 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.041535  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:45.053208  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.061885  4220 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:19:44.942844  7618 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.029876  7077 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.065831  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:45.067016  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:45.075031  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:45.078284  7699 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:19:45.037333  7503 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.079968  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 72706.6us
W20260709 13:19:45.080924  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.068933  4215 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:45.096930  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 153321us
I20260709 13:19:45.040655  7595 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:45.099845  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 67542.2us
W20260709 13:19:45.101186  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.062094  7580 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.064215  7685 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:45.111017  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:45.111707  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 143236us
I20260709 13:19:45.078783  7077 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.043149  7627 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:45.115327  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.053678  7702 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.098759  7376 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:45.120288  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:45.120966  4261 connection.cc:256] RPC call timeout handler was delayed by -1.18263603399987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 13:19:45.046730  7567 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.103330  7460 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:45.198758  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 77540.2us
I20260709 13:19:45.131248  7675 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:45.109575  7503 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.202469  4259 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:19:45.203766  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1187360339999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 13:19:45.213366  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1025360339999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 13:19:45.217578  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0115046920000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
I20260709 13:19:45.222807  4215 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:45.201320  7667 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:45.198704  7713 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:45.126899  7627 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.206144  7460 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.203274  7376 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:45.239053  7698 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 13:19:45.211540  7595 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:45.242291  7567 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.227306  7507 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.250383  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 142350us
W20260709 13:19:45.260924  7706 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.227s	user 0.000s	sys 0.008s
I20260709 13:19:45.231415  7675 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:45.262370  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.267143  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:45.235136  7374 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.238066  7279 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.272611  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:45.283771  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:45.289767  4214 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.296470  7595 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.297057  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:19:45.299021  7708 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:19:45.299193  7595 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:45.260989  7507 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:45.301469  7703 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:19:45.303189  7507 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:45.305095  7700 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:19:45.306141  7503 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.308907  7618 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.310734  7702 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:45.284591  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 82225.1us
I20260709 13:19:45.253163  7460 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.318382  4139 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:45.320915  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:45.264282  7680 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:45.323171  4221 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:45.268788  7567 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.277163  7713 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:45.295921  4924 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
W20260709 13:19:45.346487  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 95880.1us
I20260709 13:19:45.326879  7685 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:45.354758  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 104437us
I20260709 13:19:45.284061  7374 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:45.358330  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80032.8us
I20260709 13:19:45.365216  4290 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:45.366556  7376 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.367834  7376 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.376955  7716 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.377766  7716 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:45.378185  7716 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.331561  7567 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.380774  7687 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:19:45.382263  7567 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.349020  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:45.383343  7597 consensus_meta.cc:287] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.594s	user 0.013s	sys 0.000s
I20260709 13:19:45.385289  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:45.387356  6795 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.387761  6795 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.388104  6795 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.388935  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.389671  4213 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:45.390553  7430 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.390205  4044 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.391170  7430 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.396921  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.397900  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.398655  4218 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:45.399842  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.402894  7460 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.404608  7675 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.406157  4259 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:45.406999  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.418838  4219 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:45.335841  7564 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:45.333060  7702 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:45.405035  7713 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.429044  7430 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.424667  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:45.430670  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:45.430828  7580 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.431960  4924 raft_consensus.cc:2368] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9.
I20260709 13:19:45.432571  4291 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:45.436581  4185 leader_election.cc:400] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9.
I20260709 13:19:45.437121  4185 leader_election.cc:403] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:19:45.436638  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.351341  7620 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:45.435556  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:45.383842  7597 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.442237  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.442461  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.447378  4219 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:45.434953  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:45.444733  4214 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:45.448688  6795 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.456240  7460 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.456534  7683 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.457159  7683 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.459867  7421 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.460510  7421 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.463111  7627 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.463330  4295 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:45.442162  7408 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.465283  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:45.466195  7430 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:45.466697  7430 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.467089  7430 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.467593  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:45.469010  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:45.469303  7687 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:45.470068  7687 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:45.470572  7687 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:45.471711  7687 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.473706  7526 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9.
I20260709 13:19:45.477720  6795 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.448472  7718 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:45.438355  7680 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:45.479336  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:45.480849  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.479763  7314 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:45.491274  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:45.490036  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:45.493417  7664 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:45.494102  7664 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:45.495093  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:45.495272  7664 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.496591  4296 raft_consensus.cc:2368] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
I20260709 13:19:45.495787  4295 raft_consensus.cc:2376] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:19:45.497365  4290 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:45.499394  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:45.503021  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.487819  7718 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:45.508473  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 74186.7us
I20260709 13:19:45.510224  6795 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:45.514824  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.517172  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:45.498622  7567 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:45.517091  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:45.518173  7567 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.518487  4221 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.518728  7567 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.518191  4218 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.521301  7580 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:45.521631  7597 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:45.439121  7564 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.526535  7564 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:45.527824  7683 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:45.532850  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 93205.8us
I20260709 13:19:45.533855  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:45.534529  7620 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:45.534860  6795 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:45.535377  6795 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:45.535912  6795 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.535420  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:45.536731  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:45.537173  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:45.538545  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:45.539261  4294 raft_consensus.cc:2376] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7. Re-sending same reply.
I20260709 13:19:45.535311  7620 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.541982  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:45.496592  7680 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:45.562119  7264 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.563077  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:45.563033  7680 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.564889  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:45.514249  7670 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:19:45.501380  7709 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:19:45.567550  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:45.568179  7716 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.571656  7716 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:45.571796  7314 consensus_queue.cc:1059] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:45.572816  7314 raft_consensus.cc:3055] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:45.573213  7314 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:45.574117  7314 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.575346  7314 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.578943  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:45.579785  4295 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:19:45.537410  4112 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:45.589140  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51822.5us
I20260709 13:19:45.590282  4218 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:19:45.592870  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:45.555243  6795 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.558413  4288 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:45.537551  7718 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.503505  7627 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:45.558877  7421 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.586887  4044 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 4 to 5, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 5 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.621454  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:45.628649  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:45.628717  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:45.629400  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:45.632513  4222 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.633263  6795 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.629673  4293 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:45.591518  7595 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.590703  7376 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.618707  7460 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:45.655560  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55960.1us
I20260709 13:19:45.538246  7602 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.623215  7627 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.619122  7597 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:45.680225  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.662783  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 125693us
I20260709 13:19:45.680650  4222 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:45.627465  7702 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:45.667333  4044 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 4 to 5, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 5 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:45.671377  4221 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:45.676175  6795 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:45.601253  7279 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:19:45.694416  6795 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.701931  4186 leader_election.cc:400] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7.
I20260709 13:19:45.710456  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:45.713266  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.668460  7460 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.667778  7264 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.678431  7627 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.702869  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:45.743221  6795 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:45.668036  7376 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:45.742888  7077 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.001s
I20260709 13:19:45.746244  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:45.724305  7460 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.753695  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:45.753877  4031 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a35e1cee8a15436dbfaf75dd67824aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 32ebd3bc4af5446f94d9f3ac7c8cf53c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:45.718117  7702 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:45.761158  7602 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:45.763890  7376 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:45.765666  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43830.4us
I20260709 13:19:45.749428  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:45.760800  7702 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:45.732378  7618 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.777176  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:45.777999  4217 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.744545  7374 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:45.770556  7077 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:45.816905  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44539.8us
I20260709 13:19:45.817893  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:45.794940  7430 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:45.773131  7564 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:45.771405  7597 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:45.799206  7620 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:45.822816  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.836714  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:45.838562  6795 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.837919  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:45.855290  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:45.894265  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145005us
I20260709 13:19:45.895406  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:45.897439  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:45.829703  7716 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:45.948753  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 110910us
I20260709 13:19:45.950970  6795 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:45.949692  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:45.949959  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:45.836139  7376 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:45.988109  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 90769.9us
I20260709 13:19:45.989260  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:45.990198  7595 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:45.994120  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 240564us
I20260709 13:19:45.995213  4217 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:45.920913  7279 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:45.958804  7264 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:45.982357  7719 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:46.002180  7567 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.018908  7595 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:45.971936  7376 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:46.002708  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.019140  7567 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.035132  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:46.004305  7675 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:46.045110  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.026574  7376 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:46.046846  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 163744us
W20260709 13:19:46.043154  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 85340.9us
W20260709 13:19:46.073968  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.049053  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.029103  7595 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:46.029682  7279 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.085251  6795 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:46.047281  7618 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.047917  7077 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.047271  7564 raft_consensus.cc:2764] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:19:46.089411  7727 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:46.072609  7567 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:46.094969  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67206.3us
I20260709 13:19:46.100239  4296 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:46.101613  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:46.107805  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.096565  6795 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:46.111737  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 161872us
I20260709 13:19:46.113454  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:46.093230  7430 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:46.072387  7264 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:19:46.115628  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.116611  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.124119  4295 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:46.117875  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.070763  7460 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:46.099639  7314 consensus_meta.cc:287] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.524s	user 0.014s	sys 0.002s
I20260709 13:19:46.119551  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.127105  4187 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:46.106935  7724 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:46.119668  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:46.118453  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 125453us
I20260709 13:19:46.115976  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.114089  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.121565  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:46.116487  7077 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.119758  7597 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.120218  7564 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.134877  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.110847  7652 consensus_queue.cc:1059] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:46.154340  7652 raft_consensus.cc:3055] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:46.154812  7718 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:19:46.155454  7718 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.158792  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:46.159641  4925 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.138751  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.129709  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:46.141034  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.140128  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.141433  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.144292  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:46.149348  7627 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.191877  7718 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.151823  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.193013  4288 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:46.139760  7735 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:46.153236  7709 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:46.154768  7652 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:46.134574  4187 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:46.160473  4287 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
W20260709 13:19:46.163605  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.165886  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44424.6us
I20260709 13:19:46.166016  7716 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:46.142040  7595 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.167590  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:46.168084  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.170784  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.172612  7680 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.172957  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.173470  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.174957  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.176276  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.176731  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.178102  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.178308  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.178830  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.179989  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.182125  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.182142  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.135857  7526 raft_consensus.cc:2764] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:46.130744  7374 raft_consensus.cc:2764] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:46.128316  7736 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:46.183959  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:46.173048  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:46.184361  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54770.7us
I20260709 13:19:46.185985  7421 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:46.006871  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:46.229663  7675 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.232198  7716 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:46.239125  7421 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.239645  7421 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.206727  7564 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.244402  4289 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:46.213390  7709 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:46.248963  4291 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:46.249884  7709 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:46.250528  4147 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.251320  7709 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.216889  7735 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.254312  4293 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:46.187836  4044 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.234297  7652 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:46.156533  7597 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.226855  4142 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:46.262445  7711 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:46.187964  7460 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.205755  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:46.267225  4144 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:46.213187  4112 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:46.219280  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 85452.9us
I20260709 13:19:46.220865  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.222661  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.272433  4288 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:46.189921  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45772us
I20260709 13:19:46.223343  4139 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:46.224206  4145 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:46.228718  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.255105  4141 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:46.255507  7627 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.222229  4925 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:46.278048  4140 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:46.292400  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:46.299440  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 86403.7us
I20260709 13:19:46.308655  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:46.313120  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:46.314185  4218 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.326541  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:46.327626  4213 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:46.331511  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.332227  4290 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.333828  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.334422  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:46.332213  4218 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:46.335074  4214 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:46.334533  4293 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:46.336711  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.343137  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.300202  7652 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.351297  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.352713  4294 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.353581  4186 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:46.331200  7736 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:46.354694  4220 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:46.330190  7618 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.356034  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.238322  7376 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:46.239773  7716 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.343026  7564 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:46.378937  4290 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:46.385624  4112 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:46.354420  7718 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:46.387912  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:46.395385  6795 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:46.358546  7627 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.396957  4219 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:46.395596  4214 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:46.372776  7736 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:46.409406  6795 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:46.410593  6795 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.413784  4919 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:46.369473  7526 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:46.427421  4291 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:46.433730  4218 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:46.437704  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 64220.1us
I20260709 13:19:46.439045  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:46.387403  7683 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:46.446882  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:46.390311  7530 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:46.414371  7597 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:46.479501  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:46.414752  7421 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:46.488871  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 135460us
I20260709 13:19:46.490597  4144 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:46.486546  4294 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:46.489035  4293 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:46.483680  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.414011  7376 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:46.493176  4143 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:46.448947  7683 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.495159  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:46.491884  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.500214  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:46.503435  4146 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:46.471127  7484 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:19:46.503486  4144 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:46.449128  7735 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.404060  7718 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:46.470258  7564 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:46.511237  4221 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:46.508843  4138 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:46.483551  7530 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:46.472378  7526 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:46.484298  7077 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:46.449296  7314 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:46.499729  7374 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:46.506186  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 120651us
I20260709 13:19:46.514173  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.521312  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.525978  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:46.408018  7736 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.527251  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:46.427448  7627 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.576624  4144 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:46.549623  7680 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:46.577370  4138 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.506378  7683 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:46.586807  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.588517  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 232522us
I20260709 13:19:46.584553  4143 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:46.510994  7597 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.590633  4215 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:46.602209  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 96065.8us
I20260709 13:19:46.603535  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:46.612607  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:46.615330  4142 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:46.628775  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.629060  7567 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:46.621381  7744 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:19:46.602329  7735 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.621188  7430 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.635121  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:46.644972  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.646955  4259 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:46.629804  7567 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:46.655186  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:46.656095  4143 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.636636  7735 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.660744  7735 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.661480  7421 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.635717  7430 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.663900  7430 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:46.664981  4146 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:46.655814  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:46.687155  4142 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:46.693473  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.694499  4293 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:46.653578  7755 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:46.674161  7374 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:46.732539  4213 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:46.744068  4187 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.708925  7430 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:46.692876  7757 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.727070  7758 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:46.774454  6795 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:46.776084  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.778463  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.784250  4294 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.785625  6795 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:46.733603  7408 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:46.787990  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.792003  7716 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:46.793514  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.801332  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:46.804072  4294 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:46.806324  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.807719  4294 raft_consensus.cc:2410] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:46.696661  7597 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:19:46.818460  4288 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.006s
I20260709 13:19:46.819134  4288 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:46.826390  4138 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:19:46.830612  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 195564us
W20260709 13:19:46.834239  4147 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.004s
I20260709 13:19:46.837774  4147 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:19:46.833431  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.838639  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:46.839011  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:46.840117  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:46.841068  7751 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:46.839351  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:46.841660  7751 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:46.842724  7751 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.845408  7737 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:46.845717  4288 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:46.846547  7737 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:46.847836  7737 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.847968  4288 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:46.853134  4288 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:46.855302  4288 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.859591  4288 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:46.860569  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.765800  7757 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:46.878458  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 117263us
I20260709 13:19:46.879443  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:46.825093  7758 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:19:46.876091  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 129005us
I20260709 13:19:46.756505  7077 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:19:46.763520  7753 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:19:46.820994  7716 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:46.868599  7735 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:46.900544  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61614.7us
I20260709 13:19:46.833002  7421 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:46.758641  7755 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:46.733801  7530 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.909515  4288 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:46.884418  7757 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.733927  7526 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:46.922659  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:46.790959  7314 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:19:46.889778  7374 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:46.921345  7718 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:46.991001  4288 pending_rounds.cc:85] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
W20260709 13:19:46.986929  7752 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:19:46.884611  7564 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:19:47.043370  4288 pending_rounds.cc:107] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:47.053400  4288 raft_consensus.cc:2889] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.980549  7430 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:47.078130  4143 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:47.067076  7709 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.090658  4146 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:47.091797  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 205690us
W20260709 13:19:47.096489  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 295262us
I20260709 13:19:47.099798  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.102232  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.056420  7627 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.091010  7709 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:47.108223  7735 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.128784  7771 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:47.123569  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:47.136281  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 213788us
I20260709 13:19:47.136806  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.124456  7627 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:47.142020  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48570.4us
W20260709 13:19:47.156177  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.155934  7077 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.158196  7077 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.158911  7408 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:47.159497  7408 raft_consensus.cc:697] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:47.168526  7430 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.070235  7758 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:47.153772  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 398073us
I20260709 13:19:47.133399  7771 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:47.204213  7771 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.206233  7771 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.134706  7769 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.143787  7776 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.156863  7735 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:47.232934  7767 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:19:47.172456  7718 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.171568  7597 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.270027  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.270533  7735 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.271286  7735 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.271847  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.245533  7769 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.273491  4217 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:47.274024  7421 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.274190  7769 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.274598  7421 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.248787  7776 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.276916  7421 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.277288  7776 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:47.277684  7759 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.368s	user 0.002s	sys 0.000s
I20260709 13:19:47.239573  7755 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:47.231460  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 78078us
I20260709 13:19:47.285300  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:47.287747  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.225803  7709 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.282763  7627 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.292794  7627 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.295106  7627 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.300202  7595 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:47.315677  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 178960us
I20260709 13:19:47.312227  7597 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.281358  7718 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.305959  7735 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:47.316792  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 173964us
I20260709 13:19:47.319445  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.326138  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.322260  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.332571  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:47.335439  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.336220  4294 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:47.337369  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.337863  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.340513  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.343911  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:47.344744  4288 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:47.347182  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:47.347424  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.347884  4141 raft_consensus.cc:2376] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7. Re-sending same reply.
W20260709 13:19:47.329701  7683 consensus_meta.cc:287] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.001s
I20260709 13:19:47.353048  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.353332  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.354297  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.323287  7718 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.342253  7627 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:47.338119  7279 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.328519  7374 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:47.360795  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:47.317970  7785 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.363838  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.366796  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:47.366359  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 84049.2us
I20260709 13:19:47.371927  4143 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:47.339738  7735 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:47.278870  7757 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.373729  4187 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.373986  4141 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:47.375798  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.373238  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:47.353250  7789 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.322995  7408 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.373175  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.394273  4293 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:47.393847  4138 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:47.398272  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.395030  4144 raft_consensus.cc:2376] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10. Re-sending same reply.
I20260709 13:19:47.399691  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.401350  4294 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:47.402256  7374 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.404670  7597 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:47.366786  7774 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.408273  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:47.379915  7747 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:47.409000  4143 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:47.379900  7680 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:47.366554  7786 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:19:47.405575  7782 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:47.411779  7783 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.413049  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.417289  7567 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:47.417371  7757 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:47.355706  7683 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.440912  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.400108  7279 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:47.450349  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.413842  7652 consensus_meta.cc:287] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.060s	user 0.002s	sys 0.016s
I20260709 13:19:47.458165  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.466418  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.459216  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.462734  4216 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:47.412530  7680 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:47.478884  4141 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:47.476604  4293 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:47.424182  7783 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.454573  7789 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.465732  7771 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.486301  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:47.496001  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.475112  7774 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.478039  7627 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.486028  7680 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:47.478467  7755 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.510217  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:47.490734  7783 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.508745  7792 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:19:47.510255  7627 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.503302  7774 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:47.474531  7279 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.499266  7771 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.509006  7756 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.521250  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.527760  7627 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.530102  7279 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:47.531920  7652 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.541958  7652 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.547861  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:47.549995  4187 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:47.550560  7376 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:47.550964  7787 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.551441  7787 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.551789  7787 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.514824  7374 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:47.553501  7374 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.558748  7374 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:47.562633  7702 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:47.564414  7787 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.564920  7702 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:47.565486  7702 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:47.566447  7702 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.566902  7787 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.567711  7747 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:47.569948  7702 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.574110  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.574935  4140 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:47.577554  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.581133  7718 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.582509  4143 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:47.583542  7718 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.585003  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.586292  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:47.586709  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.586881  4143 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:47.535120  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.528756  4141 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:47.592576  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.576002  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.596774  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:47.625694  4221 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
W20260709 13:19:47.604810  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.596774  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.639950  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:47.598806  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 129173us
W20260709 13:19:47.641745  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.647027  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.596379  7314 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:47.648041  4140 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:47.648137  4146 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:47.518448  7750 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:47.643610  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.538574  7771 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.536782  7756 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:47.654409  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.656328  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 507) took 1320 ms. Trace:
I20260709 13:19:47.527225  7774 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.533067  7077 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.659617  4215 rpcz_store.cc:276] 0709 13:19:46.335615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.336453 (+   838us) service_pool.cc:224] Handling call
0709 13:19:46.347587 (+ 11134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.599603 (+252016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.656042 (+1056439us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54003e5154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:47.656256 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558361856}
I20260709 13:19:47.660818  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.642268  7652 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.661899  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:47.664930  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.668224  4146 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:47.664127  4143 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:47.666860  4140 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:19:47.653841  7751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.015s	sys 0.025s
I20260709 13:19:47.652793  7376 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.643539  7783 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.687490  4218 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:47.539731  7755 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:47.673415  7751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.016s	sys 0.025s
I20260709 13:19:47.661675  7756 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.696264  4140 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:47.674319  7374 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.655411  7314 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.710429  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.714409  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.714881  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:47.717295  4187 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:47.718451  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:47.719466  4144 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:47.718132  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:47.720893  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.721850  4221 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:19:47.722659  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2247) took 1430 ms. Trace:
I20260709 13:19:47.722820  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:47.723592  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:47.723894  4140 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.724331  4291 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.730129  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.730969  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:47.731379  7739 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:47.684908  7376 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.693001  7680 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.720918  7764 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:47.750366  7764 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:47.751648  7680 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:47.751780  4294 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:47.738423  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:47.773250  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.770147  7739 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:19:47.778198  7755 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.780992  7421 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:47.721057  7771 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:47.742681  7770 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.725654  7597 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:47.747326  7796 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:47.721123  7757 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:47.721002  7702 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.725869  7747 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.703091  4215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:19:47.763566  7077 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:47.703588  7758 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:47.767882  7783 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.723271  4292 rpcz_store.cc:276] 0709 13:19:46.291995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.292141 (+   146us) service_pool.cc:224] Handling call
0709 13:19:46.339287 (+ 47146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.339911 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.339954 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.340720 (+   766us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.454731 (+114011us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:46.454789 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.467565 (+ 12776us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.378085 (+910520us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b1800442420. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:19:47.713134 (+335049us) raft_consensus.cc:1685] finished
0709 13:19:47.713160 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.722575 (+  9415us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8773,"spinlock_wait_cycles":5804544,"thread_start_us":81069,"threads_started":1,"wal-append.queue_time_us":96159}
I20260709 13:19:47.769045  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 504) took 1935 ms. Trace:
I20260709 13:19:47.780839  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.809839  4219 rpcz_store.cc:276] 0709 13:19:45.833513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.833685 (+   172us) service_pool.cc:224] Handling call
0709 13:19:45.834016 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.410242 (+576226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.768753 (+1358511us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b540041aad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:47.768979 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278147456}
I20260709 13:19:47.738924  4259 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:47.790819  7376 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.794973  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.795537  4291 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:47.792831  7597 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.782837  7739 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.782475  7771 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:47.816012  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 93715.4us
I20260709 13:19:47.797240  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:47.814596  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.798662  4215 raft_consensus.cc:606] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.822873  4215 raft_consensus.cc:614] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:47.806586  7747 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.813874  7374 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.819603  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.817968  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.822886  4291 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:19:47.801571  7680 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:47.826937  4292 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:47.797863  7702 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:47.812949  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 74142.2us
I20260709 13:19:47.828786  4291 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:47.832759  4291 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:47.824805  4219 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.798162  7757 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:47.833195  4291 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:47.826495  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:47.821307  7794 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.359s	user 0.004s	sys 0.000s
I20260709 13:19:47.818586  7718 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.821614  7771 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:47.793344  7770 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.836514  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:47.837059  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:47.819098  7597 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.833894  7702 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.808895  7077 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.844722  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.859861  4142 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:19:47.845471  4140 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:47.847121  4138 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:47.862210  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:47.862829  4140 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.848718  4291 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.850262  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.826771  7747 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.854326  4141 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:47.858328  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.858800  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:47.860268  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.865619  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.823135  7739 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.853139  7757 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.869360  4214 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:47.865717  7785 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.857380  7600 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:47.872570  4146 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:47.872942  7314 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:47.863440  7279 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:19:47.886281  4140 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:47.873952  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:47.887276  4138 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.873409  4215 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:47.875200  4291 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.873515  7787 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:47.869828  7718 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:47.872658  7620 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:47.856729  7736 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:47.895192  7736 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:47.877370  7627 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:47.877339  7758 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.896267  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:47.878701  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.897224  4920 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:47.897356  4293 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:19:47.869812  4145 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:47.898586  7787 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.899597  4145 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.900820  7620 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:47.901095  4145 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:47.901861  7620 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.882854  4924 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:47.884727  7600 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.903059  4145 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:47.858685  7762 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.877s	user 0.000s	sys 0.004s
I20260709 13:19:47.904538  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:47.894309  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:47.894485  4143 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:47.908458  4145 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:47.895001  7803 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:19:47.880374  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.903595  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:47.887173  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:47.855101  7680 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.902834  7785 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.910538  7600 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.917814  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 510) took 1523 ms. Trace:
W20260709 13:19:47.921286  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.932126  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.916229  4140 raft_consensus.cc:606] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.930898  4290 rpcz_store.cc:276] 0709 13:19:46.394851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.476684 (+ 81833us) service_pool.cc:224] Handling call
0709 13:19:46.477086 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.488013 (+ 10927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.488049 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.488665 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.726222 (+237557us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:46.726292 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.726423 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.843172 (+1116749us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:47.917499 (+ 74327us) raft_consensus.cc:1685] finished
0709 13:19:47.917522 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.917745 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2707,"raft.queue_time_us":2884,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":9486,"spinlock_wait_cycles":79875840,"thread_start_us":155562,"threads_started":1,"wal-append.queue_time_us":286675}
I20260709 13:19:47.918846  4215 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:47.935868  4291 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:47.936278  4291 pending_rounds.cc:85] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 3
I20260709 13:19:47.936594  4291 pending_rounds.cc:107] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:47.936911  4291 raft_consensus.cc:2889] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:47.939884  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:47.940073  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59912.3us
I20260709 13:19:47.934548  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:47.941330  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:47.942883  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:47.957619  4290 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:47.957834  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:47.958280  4290 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:47.959014  4142 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:47.965332  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:47.919595  7783 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:47.927424  7770 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:47.975769  4138 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:47.931622  7785 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:47.950095  7279 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.950309  7737 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.950498  7751 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:47.960135  4290 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.989950  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.990856  4214 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:47.961650  7755 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:47.896298  7736 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:47.979475  7783 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.990304  7790 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:47.980847  7279 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.001729  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:47.984508  7716 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:47.984453  7735 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.035501  7735 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:48.001406  7783 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.985819  7737 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.989380  7740 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.069803  4139 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:48.069753  4214 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:48.069582  4147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1828) took 1886 ms (client timeout 2047 ms). Trace:
W20260709 13:19:48.070732  4147 rpcz_store.cc:269] 0709 13:19:46.183104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.183644 (+   540us) service_pool.cc:224] Handling call
0709 13:19:48.069365 (+1885721us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5400396cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:48.069514 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26409216}
W20260709 13:19:48.013273  7804 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:19:48.013670  7763 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.113s	user 0.004s	sys 0.000s
I20260709 13:19:48.014904  7421 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:48.086606  7421 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.020654  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:48.022205  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.023584  7739 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:47.989239  7680 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:48.027534  7702 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.029855  7716 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.030500  7805 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.995625  7785 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.033301  7279 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.035490  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6091d765c73842c992d8c60523872ccc"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:47.996810  7792 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:48.001051  7755 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:47.993683  7756 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.004587  7803 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:19:48.071575  7737 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:48.085515  7808 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:19:48.119725  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:48.090049  7774 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.206540  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:48.287115  7526 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:48.318516  7526 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:48.319614  7756 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:48.202670  7765 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 1.282s	user 0.000s	sys 0.005s
I20260709 13:19:48.317875  4289 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.201668  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:48.324419  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:48.330305  4291 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:48.315264  4140 raft_consensus.cc:606] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:48.336273  4925 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:19:48.235852  4214 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:48.230935  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:48.333515  4110 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:48.345957  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:48.235234  4219 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:48.227870  4218 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.232980  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2057) took 2090 ms. Trace:
W20260709 13:19:48.192215  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.354370  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.315290  4216 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:48.343107  4294 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
W20260709 13:19:48.310367  7795 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.849s	user 0.002s	sys 0.003s
I20260709 13:19:48.350497  4295 rpcz_store.cc:276] 0709 13:19:46.142505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.222536 (+ 80031us) service_pool.cc:224] Handling call
0709 13:19:46.250066 (+ 27530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.303752 (+ 53686us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:46.352199 (+ 48447us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.501516 (+149317us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.509727 (+  8211us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.509934 (+   207us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:46.830897 (+320963us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.831426 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.232359 (+1400933us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54002d5fd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:48.232434 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.232626 (+   192us) raft_consensus.cc:1685] finished
0709 13:19:48.232648 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.232890 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19567,"prepare.queue_time_us":141145,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":4561,"raft.queue_time_us":45168,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":57385,"spinlock_wait_cycles":32124800,"thread_start_us":417190,"threads_started":2,"wal-append.queue_time_us":303479,"wal-append.run_cpu_time_us":4861,"wal-append.run_wall_time_us":1427526}
W20260709 13:19:48.369042  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 455383us
I20260709 13:19:48.117990  7652 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.391383  4218 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:48.092617  7757 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.287906  7806 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:48.336771  7787 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:48.400697  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.163779  7780 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:48.082237  7597 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:48.374769  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 395118us
I20260709 13:19:48.089159  7771 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:48.411183  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 428835us
I20260709 13:19:48.136480  7716 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.424921  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:48.361305  7595 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:48.418780  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:48.089398  7740 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:48.366953  7421 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:48.362403  7758 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:48.427492  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:48.427671  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 112963us
I20260709 13:19:48.434376  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:48.434978  4292 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:48.298669  7600 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:48.165410  7785 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.415858  7801 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.452649  4215 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:48.448202  4295 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:19:48.453457  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.396921  7680 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:19:48.164846  7805 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.166914  7747 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.448203  4294 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:48.463941  4222 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:48.433449  7526 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:48.450793  7736 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:48.418520  7408 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:19:48.451139  7735 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:48.433907  7484 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:48.416501  7652 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:48.492684  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2269) took 1160 ms. Trace:
I20260709 13:19:48.509399  4288 rpcz_store.cc:276] 0709 13:19:47.332629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.399000 (+ 66371us) service_pool.cc:224] Handling call
0709 13:19:47.410725 (+ 11725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.414563 (+  3838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.414598 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.415598 (+  1000us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.461108 (+ 45510us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:47.461152 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.461237 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.309390 (+848153us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:48.492327 (+182937us) raft_consensus.cc:1685] finished
0709 13:19:48.492371 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.492621 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4735,"raft.queue_time_us":3645,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":25073,"spinlock_wait_cycles":22097792,"thread_start_us":45051,"threads_started":1,"wal-append.queue_time_us":45541}
I20260709 13:19:48.491690  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:48.493333  7408 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:48.493918  7813 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.494436  7077 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:48.495465  7755 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:48.496644  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1836) took 1022 ms. Trace:
I20260709 13:19:48.536732  4146 rpcz_store.cc:276] 0709 13:19:47.474534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.676256 (+201722us) service_pool.cc:224] Handling call
0709 13:19:47.691977 (+ 15721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.885085 (+193108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.496265 (+611180us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400285d54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:48.496558 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414777088}
I20260709 13:19:48.538698  7600 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:48.501605  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:48.502063  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49452.3us
I20260709 13:19:48.450294  7781 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:19:48.430500  7780 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:48.460168  7376 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.492266  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 515) took 1280 ms. Trace:
I20260709 13:19:48.543291  4213 rpcz_store.cc:276] 0709 13:19:47.212456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.212654 (+   198us) service_pool.cc:224] Handling call
0709 13:19:47.213177 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.292191 (+ 79014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.292236 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.292905 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.339117 (+ 46212us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:47.339157 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.491680 (+1152523us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b54002f3d54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:48.491760 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.491831 (+    71us) raft_consensus.cc:1685] finished
0709 13:19:48.491849 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.492182 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31240,"raft.queue_time_us":33415,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":11199,"spinlock_wait_cycles":156416896,"thread_start_us":45795,"threads_started":1,"wal-append.queue_time_us":42661,"wal-append.run_cpu_time_us":2258,"wal-append.run_wall_time_us":1008078}
I20260709 13:19:48.547462  4213 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:48.516516  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 2278) took 1181 ms. Trace:
I20260709 13:19:48.548535  4296 rpcz_store.cc:276] 0709 13:19:47.335559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.337599 (+  2040us) service_pool.cc:224] Handling call
0709 13:19:48.516233 (+1178634us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400353ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:48.516438 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384311680}
I20260709 13:19:48.516685  7683 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:48.517382  7597 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:48.518910  4919 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:48.420905  7806 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.522516  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1869) took 1034 ms. Trace:
I20260709 13:19:48.511744  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:48.566403  4215 rpcz_store.cc:276] 0709 13:19:47.488603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.936095 (+447492us) service_pool.cc:224] Handling call
0709 13:19:47.954061 (+ 17966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.456029 (+501968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.522049 (+ 66020us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b5400215f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:48.522410 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145976064}
I20260709 13:19:48.500149  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:48.459604  7803 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:48.483596  7526 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.561370  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:48.467861  7758 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:19:48.573166  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:48.574810  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:48.575600  4146 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
W20260709 13:19:48.576375  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 126933us
I20260709 13:19:48.579365  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:48.580185  4141 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:48.582175  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:48.541751  7408 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:48.554531  7709 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.583727  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:48.583000  4295 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:48.588599  4141 raft_consensus.cc:2376] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12. Re-sending same reply.
I20260709 13:19:48.590310  7815 consensus_queue.cc:1059] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:48.591497  7815 raft_consensus.cc:3055] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:48.591856  7815 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:48.593045  7815 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:48.594729  7815 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.586587  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:48.602138  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.457501  7801 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:48.602881  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:48.606137  4146 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:19:48.606353  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 94709.1us
I20260709 13:19:48.608729  4213 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:19:48.609467  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.609472  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:48.610975  4138 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:48.610136  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:48.614223  7530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.451s	user 0.027s	sys 0.016s
I20260709 13:19:48.618469  4141 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:19:48.620860  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:48.621759  4295 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:48.585896  7597 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:48.554670  7782 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:19:48.631737  7740 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:48.632014  7782 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:48.575469  7526 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.632627  7782 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:48.633610  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:48.634714  7526 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:48.636809  7806 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:48.629792  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:48.630254  7826 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:48.631137  7780 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:48.615790  7711 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:48.633916  7782 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.569476  7756 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:48.558887  7376 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.623365  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:48.625818  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:48.541873  7813 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.637099  4923 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:49.084296  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:48.815966  4295 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:49.137094  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:48.734462  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.224336  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.225236  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.264998  4261 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.007s	sys 0.008s
W20260709 13:19:49.265885  4261 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.008s
W20260709 13:19:49.266525  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 720007us
W20260709 13:19:48.618440  7530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.456s	user 0.027s	sys 0.016s
I20260709 13:19:49.569676  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:49.570639  4295 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
W20260709 13:19:49.582346  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55471.3us
I20260709 13:19:48.629035  7597 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:48.667389  7805 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:49.138916  7711 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.657249  7757 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:49.629045  7827 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:49.055617  7771 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:49.532382  7803 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:49.592157  7782 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:49.632174  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.638507  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.638307  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:49.648851  7827 consensus_queue.cc:1243] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:49.649811  7757 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:49.650641  7757 consensus_queue.cc:1243] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:49.653774  7805 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:49.655444  7805 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:49.656240  7805 consensus_queue.cc:1243] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:49.657120  7757 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:49.657507  7757 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:49.658399  7757 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:49.632086  7711 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.662832  7597 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:49.664827  7597 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.599617  7806 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:19:49.630945  7803 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:49.627846  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:48.725136  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.673247  7747 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:49.753499  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:49.677505  7783 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.641s	user 0.015s	sys 0.002s
I20260709 13:19:48.636945  7652 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:49.706779  7716 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.265s	user 0.009s	sys 0.004s
W20260709 13:19:48.953974  7279 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.003s
W20260709 13:19:49.768712  4893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.799s (SENT) [suppressed 11 similar messages]
W20260709 13:19:49.754966  7709 consensus_meta.cc:287] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.148s	user 0.010s	sys 0.002s
W20260709 13:19:48.662987  7812 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:19:48.661958  7823 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:48.954130  7421 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:48.668237  7785 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:49.760054  7826 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:49.823079  4926 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:49.777818  7279 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.665729  7801 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:49.767722  7783 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:48.668835  7408 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:49.778225  7716 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:49.842959  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.825930  7740 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.882602  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2281) took 2358 ms. Trace:
I20260709 13:19:49.883185  4287 rpcz_store.cc:276] 0709 13:19:47.524425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.859131 (+334706us) service_pool.cc:224] Handling call
0709 13:19:47.881159 (+ 22028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.972996 (+ 91837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.973047 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.989426 (+ 16379us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.100653 (+111227us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:48.100715 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.103255 (+  2540us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.882307 (+1779052us) raft_consensus.cc:1685] finished
0709 13:19:49.882330 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.882511 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2310,"raft.queue_time_us":63989,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":3546,"thread_start_us":189008,"threads_started":2,"wal-append.queue_time_us":433435}
I20260709 13:19:49.901178  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:49.902267  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47710 (request call id 523) took 1268 ms. Trace:
I20260709 13:19:49.902671  4287 rpcz_store.cc:276] 0709 13:19:48.633589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.885168 (+1251579us) service_pool.cc:224] Handling call
0709 13:19:49.902189 (+ 17021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.903801  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:49.904418  4287 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:49.905287  7813 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:49.905402  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2084) took 1360 ms. Trace:
I20260709 13:19:49.905952  4287 rpcz_store.cc:276] 0709 13:19:48.545096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.903485 (+1358389us) service_pool.cc:224] Handling call
0709 13:19:49.905341 (+  1856us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.907465  4287 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:49.908134  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2295) took 1978 ms. Trace:
I20260709 13:19:49.908551  4287 rpcz_store.cc:276] 0709 13:19:47.929874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.906764 (+1976890us) service_pool.cc:224] Handling call
0709 13:19:49.907273 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.907863 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.908072 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.910406  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2298) took 1868 ms. Trace:
I20260709 13:19:49.910804  4287 rpcz_store.cc:276] 0709 13:19:48.042225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.909462 (+1867237us) service_pool.cc:224] Handling call
0709 13:19:49.909831 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.910051 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.910079 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:49.910128 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:49.910163 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.910222 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.910350 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.912914  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 521) took 1481 ms. Trace:
I20260709 13:19:49.913367  4287 rpcz_store.cc:276] 0709 13:19:48.431758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.911900 (+1480142us) service_pool.cc:224] Handling call
0709 13:19:49.912303 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.912552 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.912581 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:49.912626 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:49.912660 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.912721 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.912856 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.894894  7801 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:49.928056  7801 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:49.931439  7801 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:49.934414  7737 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.573s	user 0.007s	sys 0.008s
I20260709 13:19:49.873615  7740 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:49.955763  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 186498us
I20260709 13:19:49.955790  7279 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:49.957746  7827 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.958326  7827 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:49.962582  7756 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:49.969050  7756 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:49.971630  7756 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:49.991535  7831 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:19:49.996254  7815 consensus_meta.cc:287] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.401s	user 0.013s	sys 0.000s
I20260709 13:19:49.996436  7711 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:49.997282  7652 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.997503  7838 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:49.997933  7652 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:49.998109  7838 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.000641  7783 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.000973  7827 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:19:50.002089  7838 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:49.999142  7711 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.002524  7716 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:49.954339  7803 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:49.956374  7813 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.005939  7839 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.006032  7813 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.006937  7839 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.008410  7813 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:49.953835  7737 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.010437  7839 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.010842  7806 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:50.011059  7803 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:50.011579  7756 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.012470  7774 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.018234  4295 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:50.016846  7803 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.018810  7782 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:50.019551  7782 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.020771  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 2302) took 1575 ms. Trace:
I20260709 13:19:50.020896  7803 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:50.021180  4295 rpcz_store.cc:276] 0709 13:19:48.445315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.571482 (+1126167us) service_pool.cc:224] Handling call
0709 13:19:50.020537 (+449055us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400276fd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:50.020691 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717303680}
I20260709 13:19:50.017107  7756 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.021572  7803 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.022497  7838 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.030939  7838 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:50.032358  4261 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.047s (SENT)
I20260709 13:19:50.032975  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:50.034176  4220 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:50.035274  4220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1865) took 2560 ms (client timeout 1966 ms). Trace:
I20260709 13:19:50.037185  7838 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.038179  7838 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:50.037292  7803 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.039364  7756 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:50.035619  4220 rpcz_store.cc:269] 0709 13:19:47.475231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.561329 (+ 86098us) service_pool.cc:224] Handling call
0709 13:19:48.501340 (+940011us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:19:50.035015 (+1533675us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400181354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:50.035180 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3506913792}
I20260709 13:19:50.041711  7803 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.042539  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:50.043447  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1879) took 1435 ms. Trace:
I20260709 13:19:50.043893  4220 rpcz_store.cc:276] 0709 13:19:48.608496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.042219 (+1433723us) service_pool.cc:224] Handling call
0709 13:19:50.043369 (+  1150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.022688  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:50.023276  7774 consensus_queue.cc:1059] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:50.016753  7806 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.053102  4295 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:50.018051  7737 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.021745  7782 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:50.057866  7806 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:50.013926  7597 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:50.060451  7597 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.053565  7774 raft_consensus.cc:3055] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:50.064482  7597 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:50.068043  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:50.063591  4295 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:50.069317  7667 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:50.069685  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2303) took 1623 ms. Trace:
I20260709 13:19:50.069872  7667 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:50.070135  4295 rpcz_store.cc:276] 0709 13:19:48.446142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.061088 (+1614946us) service_pool.cc:224] Handling call
0709 13:19:50.063117 (+  2029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.069383 (+  6266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.069622 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.064674  7774 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:50.070895  7667 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.072811  7774 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.083407  4892 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:50.084811  7774 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:50.086946  7702 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.090278  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35142 (request call id 31) took 2056 ms. Trace:
I20260709 13:19:50.090782  4140 rpcz_store.cc:276] 0709 13:19:48.033887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.035302 (+  1415us) service_pool.cc:224] Handling call
0709 13:19:50.089999 (+2054697us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b4c001984c0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3cfaea20 00007fee3cfbfa29 00007fee3cf85644 00007fee3cfacf2d 00007fee3cfacb93 00007fee3ecdcc92 00007fee3ecdc84a 00007fee43caa60a 00007fee3d2307d4 00007fee3d230762 00007fee3d230691
0709 13:19:50.090169 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130097408}
I20260709 13:19:50.092242  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.093226  4140 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
W20260709 13:19:50.093717  4140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2077) took 1464 ms (client timeout 1727 ms). Trace:
W20260709 13:19:50.094094  4140 rpcz_store.cc:269] 0709 13:19:48.629542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.091893 (+1462351us) service_pool.cc:224] Handling call
0709 13:19:50.093655 (+  1762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.095063  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.095819  4140 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:50.097370  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.096247  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2073) took 1468 ms. Trace:
I20260709 13:19:50.098423  4140 rpcz_store.cc:276] 0709 13:19:48.627886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.094775 (+1466889us) service_pool.cc:224] Handling call
0709 13:19:50.096191 (+  1416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.099735  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.101147  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2074) took 1472 ms. Trace:
I20260709 13:19:50.101545  4140 rpcz_store.cc:276] 0709 13:19:48.628455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.099096 (+1470641us) service_pool.cc:224] Handling call
0709 13:19:50.101085 (+  1989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.102433  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.103041  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2075) took 1474 ms. Trace:
I20260709 13:19:50.103292  4140 rpcz_store.cc:276] 0709 13:19:48.628828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.102196 (+1473368us) service_pool.cc:224] Handling call
0709 13:19:50.102993 (+   797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.104036  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.105003  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2076) took 1475 ms. Trace:
I20260709 13:19:50.101367  7841 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:50.105451  4140 rpcz_store.cc:276] 0709 13:19:48.629180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.103839 (+1474659us) service_pool.cc:224] Handling call
0709 13:19:50.104936 (+  1097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.106295  7841 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:50.106793  7841 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.107694  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2072) took 1480 ms. Trace:
I20260709 13:19:50.108407  4140 rpcz_store.cc:276] 0709 13:19:48.627415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.106512 (+1479097us) service_pool.cc:224] Handling call
0709 13:19:50.106982 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.107286 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.107314 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.107363 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:50.107412 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.107474 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.107635 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.112797  4290 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:50.114418  7805 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:50.115262  7805 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.117101  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2082) took 1603 ms. Trace:
I20260709 13:19:50.117627  4295 rpcz_store.cc:276] 0709 13:19:48.513855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.071038 (+1557183us) service_pool.cc:224] Handling call
0709 13:19:50.071426 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.072364 (+   938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.072396 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.073072 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.113002 (+ 39930us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:50.113078 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.113203 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.116795 (+  3592us) raft_consensus.cc:1685] finished
0709 13:19:50.116827 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.117027 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":573,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":39318,"threads_started":1,"wal-append.queue_time_us":41101}
I20260709 13:19:50.129921  7597 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.130682  7597 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.139997  7841 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.145869  7841 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.148782  7597 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.157359  4290 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:50.164621  4290 pending_rounds.cc:85] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 3
I20260709 13:19:50.165227  4290 pending_rounds.cc:107] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:50.165701  4290 raft_consensus.cc:2889] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.167421  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2079) took 2428 ms. Trace:
I20260709 13:19:50.168025  4290 rpcz_store.cc:276] 0709 13:19:47.738454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.957235 (+218781us) service_pool.cc:224] Handling call
0709 13:19:47.957498 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.111992 (+2154494us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b58006719d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec3e0aa 00007fee3ecc0447 00007fee3ecd8fe7 00007fee3ecda7de 00007fee3ece4b49 00007fee3ece5416 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4
0709 13:19:50.166493 (+ 54501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.167281 (+   788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874197248}
I20260709 13:19:50.172114  7597 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.172818  7597 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.173430  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2081) took 1684 ms. Trace:
I20260709 13:19:50.174109  4288 rpcz_store.cc:276] 0709 13:19:48.488701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.066890 (+1578189us) service_pool.cc:224] Handling call
0709 13:19:50.067317 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:50.069080 (+  1763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.069114 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:50.070246 (+  1132us) log.cc:844] Serialized 52 byte log entry
0709 13:19:50.120388 (+ 50142us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:50.170153 (+ 49765us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.171429 (+  1276us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.172754 (+  1325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.172855 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.172899 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:50.172913 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.173234 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50547,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":914,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":314,"thread_start_us":78582,"threads_started":2,"wal-append.queue_time_us":63469}
I20260709 13:19:50.176615  7597 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.171473  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:50.177398  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2085) took 1629 ms. Trace:
I20260709 13:19:50.177937  4288 rpcz_store.cc:276] 0709 13:19:48.547788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.176405 (+1628617us) service_pool.cc:224] Handling call
0709 13:19:50.176822 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.177049 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.177076 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.177121 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:50.177161 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.177219 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.177343 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:50.236562  4146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.602s	user 0.010s	sys 0.013s
W20260709 13:19:50.237035  4146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.602s	user 0.010s	sys 0.013s
I20260709 13:19:50.237985  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1857) took 1616 ms. Trace:
I20260709 13:19:50.238425  4146 rpcz_store.cc:276] 0709 13:19:48.621447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.622320 (+   873us) service_pool.cc:224] Handling call
0709 13:19:48.622694 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.633838 (+ 11144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.633880 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.634386 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.237510 (+1603124us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:50.237560 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.237655 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.237727 (+    72us) raft_consensus.cc:1685] finished
0709 13:19:50.237737 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.237908 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3582,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":13570,"thread_start_us":1602658,"threads_started":1,"wal-append.queue_time_us":1132554}
I20260709 13:19:50.347927  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2291) took 2485 ms. Trace:
I20260709 13:19:50.348516  4294 rpcz_store.cc:276] 0709 13:19:47.862436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.366411 (+503975us) service_pool.cc:224] Handling call
0709 13:19:48.367090 (+   679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.465727 (+ 98637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.347495 (+1881768us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b540042a4d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:50.347823 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184299264}
I20260709 13:19:50.351608  7652 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.385144  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2062) took 2702 ms. Trace:
I20260709 13:19:50.385936  4144 rpcz_store.cc:276] 0709 13:19:47.682479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.939514 (+257035us) service_pool.cc:224] Handling call
0709 13:19:47.960410 (+ 20896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.960668 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:48.114209 (+153541us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.382837 (+2268628us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b1800433ba0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee3bbf7a40 00007fee3bbf24e4 00007fee3bbf2455 00007fee426da3c7 00007fee3ecec9a7 00007fee3ecfc0bf 00007fee3ecfc038
0709 13:19:50.383171 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.384428 (+  1257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.384658 (+   230us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:50.384725 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.384827 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.385016 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14317,"raft.queue_time_us":207,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":3833,"spinlock_wait_cycles":531840384,"thread_start_us":133076,"threads_started":2,"wal-append.queue_time_us":1396}
I20260709 13:19:50.417145  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2280) took 2915 ms. Trace:
I20260709 13:19:50.417488  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2024) took 3942 ms. Trace:
I20260709 13:19:50.417754  4292 rpcz_store.cc:276] 0709 13:19:47.502178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.841627 (+339449us) service_pool.cc:224] Handling call
0709 13:19:47.842004 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.446625 (+604621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.416749 (+1970124us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54000eb854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:50.417035 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356886784}
I20260709 13:19:50.418026  4139 rpcz_store.cc:276] 0709 13:19:46.474784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.483299 (+  8515us) service_pool.cc:224] Handling call
0709 13:19:48.069547 (+1586248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.070494 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.417246 (+2346752us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400396cd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:50.417409 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3646973696}
W20260709 13:19:50.422310  4218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.858s	user 0.017s	sys 0.007s
W20260709 13:19:50.422806  4218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.862s	user 0.018s	sys 0.007s
I20260709 13:19:50.429889  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2347) took 2587 ms. Trace:
I20260709 13:19:50.430524  4218 rpcz_store.cc:276] 0709 13:19:47.842338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.560153 (+717815us) service_pool.cc:224] Handling call
0709 13:19:48.560516 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.423239 (+1862723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.423289 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.423883 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.425007 (+  1124us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:50.425057 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.425155 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.429587 (+  4432us) raft_consensus.cc:1685] finished
0709 13:19:50.429610 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.429804 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47602,"raft.queue_time_us":24957,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":1862857,"threads_started":2,"wal-append.queue_time_us":1279}
W20260709 13:19:50.435796  4042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 177) took 23441 ms (client timeout 15000 ms). Trace:
I20260709 13:19:50.437058  4293 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:50.437723  4293 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:50.438819  4293 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.439841  4293 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:50.436408  4042 rpcz_store.cc:269] 0709 13:19:26.994344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.994758 (+   414us) service_pool.cc:224] Handling call
0709 13:19:28.331558 (+1336800us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b5400030890. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbe0b2 00007fee44b37a89 00007fee44acfda6 00007fee44aa1088 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc
0709 13:19:50.435483 (+22103925us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:39.280841 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:39.481194 (+200353us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:39.481253 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:19:39.481277 (+    24us) tablet.cc:662] Decoding operations
0709 13:19:39.552305 (+ 71028us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:39.552430 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:39.552464 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:19:39.553429 (+   965us) tablet.cc:701] Row locks acquired
0709 13:19:39.553602 (+   173us) write_op.cc:260] PREPARE: finished
0709 13:19:39.553833 (+   231us) write_op.cc:270] Start()
0709 13:19:39.554041 (+   208us) write_op.cc:276] Timestamp: P: 1783603179553747 usec, L: 0
0709 13:19:39.554059 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:19:39.564660 (+ 10601us) log.cc:844] Serialized 3271 byte log entry
0709 13:19:40.783069 (+1218409us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b1800224200. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:19:41.536904 (+753835us) op_driver.cc:464] REPLICATION: finished
0709 13:19:41.699727 (+162823us) write_op.cc:301] APPLY: starting
0709 13:19:41.699859 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:41.700147 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:41.700185 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:41.701498 (+  1313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:41.702066 (+   568us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:19:41.702112 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:41.702474 (+   362us) log.cc:844] Serialized 64 byte log entry
0709 13:19:41.702703 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:41.702838 (+   135us) write_op.cc:454] Released schema lock
0709 13:19:41.702915 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:41.750834 (+ 47919us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:41.750875 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1660692,"reported_tablets":45,"spinlock_wait_cycles":9849600,"child_traces":[["op",{"apply.queue_time_us":162452,"apply.run_cpu_time_us":3757,"apply.run_wall_time_us":32062,"num_ops":8,"prepare.queue_time_us":198318,"prepare.run_cpu_time_us":61194,"prepare.run_wall_time_us":1305278,"raft.queue_time_us":404416,"raft.run_cpu_time_us":6701,"raft.run_wall_time_us":38363,"replication_time_us":1982646,"spinlock_wait_cycles":37521024,"thread_start_us":1337336,"threads_started":4,"wal-append.queue_time_us":1030160,"wal-append.run_cpu_time_us":44415,"wal-append.run_wall_time_us":1922736}]]}
I20260709 13:19:50.446903  4217 raft_consensus.cc:2368] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
W20260709 13:19:50.448570  4217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1873) took 2903 ms (client timeout 2170 ms). Trace:
W20260709 13:19:50.449047  4217 rpcz_store.cc:269] 0709 13:19:47.545543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.584740 (+ 39197us) service_pool.cc:224] Handling call
0709 13:19:48.345715 (+760975us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:19:50.448261 (+2102546us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54003e4c54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:50.448481 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4847603840}
I20260709 13:19:50.453501  4925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 471) took 2030 ms. Trace:
I20260709 13:19:50.454011  4925 rpcz_store.cc:276] 0709 13:19:48.422842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.430779 (+  7937us) service_pool.cc:224] Handling call
0709 13:19:48.431154 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.579924 (+148770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.579954 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:48.579998 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:48.580029 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.453155 (+1873126us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54004ec5d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:50.453215 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.453387 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341600640}
I20260709 13:19:50.459482  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2078) took 2721 ms. Trace:
I20260709 13:19:50.460135  4293 rpcz_store.cc:276] 0709 13:19:47.738148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.956767 (+218619us) service_pool.cc:224] Handling call
0709 13:19:47.977981 (+ 21214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.436955 (+2458974us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b54002c63a0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec59dc0 00007fee3ece41c0 00007fee3ece5231 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c
0709 13:19:50.459087 (+ 22132us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:50.459121 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.459163 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:50.459197 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.459259 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.459399 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48656640}
I20260709 13:19:50.467249  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2078) took 1837 ms. Trace:
I20260709 13:19:50.467832  4139 rpcz_store.cc:276] 0709 13:19:50.465994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.466201 (+   207us) service_pool.cc:224] Handling call
0709 13:19:50.466618 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.466845 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.466877 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.466930 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:50.466971 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.467032 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.467176 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.471779  7737 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.472553  7737 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.473747  4144 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:50.474948  7737 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.475536  7737 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.476014  7737 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.476861  4215 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
W20260709 13:19:50.477440  4215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1876) took 1870 ms (client timeout 1860 ms). Trace:
W20260709 13:19:50.477823  4215 rpcz_store.cc:269] 0709 13:19:48.607416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.607596 (+   180us) service_pool.cc:224] Handling call
0709 13:19:50.477362 (+1869766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.478930  7716 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.479564  7716 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.482544  7716 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.484884  7716 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.485448  7716 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.489014  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.478969  7737 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.490006  4144 raft_consensus.cc:2376] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 9. Re-sending same reply.
I20260709 13:19:50.489122  7716 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.489135  7787 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:50.495005  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.495757  4146 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.511106  7826 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.511875  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.512665  4140 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:19:50.512789  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.513607  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.513954  4146 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:50.514258  4140 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:50.513526  4147 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:50.515113  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.515589  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.516512  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.516916  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.517159  4140 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:50.517606  4147 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:50.518191  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.519392  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.519872  4140 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.520527  7826 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.515090  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.521581  4146 raft_consensus.cc:2376] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 8. Re-sending same reply.
I20260709 13:19:50.521906  4919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42928 (request call id 274) took 2185 ms. Trace:
I20260709 13:19:50.522516  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.522305  4919 rpcz_store.cc:276] 0709 13:19:48.336035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.347006 (+ 10971us) service_pool.cc:224] Handling call
0709 13:19:48.415929 (+ 68923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.563056 (+147127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.521566 (+1958510us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54002b2354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:50.521804 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100766080}
I20260709 13:19:50.525874  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.526562  4146 raft_consensus.cc:2376] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7. Re-sending same reply.
I20260709 13:19:50.527544  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:48.621752  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:50.531189  4141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1856) took 1910 ms (client timeout 1737 ms). Trace:
W20260709 13:19:50.531615  4141 rpcz_store.cc:269] 0709 13:19:48.620455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.621220 (+   765us) service_pool.cc:224] Handling call
0709 13:19:50.531106 (+1909886us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.528174  4146 raft_consensus.cc:2376] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 8. Re-sending same reply.
I20260709 13:19:50.539162  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.547750  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.548652  4146 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:50.548779  7757 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:50.549715  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.550944  4140 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:50.551916  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.552240  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:50.552591  4140 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:50.553438  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.553985  4140 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:50.551916  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:50.554759  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.555291  4140 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:50.555660  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:50.526813  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1871) took 3021 ms. Trace:
I20260709 13:19:50.556951  4222 rpcz_store.cc:276] 0709 13:19:47.505076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.212003 (+706927us) service_pool.cc:224] Handling call
0709 13:19:48.212603 (+   600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.466193 (+253590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.526455 (+2060262us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540041a5d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:50.526715 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577137408}
I20260709 13:19:48.648676  4187 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:50.558938  7620 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:50.559141  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 1.91043e+06us
I20260709 13:19:50.559465  7620 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:50.561013  7740 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.560623  7620 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.561843  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:50.562469  4141 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:50.563625  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.717s (SENT)
I20260709 13:19:50.564765  7702 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:48.647912  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 86608.7us
I20260709 13:19:50.567448  7702 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:50.569329  4145 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.434s	user 0.017s	sys 0.009s
W20260709 13:19:50.569861  4145 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.446s	user 0.018s	sys 0.009s
I20260709 13:19:50.576591  4143 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:50.578898  7702 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:50.580648  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.580499  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2067) took 2868 ms. Trace:
I20260709 13:19:50.581445  4143 rpcz_store.cc:276] 0709 13:19:47.711998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.950173 (+238175us) service_pool.cc:224] Handling call
0709 13:19:47.967593 (+ 17420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.577381 (+2609788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.579628 (+  2247us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b54003dac54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:50.580407 (+   779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5999249152}
I20260709 13:19:50.582950  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.585390  4186 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:50.588725  4292 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:50.589254  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:50.589917  4290 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.591192  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:50.591826  4291 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.593016  7702 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:50.599197  4290 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
W20260709 13:19:50.604614  4185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.040s	user 0.014s	sys 0.052s
W20260709 13:19:50.605180  4185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.041s	user 0.014s	sys 0.052s
I20260709 13:19:50.606321  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:50.607151  4292 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:50.607281  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:50.608039  4294 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:50.610086  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:50.611125  4292 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
W20260709 13:19:50.611585  4185 connection.cc:256] RPC call timeout handler was delayed by -1.9545671850000872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:19:50.621105  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:50.622153  4927 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:19:50.622759  4146 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:50.623747  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.624558  4146 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 4.
I20260709 13:19:50.615886  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:50.626577  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:50.627374  4290 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:50.628317  7837 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:50.637667  7837 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.638082  7837 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:50.638634  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.640560  7806 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.641161  7806 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.627802  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:50.646234  4893 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:50.629747  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2337) took 3126 ms. Trace:
I20260709 13:19:50.649397  4147 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:50.650753  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.625627  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.648576  4214 rpcz_store.cc:276] 0709 13:19:47.503345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.071075 (+567730us) service_pool.cc:224] Handling call
0709 13:19:48.235441 (+164366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.339396 (+103955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.629389 (+2289993us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54001f6b50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:50.629668 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377149184}
I20260709 13:19:50.657127  4893 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:50.661128  4287 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:50.644027  7806 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:50.640869  4924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 490) took 2867 ms (client timeout 1739 ms). Trace:
I20260709 13:19:50.653110  4141 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:50.688069  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.674800  4287 pending_rounds.cc:85] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 3
I20260709 13:19:50.754186  4287 pending_rounds.cc:107] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:50.754733  4287 raft_consensus.cc:2889] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.674005  4146 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:19:50.584215  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:50.689618  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 104309us
I20260709 13:19:50.718931  4140 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
W20260709 13:19:50.749132  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 179193us
I20260709 13:19:50.756806  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.758200  4146 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:50.738334  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:50.738164  4295 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:50.760579  4295 pending_rounds.cc:85] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:19:50.756215  4143 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:50.760890  4295 pending_rounds.cc:107] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:50.761168  4295 raft_consensus.cc:2889] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.693827  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:19:50.762759  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69026.8us
I20260709 13:19:50.689285  7770 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:50.659636  4291 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
W20260709 13:19:50.689920  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 49073.3us
I20260709 13:19:50.682888  7787 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:50.770537  7787 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.676239  7652 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:50.777288  7770 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.778002  7770 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.779491  4259 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:50.767982  4147 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:50.780876  7826 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:50.781553  7826 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:50.782130  7826 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.783782  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:50.675799  7757 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.788089  4143 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:19:50.791702  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.675141  7279 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:19:50.677296  7806 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:19:50.794305  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 118788us
I20260709 13:19:50.768584  7650 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:50.795192  7740 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:50.677665  4924 rpcz_store.cc:269] 0709 13:19:47.773656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.774851 (+  1195us) service_pool.cc:224] Handling call
0709 13:19:50.640609 (+2865758us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b5400600254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:50.640747 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118104320}
W20260709 13:19:50.812608  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55992.6us
I20260709 13:19:50.816035  7279 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.822213  7279 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.793077  7757 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:50.830523  4926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 496) took 2331 ms (client timeout 3051 ms). Trace:
I20260709 13:19:50.831117  7862 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:50.831615  7862 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:50.832855  7757 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.832633  7862 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.834301  7862 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.837913  7865 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:50.838606  7865 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:50.831130  4926 rpcz_store.cc:269] 0709 13:19:48.499165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.499837 (+   672us) service_pool.cc:224] Handling call
0709 13:19:50.830325 (+2330488us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54006d5454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:50.830443 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2886379264}
I20260709 13:19:50.852319  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2066) took 3142 ms. Trace:
I20260709 13:19:50.826910  7279 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:50.855824  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 56398.6us
I20260709 13:19:50.877529  7279 raft_consensus.cc:993] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:50.878492  7279 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:50.878749  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:50.880661  7279 raft_consensus.cc:1081] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:50.881114  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:50.882807  7279 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:50.876251  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 56786.6us
I20260709 13:19:50.820667  7859 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:50.896552  7868 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.897406  7868 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.900640  7867 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:50.901422  7867 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.883157  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:50.887955  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 125562us
I20260709 13:19:50.853065  4145 rpcz_store.cc:276] 0709 13:19:47.709680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.951856 (+242176us) service_pool.cc:224] Handling call
0709 13:19:47.952538 (+   682us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:47.956859 (+  4321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.956888 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:47.977117 (+ 20229us) log.cc:844] Serialized 52 byte log entry
0709 13:19:48.102098 (+124981us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:50.570363 (+2468265us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.851699 (+281336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.851843 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.851928 (+    85us) raft_consensus.cc:1685] finished
0709 13:19:50.851947 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.852208 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3673,"raft.queue_time_us":37305,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":14150,"thread_start_us":2826921,"threads_started":4,"wal-append.queue_time_us":645621,"wal-append.run_cpu_time_us":2163,"wal-append.run_wall_time_us":1152676}
I20260709 13:19:50.883494  7279 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:50.916543  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:50.925220  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:50.904173  7867 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:50.893992  7859 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:50.900154  7868 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:50.853756  7837 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.938149  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:50.939457  7801 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:50.940177  7801 raft_consensus.cc:697] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:50.941480  7801 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.955036  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:19:50.932577  7822 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 2.414s	user 0.003s	sys 0.034s
I20260709 13:19:50.919065  7864 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:50.962708  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 77484.9us
W20260709 13:19:50.964917  7822 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 2.446s	user 0.003s	sys 0.034s
W20260709 13:19:50.966181  7789 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:19:50.968287  7865 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:50.933642  7874 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:50.975804  7874 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:50.981160  7868 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.947830  7866 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:50.982467  7866 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.983042  7866 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:50.964599  7864 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:50.994685  7837 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:50.994858  7864 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:50.996908  7279 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:50.954367  7867 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:51.001017  7867 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.003891  7867 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:51.004563  7869 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:50.935889  7859 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.982002  7868 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:51.077690  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 122793us
W20260709 13:19:51.081153  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.265223  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 301246us
I20260709 13:19:51.398948  7877 raft_consensus.cc:993] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:50.947556  7567 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:51.399642  7770 consensus_meta.cc:287] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.007s
W20260709 13:19:51.401083  7826 consensus_meta.cc:287] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.618s	user 0.015s	sys 0.000s
I20260709 13:19:51.441975  7871 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.443082  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 484279us
I20260709 13:19:51.446799  4185 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:51.460561  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:51.462320  4185 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:51.464115  4185 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:51.451149  7567 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:51.484370  7567 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.488823  7879 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:51.489620  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:51.445052  7874 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:50.968321  7863 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.509s
I20260709 13:19:51.444736  7875 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:51.452144  7869 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:51.114574  7787 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.491467  7877 raft_consensus.cc:1081] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
W20260709 13:19:51.568799  4187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.037s	sys 0.047s
W20260709 13:19:51.573172  4187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.037s	sys 0.047s
I20260709 13:19:51.578409  7787 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:51.579506  7787 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:51.579630  7868 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:51.580405  7868 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:51.581111  7868 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:51.580679  7787 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:51.578351  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 659852us
I20260709 13:19:51.463835  7826 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:51.606170  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:51.610114  4187 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:51.465381  7770 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:51.560667  7874 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:19:51.632664  7869 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.480612  7871 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.583549  7875 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:51.653539  7862 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.819s	user 0.006s	sys 0.010s
I20260709 13:19:51.643066  7878 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:51.764778  4111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.022s	sys 0.019s
W20260709 13:19:51.765437  4111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.022s	sys 0.019s
I20260709 13:19:51.767764  4143 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:51.770182  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:51.771147  4143 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:19:51.778328  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:51.779103  4141 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.785501  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:51.786500  4147 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:51.791730  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.792435  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.805696  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.806576  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.808959  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 198946us
I20260709 13:19:51.729592  7567 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.805179  7877 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:51.815156  7803 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.799029  7880 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.799002  7789 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.815691  4141 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:19:51.805552  7837 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:19:51.820223  4187 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:51.825855  7871 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:51.879585  7871 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:51.880041  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:51.827301  7883 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:19:51.827850  7826 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:51.882656  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 62536.4us
I20260709 13:19:51.812592  7878 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:19:51.885797  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1864) took 1361 ms. Trace:
I20260709 13:19:48.647483  4138 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:51.887259  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1858) took 3263 ms. Trace:
I20260709 13:19:51.833331  7739 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:51.887830  4138 rpcz_store.cc:276] 0709 13:19:48.624192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.624638 (+   446us) service_pool.cc:224] Handling call
0709 13:19:48.646974 (+ 22336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.887003 (+3240029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.887204 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.844573  7770 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:51.845625  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.850486  7881 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.088s	user 0.000s	sys 0.004s
I20260709 13:19:51.903115  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42928 (request call id 282) took 1064 ms. Trace:
I20260709 13:19:51.903586  4920 rpcz_store.cc:276] 0709 13:19:50.838439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.840485 (+  2046us) service_pool.cc:224] Handling call
0709 13:19:50.840839 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.841242 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.841273 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.841797 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.930828 (+ 89031us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:50.930875 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.930964 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.820008 (+889044us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:51.902759 (+ 82751us) raft_consensus.cc:1685] finished
0709 13:19:51.902779 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.903046 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1084,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":8297,"spinlock_wait_cycles":16206592,"thread_start_us":88590,"threads_started":1,"wal-append.queue_time_us":812171}
I20260709 13:19:51.854882  4147 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
W20260709 13:19:51.862816  7864 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.867s	user 0.015s	sys 0.000s
I20260709 13:19:51.908013  7864 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.873286  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2339) took 4275 ms. Trace:
I20260709 13:19:51.909401  4221 rpcz_store.cc:276] 0709 13:19:47.597707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.389354 (+791647us) service_pool.cc:224] Handling call
0709 13:19:48.416392 (+ 27038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.416813 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.416860 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.425116 (+  8256us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.839348 (+414232us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:48.839415 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.839540 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.872978 (+3033438us) raft_consensus.cc:1685] finished
0709 13:19:51.873007 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.873226 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1029,"raft.queue_time_us":15394,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":10674,"thread_start_us":379899,"threads_started":1,"wal-append.queue_time_us":1204030,"wal-append.run_cpu_time_us":4239,"wal-append.run_wall_time_us":1018060}
I20260709 13:19:51.876803  7789 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:51.911715  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2660 after lost signal to thread 3024
I20260709 13:19:51.913007  7789 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:51.913786  7789 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.914139  7813 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:51.914297  7789 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.914700  7813 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.874630  7877 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.877650  7880 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.877820  7803 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.880954  4922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42928 (request call id 280) took 1327 ms. Trace:
I20260709 13:19:51.893074  7888 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:51.828413  7884 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:51.883253  7826 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:51.881860  7886 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.837433  7862 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:51.892884  7421 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.888346  7739 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:51.886482  4146 rpcz_store.cc:276] 0709 13:19:50.524125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.759079 (+234954us) service_pool.cc:224] Handling call
0709 13:19:50.759547 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.888961 (+129414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.889004 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.917419 (+ 28415us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.450746 (+533327us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:51.450808 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.451228 (+   420us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.885492 (+434264us) raft_consensus.cc:1685] finished
0709 13:19:51.885528 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.885729 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6977,"raft.queue_time_us":55652,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":93,"thread_start_us":564226,"threads_started":2,"wal-append.queue_time_us":825840}
I20260709 13:19:51.917486  7567 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:51.898252  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 408732us
W20260709 13:19:51.866110  7866 consensus_meta.cc:287] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.882s	user 0.010s	sys 0.005s
I20260709 13:19:51.921370  4143 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:51.918504  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:51.923537  4922 rpcz_store.cc:276] 0709 13:19:50.553984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.879755 (+1325771us) service_pool.cc:224] Handling call
0709 13:19:51.880898 (+  1143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.880250  7871 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.889775  7859 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.892084  7737 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.922855  7894 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:51.944938  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:51.946231  4146 raft_consensus.cc:606] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:51.932260  7862 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:51.947111  4110 connection.cc:256] RPC call timeout handler was delayed by -2.5430464449998453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 13:19:51.936973  7890 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.944746  7279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.023s
I20260709 13:19:51.945972  7837 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:51.950103  7620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.043s	sys 0.103s
I20260709 13:19:51.931785  7884 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.936452  7886 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:51.953810  7894 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:51.930540  7888 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:51.968192  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 78306.3us
I20260709 13:19:51.937819  7421 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:51.956521  7279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.015s	sys 0.023s
I20260709 13:19:51.950863  7862 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.934013  7826 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:51.944044  7866 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.991056  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:51.991899  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:51.953653  7484 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:19:51.977648  7620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.043s	sys 0.103s
W20260709 13:19:51.984328  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 45743.8us
I20260709 13:19:52.003000  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:51.949779  7737 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.008744  7803 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:52.009392  7803 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.009965  7803 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.010728  7894 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:51.998451  4143 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:52.012993  7877 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.013322  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.013762  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2083) took 3483 ms. Trace:
I20260709 13:19:52.014184  4295 rpcz_store.cc:276] 0709 13:19:48.530875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.119938 (+1589063us) service_pool.cc:224] Handling call
0709 13:19:50.126091 (+  6153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.761836 (+635745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.013514 (+1251678us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54003539d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:52.013702 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406351616}
I20260709 13:19:52.014602  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:51.975596  7789 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:52.015971  7789 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.016800  7886 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:52.016607  7789 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.015383  4143 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:52.018684  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.019363  4143 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:52.004489  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.022248  7879 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.022835  7879 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.023980  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:51.983286  7837 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:52.005219  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.001997  7376 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.007614  7864 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:51.957484  7890 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:51.976260  7893 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:52.003883  4146 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.020632  7896 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:52.022014  7789 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:52.025357  4143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ca04a09529497898d86f573a0e1189"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:52.042359  4143 raft_consensus.cc:606] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:52.028151  4261 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.529s (SENT)
I20260709 13:19:52.031000  4110 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:52.034034  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.043527  4215 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:52.025344  7900 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:52.036069  7888 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.038393  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.040027  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:52.048794  4214 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:52.051308  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.051965  4215 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:19:52.043851  4110 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:52.019413  7884 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.046360  7803 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:52.024299  7898 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:52.046061  7900 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.054302  7864 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.057561  7864 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.058017  7864 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.058604  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.059455  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.059854  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.060457  4213 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:52.060844  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:51.979898  7739 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.030702  7859 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.064770  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:52.065610  7866 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.025209  7879 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.035724  7837 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.067209  7871 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.054713  7880 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.048864  7421 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.063865  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:52.068702  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.069389  7890 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.072376  4146 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:19:52.073355  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:52.081348  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.082962  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:52.082994  4214 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:52.083804  4922 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:19:52.083935  4142 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:52.085053  4142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1859) took 3460 ms (client timeout 2762 ms). Trace:
W20260709 13:19:52.085498  4142 rpcz_store.cc:269] 0709 13:19:48.625000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.625522 (+   522us) service_pool.cc:224] Handling call
0709 13:19:52.084958 (+3459436us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:52.089380  4261 leader_election.cc:336] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.868s (SENT)
I20260709 13:19:52.090116  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:52.106164  7826 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:52.107045  7862 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.108680  7803 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:52.108707  4216 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:52.092516  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 110071us
I20260709 13:19:52.119494  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:52.121192  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:52.125072  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.126748  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:52.127029  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.127774  4142 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:19:52.129196  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.131503  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:52.132485  4146 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.131036  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:52.137157  7803 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:52.137804  7803 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:52.138728  7909 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:52.078359  7898 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.139701  7826 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:52.141865  7898 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.139699  7909 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.141916  7826 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:52.143185  7826 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:52.136514  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:52.145378  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:52.146286  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:52.147500  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:52.150198  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.096180  7805 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:52.155864  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:52.161072  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 81029.5us
I20260709 13:19:52.162112  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:52.162951  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.164579  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:52.166972  4221 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:52.130193  7906 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:52.156927  7898 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:52.130841  7827 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:19:52.138845  7803 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:52.207624  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47581.7us
W20260709 13:19:52.251288  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.251497  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:52.217072  4217 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:52.160223  4146 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:52.250406  7906 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.253547  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:52.254783  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.166263  7902 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.169040  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.255822  4214 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:52.217487  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.257272  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.258901  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.217238  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.167789  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.176483  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.167618  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.273700  4143 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 4.
I20260709 13:19:52.274745  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.161100  7789 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:52.177130  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.272379  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:52.280046  7902 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.165293  7913 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:52.283710  7913 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.284171  7909 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.284554  4214 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:52.285251  7827 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:52.285835  7827 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:52.287125  7827 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:52.165467  7805 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:52.287880  7805 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:52.222911  7825 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:52.289124  7868 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:52.289377  7825 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:52.279206  4143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:52.289619  7868 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:52.289959  7825 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:52.290176  4143 raft_consensus.cc:606] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:52.290669  7868 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.230681  7914 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:19:52.279968  7789 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.280216  4215 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:52.276167  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.160640  7899 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.291193  7902 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.153885  7888 raft_consensus.cc:2764] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:52.284133  7913 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:52.299950  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.308138  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.296135  4141 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:52.206893  7905 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:52.311148  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.312879  4214 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:52.311378  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:52.312759  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 100798us
I20260709 13:19:52.309197  7899 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:52.329614  7899 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.324092  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:52.310943  7789 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:52.317441  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66009.8us
I20260709 13:19:52.290712  4143 raft_consensus.cc:614] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:52.274269  7906 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.337498  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:52.292407  7805 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:52.353390  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.361876  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:19:52.366168  7912 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:19:52.380038  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.362910  7905 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:52.385320  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 65407.1us
I20260709 13:19:52.385552  4922 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:52.339397  7868 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.275312  7898 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.350648  7902 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:52.400985  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 63555.8us
W20260709 13:19:52.405841  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 80253.4us
I20260709 13:19:52.409644  7864 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.411294  7764 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.411938  7764 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.412324  7764 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.414742  4217 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:52.404949  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:52.421960  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:52.430524  7803 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:52.431284  7803 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.440111  4218 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:52.440317  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.400612  7914 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.442322  4222 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:52.403733  7906 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:52.448964  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.449771  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.453768  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.450047  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.450410  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.450233  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.455351  4215 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:52.459595  4218 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:52.460927  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.467039  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.441056  7803 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:52.471212  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.435859  7879 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:19:52.473917  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52076.6us
I20260709 13:19:52.480043  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.447062  7920 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:52.481432  7920 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:52.482056  7920 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:52.456745  7906 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.489318  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.489991  4213 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:19:52.489822  7877 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:52.434748  7789 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.493331  7803 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:52.475250  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:52.498507  7874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.008s	sys 0.039s
W20260709 13:19:52.514124  7874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.008s	sys 0.039s
I20260709 13:19:52.519223  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.501168  7567 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:52.501757  7803 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:52.543175  7567 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.543367  7803 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.451985  7914 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.452097  7899 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.532687  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.533171  7906 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:52.533416  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6e40 after lost signal to thread 4079
I20260709 13:19:52.533654  7825 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.534446  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:52.562312  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.562783  4922 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.534740  7789 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:52.535810  7898 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.541546  7826 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.541767  7913 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:52.510022  7879 consensus_queue.cc:1243] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer b81584b21ed144698954548303f1e507 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:19:52.542548  7864 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:52.497473  7905 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.544761  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.510843  7915 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:52.545576  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:52.559893  4243 debug-util.cc:398] Leaking SignalData structure 0x7b080032e6c0 after lost signal to thread 4171
I20260709 13:19:52.576743  7825 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:52.578763  7764 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.580302  4214 raft_consensus.cc:2410] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:52.591972  7930 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.575654  7805 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:52.557624  7866 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:52.595093  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.198227  4920 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:53.198531  4218 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:19:53.198652  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:53.199427  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.200151  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.595914  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:52.657913  4922 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
W20260709 13:19:52.773607  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 298459us
I20260709 13:19:52.659757  7914 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:52.671149  4292 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:52.627928  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.620844  4112 connection.cc:256] RPC call timeout handler was delayed by -2.2785783299998457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2839s for a response
I20260709 13:19:52.623616  7915 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:53.152554  7869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.005s	sys 0.033s
W20260709 13:19:53.192744  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 240749us
I20260709 13:19:53.200281  4218 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:19:52.670331  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.225781  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.755576  7826 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:53.208673  7935 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:53.227470  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 532) took 1177 ms. Trace:
W20260709 13:19:53.209425  4112 connection.cc:256] RPC call timeout handler was delayed by -1.6428943420000905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30510000000000004s for a response
I20260709 13:19:53.228296  4216 rpcz_store.cc:276] 0709 13:19:52.049800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.051293 (+  1493us) service_pool.cc:224] Handling call
0709 13:19:52.051615 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.109611 (+ 57996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.227176 (+1117565us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b5400181854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:53.227401 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130325376}
I20260709 13:19:53.229918  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.231594  7932 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:53.205461  7914 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:53.225871  4290 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:19:53.210400  7805 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:53.211238  4243 debug-util.cc:398] Leaking SignalData structure 0x7b080032e600 after lost signal to thread 4172
I20260709 13:19:53.233023  7740 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:53.212757  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2080) took 4768 ms. Trace:
I20260709 13:19:53.256762  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:52.868144  7827 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:19:53.222838  4291 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:53.223119  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2275) took 5888 ms. Trace:
I20260709 13:19:53.264715  4289 rpcz_store.cc:276] 0709 13:19:47.334408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.579671 (+245263us) service_pool.cc:224] Handling call
0709 13:19:47.579911 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.322285 (+742374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.222687 (+4900402us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54002783d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:53.222953 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696701184}
I20260709 13:19:53.238581  4220 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:52.773422  7884 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.245843  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:52.613337  7928 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.256565  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.270641  4290 raft_consensus.cc:2410] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:53.248591  7866 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.271775  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.272142  7764 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:53.257819  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6a20 after lost signal to thread 4246
I20260709 13:19:53.258786  4287 rpcz_store.cc:276] 0709 13:19:48.444699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.914719 (+1470020us) service_pool.cc:224] Handling call
0709 13:19:49.915115 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.755547 (+840432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.212461 (+2456914us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54003543d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:53.212698 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714307840}
W20260709 13:19:53.213395  7869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.005s	sys 0.034s
W20260709 13:19:53.259960  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2138600450000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:19:53.274467  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.275707  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.276319  4287 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:53.276594  7869 consensus_queue.cc:1059] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:53.277740  7869 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:53.264176  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.260839  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:19:53.209482  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.278633  4291 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:53.207932  7803 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.267056  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:52.624279  7789 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.010581  7279 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.236084  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.273065  4290 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:52.658088  7899 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.281826  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.269984  4218 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:53.282439  4289 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.249830  7913 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:53.280000  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7c60 after lost signal to thread 4320
I20260709 13:19:52.624011  7864 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:53.225765  7917 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:53.263638  7740 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:53.277853  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.284981  4295 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:53.251336  7567 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:53.309091  7920 consensus_meta.cc:287] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.002s
I20260709 13:19:53.309700  7920 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.267040  7833 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:53.246395  7915 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.293658  4290 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:53.250200  7930 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.284922  7789 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.228072  7935 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.295373  4287 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:19:53.303058  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.296649  7776 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.299188  7917 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.287232  7914 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:53.306228  7866 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:53.306839  7900 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:53.288707  4243 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7fa0 after lost signal to thread 4953
I20260709 13:19:53.339905  7914 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.313333  4289 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:19:53.341897  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.343298  7904 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:53.343880  7904 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:53.345654  7916 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 1.068s	user 0.005s	sys 0.006s
I20260709 13:19:53.345286  7904 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.349088  7917 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.350751  7789 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.317941  7567 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:53.295327  7934 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.314621  7833 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.319222  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:53.358526  4142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2091) took 1229 ms (client timeout 1501 ms). Trace:
I20260709 13:19:53.323189  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.360562  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.361083  4290 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.260836  7826 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.365517  4295 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:53.283239  7884 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.334908  4291 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:19:53.336058  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.300941  7864 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.289661  7279 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.323765  7933 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.354758  4289 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:53.286226  7928 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:53.359119  4142 rpcz_store.cc:269] 0709 13:19:52.129042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.318869 (+1189827us) service_pool.cc:224] Handling call
0709 13:19:53.358427 (+ 39558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.269950  7827 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.370028  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.386344  4295 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:19:53.370065  4287 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:53.387962  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.388720  4287 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:19:53.389688  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.390344  4287 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:53.391206  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.391793  4287 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:19:53.395100  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.395648  4287 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:53.396914  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 154984us
I20260709 13:19:53.401610  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.402873  4295 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:53.371560  4290 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:53.359378  7833 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.370393  7826 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.358812  7567 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:53.373593  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.436854  7864 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:53.437671  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.438824  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.439289  4291 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:53.374598  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.440793  4292 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:53.441529  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.376044  7935 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:53.442061  4292 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:53.442921  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.443447  7740 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.444200  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.380889  7875 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:53.445423  7875 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:53.446126  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:53.446686  4216 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:53.446288  7875 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.357142  7904 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.448436  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:53.441533  7567 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.449470  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.450131  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:53.450784  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.451587  4220 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:53.385285  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:53.454262  7928 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.455127  4142 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:53.443900  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.456954  4292 raft_consensus.cc:2368] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11.
I20260709 13:19:53.457659  7902 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.458739  7567 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:53.459038  7920 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.457962  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.460655  4292 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:19:53.461515  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.419423  4112 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:53.429821  7827 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.434245  7884 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:53.435689  7826 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.448743  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:53.456202  7279 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:53.462198  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.470880  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:53.471320  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.471617  4922 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:53.409619  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.473013  4295 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:53.455850  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2099) took 1322 ms. Trace:
I20260709 13:19:53.469604  4287 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:19:53.473874  4142 rpcz_store.cc:276] 0709 13:19:52.133062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.454603 (+1321541us) service_pool.cc:224] Handling call
0709 13:19:53.454930 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.455602 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.455791 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.474849  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.475060  4142 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:53.475425  4287 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:53.475648  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2100) took 1342 ms. Trace:
I20260709 13:19:53.416049  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.476224  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.477682  4287 raft_consensus.cc:2410] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:53.478543  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.477468  4290 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:53.480743  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.481454  4290 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:53.482517  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.483466  4290 raft_consensus.cc:2410] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:53.475975  4142 rpcz_store.cc:276] 0709 13:19:52.133311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.474678 (+1341367us) service_pool.cc:224] Handling call
0709 13:19:53.474913 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.475414 (+   501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.475601 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.486538  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2101) took 1353 ms. Trace:
I20260709 13:19:53.487015  4142 rpcz_store.cc:276] 0709 13:19:52.133557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.485266 (+1351709us) service_pool.cc:224] Handling call
0709 13:19:53.485636 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.485859 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.485909 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.485960 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:53.486009 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.486071 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.486472 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.487703  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.421051  7854 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:53.463141  4292 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:19:53.465365  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.466368  4216 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:53.467407  4291 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:53.495988  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.496944  4291 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:19:53.498126  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.498750  4295 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:53.488318  4287 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
W20260709 13:19:53.462805  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 43478.7us
I20260709 13:19:53.468750  7902 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.472083  7864 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:53.490170  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 215576us
I20260709 13:19:53.479913  7421 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.423154  7900 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:19:53.458032  7944 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:53.368077  7934 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.497301  4186 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:53.489739  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.512398  4295 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:53.514639  4291 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:53.503865  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.505595  4292 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:53.516685  4287 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:53.506137  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1465982439999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
W20260709 13:19:53.490463  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 229680us
I20260709 13:19:53.467893  7932 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:19:53.502969  7755 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:53.514338  7905 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:53.400907  7933 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.503180  7854 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.517572  4291 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:53.466355  7886 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:19:53.511652  7740 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:53.527715  7854 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:53.533980  7408 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:53.536358  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.522488  4290 raft_consensus.cc:2410] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:53.522361  4295 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:53.536999  4293 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:53.499372  7904 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:53.480270  7833 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:53.523990  4261 leader_election.cc:336] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.966s (SENT)
I20260709 13:19:53.504292  7878 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:19:53.520177  4287 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:53.509743  7421 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.540366  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:53.542573  7421 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:53.542743  7914 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.517848  7944 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.526762  7930 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:53.544852  7930 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:53.545354  7944 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:53.545574  7833 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:53.546115  7774 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:53.522119  4292 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:53.539326  4288 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:53.549665  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:53.550617  4287 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:53.553992  4291 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:19:53.554636  4291 pending_rounds.cc:85] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:19:53.554531  7826 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.555119  4291 pending_rounds.cc:107] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:19:53.555752  4291 raft_consensus.cc:2889] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:53.555289  4288 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:53.556088  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.556982  4288 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:53.546631  7774 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:53.546636  7904 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:53.561048  7933 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:53.525331  7905 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:53.561612  7774 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.561043  7904 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:53.562783  7905 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.564152  7904 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.565632  7904 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.565874  7787 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:53.566352  7787 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:53.567243  7787 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.568665  7787 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.570163  7833 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:53.570629  7833 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:53.571565  7833 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.539579  7934 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:53.595489  7867 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.031s	user 0.011s	sys 0.015s
W20260709 13:19:53.596035  7867 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.042s	user 0.011s	sys 0.015s
I20260709 13:19:53.562873  7774 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.581388  7833 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.615127  7862 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:53.621096  7875 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:53.623986  7902 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.632427  7902 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:53.665804  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.682211  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:53.507483  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:53.685449  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 177931us
W20260709 13:19:53.689349  4044 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 86) took 23661 ms (client timeout 15000 ms). Trace:
I20260709 13:19:53.690320  4112 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:53.690224  4044 rpcz_store.cc:269] 0709 13:19:30.027691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.028320 (+   629us) service_pool.cc:224] Handling call
0709 13:19:30.753582 (+725262us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:53.688924 (+22935342us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:46.510369 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:46.629803 (+119434us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:46.637089 (+  7286us) write_op.cc:435] Acquired schema lock
0709 13:19:46.637138 (+    49us) tablet.cc:662] Decoding operations
0709 13:19:46.638094 (+   956us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:46.638205 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:46.638241 (+    36us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:46.638983 (+   742us) tablet.cc:701] Row locks acquired
0709 13:19:46.639041 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:19:46.639281 (+   240us) write_op.cc:270] Start()
0709 13:19:46.657946 (+ 18665us) write_op.cc:276] Timestamp: P: 1783603186639179 usec, L: 0
0709 13:19:46.657994 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:19:46.658834 (+   840us) log.cc:844] Serialized 2116 byte log entry
0709 13:19:48.201314 (+1542480us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:48.518025 (+316711us) op_driver.cc:464] REPLICATION: finished
0709 13:19:50.902171 (+2384146us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3bbd80ac 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee42718ef0
0709 13:19:51.553704 (+651533us) write_op.cc:301] APPLY: starting
0709 13:19:51.582877 (+ 29173us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:51.609102 (+ 26225us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:51.609169 (+    67us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:51.610732 (+  1563us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:51.611293 (+   561us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:19:51.611367 (+    74us) write_op.cc:312] APPLY: finished
0709 13:19:51.612002 (+   635us) log.cc:844] Serialized 47 byte log entry
0709 13:19:51.931627 (+319625us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:51.936143 (+  4516us) write_op.cc:454] Released schema lock
0709 13:19:51.943229 (+  7086us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:51.977154 (+ 33925us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:51.978708 (+  1554us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1934835,"reported_tablets":14,"spinlock_wait_cycles":41102080,"child_traces":[["op",{"apply.queue_time_us":2933415,"apply.run_cpu_time_us":46063,"apply.run_wall_time_us":456489,"num_ops":5,"prepare.queue_time_us":135158,"prepare.run_cpu_time_us":37028,"prepare.run_wall_time_us":260794,"raft.queue_time_us":131215,"raft.run_cpu_time_us":39313,"raft.run_wall_time_us":2507916,"replication_time_us":1817804,"spinlock_wait_cycles":293948928,"thread_start_us":3060817,"threads_started":5,"wal-append.queue_time_us":641089,"wal-append.run_cpu_time_us":39780,"wal-append.run_wall_time_us":3706176}]]}
I20260709 13:19:53.696957  4045 catalog_manager.cc:5697] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 2 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 5 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.519172  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:53.560009  4291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:53.742337  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2098) took 1609 ms. Trace:
I20260709 13:19:53.749107  7944 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:53.750698  7944 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.755095  7866 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.759270  7871 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.749562  4288 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:53.760401  7871 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.761127  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.762100  7944 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:53.762984  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.764063  4288 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:53.757668  4221 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:53.758630  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.755908  7902 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:53.768477  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:53.769462  7902 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.765939  7866 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:53.768818  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 217584us
I20260709 13:19:53.770347  4045 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 5 to 6, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 6 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.757208  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:53.771965  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:53.772962  4220 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.756807  7904 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:53.782341  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:53.784854  7930 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:53.786952  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.789230  7902 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:53.790580  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 275299us
I20260709 13:19:53.793159  7866 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:53.795234  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 275959us
I20260709 13:19:53.795562  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:53.796191  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.796763  7942 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:53.797798  7942 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:53.797156  4045 catalog_manager.cc:5697] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 3 to 8, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:53.797967  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.798799  7902 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.799650  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.799921  7933 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:53.800457  7930 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.800562  4288 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.747550  4141 rpcz_store.cc:276] 0709 13:19:52.132798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.451096 (+1318298us) service_pool.cc:224] Handling call
0709 13:19:53.451441 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.451726 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.451753 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:53.462744 (+ 10991us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.741155 (+278411us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:53.741300 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.741492 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.741600 (+   108us) raft_consensus.cc:1685] finished
0709 13:19:53.741626 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.741943 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":249259,"threads_started":1,"wal-append.queue_time_us":49790}
I20260709 13:19:53.848939  4220 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:19:53.850133  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:53.850718  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.852787  7942 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:53.823731  7933 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.856268  7933 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.763707  7871 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:53.851855  4141 raft_consensus.cc:2376] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9. Re-sending same reply.
I20260709 13:19:53.875479  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:53.880859  4291 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:53.881647  4291 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:53.884750  4214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2354) took 1435 ms (client timeout 1889 ms). Trace:
W20260709 13:19:53.885337  4214 rpcz_store.cc:269] 0709 13:19:52.448880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.449855 (+   975us) service_pool.cc:224] Handling call
0709 13:19:53.884122 (+1434267us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003c23d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:53.884503 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286847744}
I20260709 13:19:53.889679  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 357) took 3395 ms. Trace:
I20260709 13:19:53.890551  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.891712  4217 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:53.893345  4045 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 5 to 7, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 7 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:53.895938  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.897050  4293 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:53.898581  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.902221  4294 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:53.895480  4045 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:53.899533  4293 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:53.905503  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.902997  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2309) took 1234 ms. Trace:
I20260709 13:19:53.916669  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:53.917579  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:53.917378  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.940093  4294 rpcz_store.cc:276] 0709 13:19:52.668404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.668557 (+   153us) service_pool.cc:224] Handling call
0709 13:19:53.901413 (+1232856us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5800082598. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:19:53.901710 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.902687 (+   977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.902918 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7180544}
I20260709 13:19:53.954726  4288 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:19:53.945166  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:53.956905  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:53.963578  4215 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:53.917266  7376 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:53.890354  4139 rpcz_store.cc:276] 0709 13:19:50.494182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.494349 (+   167us) service_pool.cc:224] Handling call
0709 13:19:50.494743 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.495018 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.495063 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.495690 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.587221 (+ 91531us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:53.701586 (+3114365us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.888722 (+187136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.888923 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.889067 (+   144us) raft_consensus.cc:1685] finished
0709 13:19:53.889087 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.889407 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3113504,"prepare.queue_time_us":3241938,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":21898,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":21913,"thread_start_us":214612,"threads_started":2,"wal-append.queue_time_us":49486,"wal-append.run_cpu_time_us":3018,"wal-append.run_wall_time_us":1253543}
I20260709 13:19:53.909186  7279 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:53.969213  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:53.964936  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:53.969446  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 122842us
W20260709 13:19:53.977376  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 185008us
I20260709 13:19:53.980087  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:53.980649  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.878497  7866 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:19:53.984956  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:53.904665  7904 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:53.968889  4034 maintenance_manager.cc:419] P bc702ba481ed4ff7b99697ca2b44c086: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033356
I20260709 13:19:53.974113  7376 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:53.983098  4221 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:54.026726  4288 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:54.053454  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.026328  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 368) took 3466 ms. Trace:
I20260709 13:19:54.026374  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:54.031680  7859 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:54.034288  7932 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:54.023507  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:54.060288  7376 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.062754  4295 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:54.063370  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:54.063934  4295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6091d765c73842c992d8c60523872ccc"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
W20260709 13:19:54.065028  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 204444us
I20260709 13:19:54.065697  7932 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.066200  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:54.066936  7880 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:54.054450  4140 rpcz_store.cc:276] 0709 13:19:50.512111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.758297 (+246186us) service_pool.cc:224] Handling call
0709 13:19:50.758760 (+   463us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:50.789484 (+ 30724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.789527 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:50.792763 (+  3236us) log.cc:844] Serialized 52 byte log entry
0709 13:19:50.858164 (+ 65401us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:53.704600 (+2846436us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.956978 (+252378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.962930 (+  5952us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.967068 (+  4138us) raft_consensus.cc:1685] finished
0709 13:19:53.967086 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.978507 (+ 11421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2856686,"prepare.queue_time_us":2978940,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":9189,"raft.queue_time_us":120675,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":41233,"spinlock_wait_cycles":32446720,"thread_start_us":192254,"threads_started":2,"wal-append.queue_time_us":345178,"wal-append.run_cpu_time_us":3052,"wal-append.run_wall_time_us":1080983}
I20260709 13:19:54.068454  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:54.069922  4261 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.737s (SENT)
I20260709 13:19:54.070129  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.054504  4293 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:54.079543  4261 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.860s (SENT)
I20260709 13:19:54.081357  7813 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:54.088536  7890 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:54.089584  7890 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:54.093673  7960 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:54.004783  7279 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:54.099442  4140 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:19:54.062270  7376 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.039917  7944 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:54.067672  7880 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:54.100455  4139 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:54.068948  7902 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:54.102267  4291 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.110111  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.118242  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.126327  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.128062  4295 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:54.128616  4295 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:54.136952  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:54.147053  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 97991.2us
I20260709 13:19:54.150337  4294 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:54.156224  4291 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:54.170064  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:54.157631  7716 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:54.171185  7813 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:54.172052  7813 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.172793  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2094) took 1922 ms. Trace:
I20260709 13:19:54.174666  7813 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:54.173229  4143 rpcz_store.cc:276] 0709 13:19:52.131711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.337250 (+205539us) service_pool.cc:224] Handling call
0709 13:19:52.337600 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:52.338000 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.338029 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:52.338541 (+   512us) log.cc:844] Serialized 52 byte log entry
0709 13:19:52.448400 (+109859us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:53.706543 (+1258143us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.973522 (+266979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.977290 (+  3768us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.986892 (+  9602us) raft_consensus.cc:1685] finished
0709 13:19:53.986911 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.054283 (+ 67372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1350290,"prepare.queue_time_us":1409156,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":9769,"raft.queue_time_us":116057,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":15846,"spinlock_wait_cycles":3958528,"thread_start_us":179626,"threads_started":2,"wal-append.queue_time_us":410409,"wal-append.run_cpu_time_us":1924,"wal-append.run_wall_time_us":1023205}
W20260709 13:19:54.175817  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 109847us
I20260709 13:19:54.179070  7898 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:54.179201  7880 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:54.179689  7898 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:54.180923  7898 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.181942  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2087) took 2056 ms. Trace:
I20260709 13:19:54.184013  7902 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:54.184690  4892 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:54.185734  7902 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.189694  7890 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:54.190747  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:54.182662  4146 rpcz_store.cc:276] 0709 13:19:52.125639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.286946 (+161307us) service_pool.cc:224] Handling call
0709 13:19:52.287366 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:52.287812 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.287851 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:52.288559 (+   708us) log.cc:844] Serialized 52 byte log entry
0709 13:19:52.395896 (+107337us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:53.948643 (+1552747us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.181103 (+232460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.181271 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.181360 (+    89us) raft_consensus.cc:1685] finished
0709 13:19:54.181372 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.181655 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1364280,"prepare.queue_time_us":1488573,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":44249,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":9788,"thread_start_us":477860,"threads_started":3,"wal-append.queue_time_us":107031,"wal-append.run_cpu_time_us":2083,"wal-append.run_wall_time_us":1002083}
I20260709 13:19:54.191965  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:54.192526  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.193703  7872 raft_consensus.cc:2764] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:54.195070  7859 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.195528  7859 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:54.195928  7859 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.196545  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.198398  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:54.199944  7833 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.557s	user 0.016s	sys 0.004s
I20260709 13:19:54.177947  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:54.201436  7869 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:54.201325  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.202544  7869 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.157352  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 356) took 3605 ms. Trace:
I20260709 13:19:54.204792  7421 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:54.195680  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.205276  7421 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:54.205797  7421 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:54.206358  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:54.206935  4186 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:54.207983  7833 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:54.208640  7833 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:54.209123  7833 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.208729  7890 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:54.208105  7279 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:54.210438  7737 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:54.211347  7279 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:54.211894  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 229131us
W20260709 13:19:54.200369  7959 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.141s	user 0.005s	sys 0.000s
I20260709 13:19:54.213797  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:54.203449  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:54.216122  7969 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:54.216568  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.216809  7890 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:54.217747  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 106708us
W20260709 13:19:54.218299  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.217958  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 543) took 1729 ms. Trace:
I20260709 13:19:54.168457  4221 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:54.215981  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:54.220273  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.187984  4892 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:54.218403  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:54.222224  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.222872  4139 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.158463  4140 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:54.154939  4045 catalog_manager.cc:5697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:54.217379  7890 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:54.228615  7875 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:54.229149  7890 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.229461  7875 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:54.230269  7922 raft_consensus.cc:2764] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:54.211987  7279 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:54.219827  4213 rpcz_store.cc:276] 0709 13:19:52.488120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.216573 (+1728453us) service_pool.cc:224] Handling call
0709 13:19:54.217090 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.217457 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.217497 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.217557 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:54.217589 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.217641 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.217766 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.176033  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:54.243331  4143 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:54.152166  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.246017  4111 leader_election.cc:400] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11.
I20260709 13:19:54.246670  4111 leader_election.cc:403] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:54.207971  4112 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:54.248315  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.204151  4144 rpcz_store.cc:276] 0709 13:19:50.492778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.492941 (+   163us) service_pool.cc:224] Handling call
0709 13:19:50.493402 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.493655 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:53.708190 (+3214535us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.979945 (+271755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.986153 (+  6208us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:54.029837 (+ 43684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.054886 (+ 25049us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.098065 (+ 43179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3213929,"prepare.queue_time_us":3372299,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":6824,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4600,"thread_start_us":257661,"threads_started":1,"wal-append.queue_time_us":415417}
I20260709 13:19:54.261495  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.264037  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.269084  4218 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:54.257378  7872 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:54.275365  4221 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
W20260709 13:19:54.287099  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.286931  7968 raft_consensus.cc:2804] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:54.287789  7968 raft_consensus.cc:697] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:19:54.288213  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.294153  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.297178  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:54.282811  4045 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 3 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 4 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:54.300207  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.293576  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:54.301863  4216 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:54.304152  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.305284  7879 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.282938  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:54.312069  7740 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.312959  7740 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:54.316630  7886 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:54.302663  7737 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.317545  7886 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:54.322300  4218 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 3.
I20260709 13:19:54.291070  7866 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:54.330294  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 114068us
I20260709 13:19:54.307514  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.289145  7968 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:54.320493  7787 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.014s
I20260709 13:19:54.338617  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.338963  4140 raft_consensus.cc:2393] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:54.305724  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:54.348026  4221 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:54.354261  4213 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:19:54.358217  7279 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:54.361141  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 173383us
I20260709 13:19:54.363319  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:54.363505  7922 consensus_queue.cc:1059] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:54.364753  7567 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:54.369297  7976 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:54.372054  4222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2362) took 1872 ms (client timeout 1816 ms). Trace:
W20260709 13:19:54.372625  4222 rpcz_store.cc:269] 0709 13:19:52.499437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.371595 (+1872158us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:54.371816 (+   221us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:19:54.372916  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 384) took 1964 ms. Trace:
I20260709 13:19:54.373064  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.373471  4141 rpcz_store.cc:276] 0709 13:19:52.408919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.247788 (+1838869us) service_pool.cc:224] Handling call
0709 13:19:54.342896 (+ 95108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.372479 (+ 29583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.372519 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.372588 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:54.372633 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.372703 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.372825 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.375505  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:54.375883  4141 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:54.377125  4147 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:54.377797  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2107) took 1797 ms. Trace:
I20260709 13:19:54.378116  4147 rpcz_store.cc:276] 0709 13:19:52.580490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.376537 (+1796047us) service_pool.cc:224] Handling call
0709 13:19:54.376918 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.377528 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.377719 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.399951  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2102) took 1100 ms. Trace:
I20260709 13:19:54.400446  4289 rpcz_store.cc:276] 0709 13:19:53.299370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.341574 (+ 42204us) service_pool.cc:224] Handling call
0709 13:19:54.399507 (+1057933us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b540025a3d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:54.399719 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27616640}
I20260709 13:19:54.400954  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2109) took 1820 ms. Trace:
I20260709 13:19:54.401358  4147 rpcz_store.cc:276] 0709 13:19:52.581078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.399720 (+1818642us) service_pool.cc:224] Handling call
0709 13:19:54.400278 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.400568 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.400593 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.400636 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:54.400701 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.400758 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.400898 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.403106  4147 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:54.405211  4219 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:54.379696  7859 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.407723  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 539) took 1150 ms. Trace:
I20260709 13:19:54.408368  7859 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:54.409214  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2106) took 1829 ms. Trace:
I20260709 13:19:54.409422  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 383) took 2084 ms. Trace:
I20260709 13:19:54.409638  4141 rpcz_store.cc:276] 0709 13:19:52.580197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.374900 (+1794703us) service_pool.cc:224] Handling call
0709 13:19:54.375440 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.376222 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.409122 (+ 32900us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11520}
I20260709 13:19:54.409785  4142 rpcz_store.cc:276] 0709 13:19:52.324590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.489668 (+1165078us) service_pool.cc:224] Handling call
0709 13:19:53.489932 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.703737 (+213805us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:53.966053 (+262316us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.260510 (+294457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.260572 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:54.260651 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.408959 (+148308us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400069354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:54.409008 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.409224 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41302,"prepare.queue_time_us":180968,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":33,"raft.queue_time_us":15124,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":14765,"spinlock_wait_cycles":490120448,"thread_start_us":365981,"threads_started":2,"wal-append.queue_time_us":327186}
W20260709 13:19:54.415016  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 207243us
I20260709 13:19:54.415313  7869 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:54.416368  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:54.418926  7865 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:54.419464  7865 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:19:54.419929  7865 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:54.385131  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.387454  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57712 (request call id 9) took 3434 ms. Trace:
I20260709 13:19:54.343250  7886 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:54.395460  7875 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:54.397789  7872 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:54.398187  7867 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:54.372134  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:54.421556  4145 rpcz_store.cc:276] 0709 13:19:50.953386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.953537 (+   151us) service_pool.cc:224] Handling call
0709 13:19:54.386793 (+3433256us) spinlock_profiling.cc:243] Waited 2.94 s on lock 0x7b5400069854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece8735 00007fee3ece09fa 00007fee43ca84c9 00007fee3d224c54 00007fee3d224be2 00007fee3d224b11 00007fee3d224a8c 00007fee3d223d42 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:54.387177 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6753881856}
I20260709 13:19:54.408138  4292 rpcz_store.cc:276] 0709 13:19:53.257498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.549037 (+291539us) service_pool.cc:224] Handling call
0709 13:19:54.404573 (+855536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.404953 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.404978 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.405049 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:54.405108 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.405179 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.407367 (+  2188us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b540025a3d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:54.407507 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966549888}
I20260709 13:19:54.428715  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2111) took 1841 ms. Trace:
I20260709 13:19:54.429195  4147 rpcz_store.cc:276] 0709 13:19:52.581667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.402334 (+1820667us) service_pool.cc:224] Handling call
0709 13:19:54.402831 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.403531 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.422922 (+ 19391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.429840  4220 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:54.404166  7932 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:54.431942  7872 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:54.435354  4222 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:54.423797  4294 pending_rounds.cc:85] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 3
I20260709 13:19:54.430289  4045 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 7 to 8, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:19:54.448558  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76567.5us
I20260709 13:19:54.449607  4920 raft_consensus.cc:2368] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:19:54.437393  4294 pending_rounds.cc:107] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:54.452689  4294 raft_consensus.cc:2889] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:54.454720  4293 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:19:54.449968  4295 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.457832  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.436105  7890 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.437885  7867 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:54.478307  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 139030us
W20260709 13:19:54.463488  4031 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a35e1cee8a15436dbfaf75dd67824aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 32ebd3bc4af5446f94d9f3ac7c8cf53c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:19:54.339563  7879 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.485694  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:54.486119  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2367) took 1034 ms. Trace:
I20260709 13:19:54.484679  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:54.486721  4219 rpcz_store.cc:276] 0709 13:19:53.445332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.455519 (+ 10187us) service_pool.cc:224] Handling call
0709 13:19:54.195221 (+739702us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:19:54.479867 (+284646us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54002f4754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:54.480014 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482198144}
I20260709 13:19:54.471591  7944 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:54.469853  7867 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:54.493613  4045 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 4 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:54.473295  7904 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:54.474917  7869 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:54.503206  7888 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.522682  4112 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:54.488183  7740 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:54.493330  7890 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:54.528920  4221 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:54.527225  4147 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:19:54.532738  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52783.8us
I20260709 13:19:54.533556  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2104) took 1953 ms. Trace:
I20260709 13:19:54.534081  4140 rpcz_store.cc:276] 0709 13:19:52.579702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.427304 (+1847602us) service_pool.cc:224] Handling call
0709 13:19:54.479734 (+ 52430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.533101 (+ 53367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.533133 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.533224 (+    91us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:54.533272 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.533364 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.533486 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:54.527609  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 335285us
I20260709 13:19:54.536433  4926 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:54.558977  4139 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:54.514109  7869 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.557886  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.525974  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.565671  4924 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:19:54.567862  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:54.563277  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:19:54.564469  7933 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.010s
I20260709 13:19:54.572376  4920 raft_consensus.cc:2393] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:19:54.572937  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 51200us
W20260709 13:19:54.574738  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.576467  4217 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:54.557111  7774 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.010s
I20260709 13:19:54.493417  7944 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.585845  7890 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.586009  4221 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:54.567365  7869 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.528602  7421 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.586392  7890 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.589450  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:54.597538  4045 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:19:54.602440  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.643908  4920 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:54.582419  7933 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.653105  4140 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:54.601418  7890 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:54.633771  7972 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:19:54.600817  7888 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:54.585071  7904 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:54.656567  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:54.663053  4216 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
W20260709 13:19:54.675365  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.662847  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 64824.2us
I20260709 13:19:54.683724  4295 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:54.684315  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:46860 (request call id 2109) took 1373 ms. Trace:
W20260709 13:19:54.684777  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 321200us
I20260709 13:19:54.629259  7866 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:54.692811  4138 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:54.684700  4295 rpcz_store.cc:276] 0709 13:19:53.311005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.063614 (+752609us) service_pool.cc:224] Handling call
0709 13:19:54.630424 (+566810us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b54002599d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ecd9a3d 00007fee43ca9cd0 00007fee3d22e254 00007fee3d22e1e2 00007fee3d22e111 00007fee3d22e08c 00007fee3d22d342 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:54.684249 (+ 53825us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145139072}
W20260709 13:19:54.690013  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44668.9us
I20260709 13:19:54.665033  7888 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.695158  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.694348  4112 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:54.706703  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:54.708294  7974 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:19:54.708835  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:54.720630  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.700165  4045 catalog_manager.cc:5697] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 4 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:54.729265  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2116) took 1025 ms. Trace:
I20260709 13:19:54.729831  4139 rpcz_store.cc:276] 0709 13:19:53.704009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.645787 (+941778us) service_pool.cc:224] Handling call
0709 13:19:54.662887 (+ 17100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.728785 (+ 65898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.728823 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.728893 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:54.728941 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.729028 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.729191 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.702327  7879 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:54.697165  7871 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.737032  7871 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:54.737522  7871 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:54.739208  7978 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:19:54.739918  4261 leader_election.cc:336] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.524s (SENT)
I20260709 13:19:54.740406  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:54.741955  7774 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.693432  7567 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:54.723253  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:54.680891  7376 consensus_queue.cc:1059] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:19:54.749259  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 475521us
I20260709 13:19:54.714179  7888 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:54.757927  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:54.758690  4920 raft_consensus.cc:2393] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:54.689589  7740 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:19:54.750372  7279 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:54.793627  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 385) took 2383 ms. Trace:
W20260709 13:19:54.801692  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.783244  4045 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 5 to 9, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 9 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:19:54.776288  4261 leader_election.cc:336] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.545s (SENT)
W20260709 13:19:54.809130  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.785192  4215 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.781734  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:54.803316  4144 rpcz_store.cc:276] 0709 13:19:52.409817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.276498 (+1866681us) service_pool.cc:224] Handling call
0709 13:19:54.334589 (+ 58091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.469396 (+134807us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:54.494067 (+ 24671us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.793138 (+299071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.793214 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:54.793285 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.793365 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.793545 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6326,"prepare.queue_time_us":13990,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":23978,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":17773,"thread_start_us":215141,"threads_started":2}
I20260709 13:19:54.774602  7279 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.778059  7932 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:54.815080  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 53630.1us
W20260709 13:19:54.818405  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76845us
I20260709 13:19:54.807809  7421 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:54.827768  4261 leader_election.cc:336] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.545s (SENT)
I20260709 13:19:54.828261  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:54.824131  4045 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 4 to 7, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 7 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:54.829509  4143 consensus_meta.cc:287] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.003s
I20260709 13:19:54.830508  4143 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
I20260709 13:19:54.831120  4141 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:54.815881  7279 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:54.782967  7567 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:19:54.834828  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 118065us
I20260709 13:19:54.836699  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1904) took 1149 ms. Trace:
I20260709 13:19:54.824581  7376 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:54.815102  7932 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:54.839839  4143 rpcz_store.cc:276] 0709 13:19:53.681639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.175684 (+494045us) service_pool.cc:224] Handling call
0709 13:19:54.830962 (+655278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:54.836719  7737 consensus_meta.cc:287] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.006s
W20260709 13:19:54.853518  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80735.4us
W20260709 13:19:54.859360  7979 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.140s	user 0.000s	sys 0.003s
I20260709 13:19:54.861501  7933 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:54.862969  7871 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.852435  7932 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:54.881937  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 54207.4us
I20260709 13:19:54.842069  7922 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:54.845283  7774 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.882339  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2126) took 1123 ms. Trace:
I20260709 13:19:54.851027  7376 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.897464  4294 rpcz_store.cc:276] 0709 13:19:53.759009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.166428 (+407419us) service_pool.cc:224] Handling call
0709 13:19:54.283771 (+117343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.501824 (+218053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.501874 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.510335 (+  8461us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.747307 (+236972us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:54.747342 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.747415 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.882097 (+134682us) raft_consensus.cc:1685] finished
0709 13:19:54.882122 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.882278 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":183006,"threads_started":1,"wal-append.queue_time_us":271047}
I20260709 13:19:54.910163  7872 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:54.896800  7833 consensus_meta.cc:287] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.005s
I20260709 13:19:54.919713  7833 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:54.887373  7737 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11.
I20260709 13:19:54.920250  7871 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:54.919744  7982 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:19:54.922959  7376 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:54.920912  7922 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:54.942903  7865 consensus_meta.cc:287] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.004s
W20260709 13:19:55.265755  7993 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 13:19:54.944375  7922 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:19:55.268559  7867 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.742s	user 0.006s	sys 0.006s
I20260709 13:19:55.257959  7865 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.277655  7872 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:55.273860  7867 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.281984  7922 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:55.324417  7997 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.377s	user 0.002s	sys 0.000s
I20260709 13:19:55.330482  4145 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:55.334823  7922 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:55.341216  7890 consensus_meta.cc:287] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.651s	user 0.003s	sys 0.009s
I20260709 13:19:55.341727  7890 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.347256  7279 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.347986  7867 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:55.352747  7279 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:55.349467  7869 consensus_meta.cc:287] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.709s	user 0.013s	sys 0.000s
I20260709 13:19:55.355322  7869 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.334560  7865 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:55.356805  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.350746  7888 consensus_meta.cc:287] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.005s
I20260709 13:19:55.360220  7890 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:55.359882  7932 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:55.359249  7977 raft_consensus.cc:3055] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:55.360818  7888 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.362010  7977 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:55.363343  7932 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:55.363710  7888 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:55.363477  7977 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:55.365540  7869 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:55.365708  7977 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:55.366343  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.358355  7376 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.370469  7376 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:55.389840  4187 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.866s (SENT) [suppressed 55 similar messages]
W20260709 13:19:55.418244  7989 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.650s	user 0.003s	sys 0.000s
W20260709 13:19:55.468669  7988 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.728s	user 0.003s	sys 0.001s
I20260709 13:19:55.519752  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1901) took 1839 ms. Trace:
I20260709 13:19:55.520258  4145 rpcz_store.cc:276] 0709 13:19:53.680537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.457450 (+776913us) service_pool.cc:224] Handling call
0709 13:19:54.483109 (+ 25659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.330905 (+847796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.519420 (+188515us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400378554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:55.519659 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948372352}
W20260709 13:19:55.524253  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.546747  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.548763  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.549643  4220 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:55.550609  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.558172  4219 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:55.560036  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2391) took 1522 ms. Trace:
I20260709 13:19:55.563056  4219 rpcz_store.cc:276] 0709 13:19:54.037762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.498619 (+460857us) service_pool.cc:224] Handling call
0709 13:19:54.524686 (+ 26067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.558637 (+1033951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.559747 (+  1110us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000271d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:55.559951 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376107776}
I20260709 13:19:55.564553  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.566200  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.567749  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.568650  4219 raft_consensus.cc:2410] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:55.560957  4220 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:55.573561  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.574903  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.575693  4219 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:19:55.576593  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.578368  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:55.580125  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.591653  4220 raft_consensus.cc:2368] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:55.594997  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:55.597368  4893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.014s	sys 0.029s
W20260709 13:19:55.597940  4893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.015s	sys 0.030s
W20260709 13:19:55.598270  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 812923us
I20260709 13:19:55.599304  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:55.600317  7922 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:55.600867  7922 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:55.601243  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.601410  7922 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:55.605126  4112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.046s	sys 0.052s
W20260709 13:19:55.605608  4112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.046s	sys 0.053s
W20260709 13:19:55.606326  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 883108us
I20260709 13:19:55.577661  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.622169  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:55.623081  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 784036us
I20260709 13:19:55.623778  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.625245  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.628273  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:55.630154  7865 raft_consensus.cc:993] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:55.629917  7737 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:19:55.637545  7875 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:55.643648  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.644683  7875 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:55.645105  4219 raft_consensus.cc:2368] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:19:55.646152  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.646569  7942 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.648751  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:55.645738  7875 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.652973  7737 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:55.653431  7737 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:55.654449  7737 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:55.658838  4138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1887) took 1987 ms (client timeout 2300 ms). Trace:
I20260709 13:19:55.652032  7865 raft_consensus.cc:1081] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:19:55.661756  7869 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:55.663816  7376 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.664821  7737 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:55.665472  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.668916  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:55.669514  7875 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:55.673508  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.680617  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:55.686477  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55485.2us
W20260709 13:19:55.681197  4138 rpcz_store.cc:269] 0709 13:19:53.671898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.215569 (+543671us) service_pool.cc:224] Handling call
0709 13:19:55.658390 (+1442821us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400396cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:55.658666 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085769472}
I20260709 13:19:55.688506  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.690753  7376 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.692678  4222 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:55.693778  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.693856  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2384) took 1751 ms. Trace:
I20260709 13:19:55.694478  4222 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:55.695676  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.697589  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:55.698737  7865 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.699225  7865 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:55.699627  7865 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.701560  7376 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:55.703503  4218 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:55.710740  4222 raft_consensus.cc:2368] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:19:55.711059  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.711989  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.711059  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:55.718700  4922 raft_consensus.cc:2368] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:19:55.715047  4219 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
W20260709 13:19:55.720729  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.721526  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.694578  4214 rpcz_store.cc:276] 0709 13:19:53.942591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.985516 (+ 42925us) service_pool.cc:224] Handling call
0709 13:19:54.049839 (+ 64323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.189052 (+139213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.189090 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.189993 (+   903us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.420755 (+230762us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:54.420794 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.420872 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.858546 (+437674us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:55.693222 (+834676us) raft_consensus.cc:1685] finished
0709 13:19:55.693262 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.693741 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64675,"raft.queue_time_us":68978,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":151,"spinlock_wait_cycles":118803328,"thread_start_us":230336,"threads_started":1,"wal-append.queue_time_us":463955}
W20260709 13:19:55.725821  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.727980  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.728451  8002 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:55.726929  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1899) took 2047 ms. Trace:
I20260709 13:19:55.733031  4142 rpcz_store.cc:276] 0709 13:19:53.679662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.411765 (+732103us) service_pool.cc:224] Handling call
0709 13:19:54.412143 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.442026 (+ 29883us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:54.456604 (+ 14578us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.690271 (+233667us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.727563 (+ 37292us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.728086 (+   523us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:54.728523 (+   437us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.732586 (+  4063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.732718 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.417189 (+684471us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:55.726671 (+309482us) raft_consensus.cc:1685] finished
0709 13:19:55.726699 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.726853 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20663,"prepare.queue_time_us":31868,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":80614,"raft.run_cpu_time_us":647,"raft.run_wall_time_us":30481,"spinlock_wait_cycles":14517120,"thread_start_us":189517,"threads_started":1,"wal-append.queue_time_us":288390}
I20260709 13:19:55.735910  4222 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:19:55.718802  7865 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:55.738130  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.739769  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.740173  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:55.740794  4214 raft_consensus.cc:2376] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10. Re-sending same reply.
I20260709 13:19:55.741667  7376 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.748842  8009 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:55.748936  7376 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:55.750422  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.751645  4214 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:55.753872  7865 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:55.754004  8002 raft_consensus.cc:2764] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:55.754527  7376 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:55.759562  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 90757.4us
I20260709 13:19:55.759677  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:19:55.769279  7986 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.028s	user 0.004s	sys 0.000s
I20260709 13:19:55.768441  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:55.771972  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2383) took 1855 ms. Trace:
I20260709 13:19:55.772428  4215 rpcz_store.cc:276] 0709 13:19:53.916159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.974344 (+ 58185us) service_pool.cc:224] Handling call
0709 13:19:54.029720 (+ 55376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.816215 (+786495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.771731 (+955516us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54001f7554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:55.771914 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731683584}
I20260709 13:19:55.763276  4222 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:55.782248  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.782743  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.782966  4222 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:55.783526  4216 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:55.783882  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.784525  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.784983  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.785176  4216 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:55.785735  4222 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:55.786208  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.786594  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.787242  4222 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.787679  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.788836  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.789117  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2387) took 1753 ms. Trace:
I20260709 13:19:55.789651  4216 raft_consensus.cc:2410] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:55.790519  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:55.789480  4213 rpcz_store.cc:276] 0709 13:19:54.035796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.355186 (+319390us) service_pool.cc:224] Handling call
0709 13:19:54.355558 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.355899 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.355926 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.390950 (+ 35024us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.654498 (+263548us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:54.654535 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.654606 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.768615 (+1114009us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:55.788767 (+ 20152us) raft_consensus.cc:1685] finished
0709 13:19:55.788791 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.789048 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83579648,"thread_start_us":262974,"threads_started":1,"wal-append.queue_time_us":350182}
I20260709 13:19:55.791548  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:55.791687  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.792264  4926 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:19:55.785019  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2386) took 1762 ms. Trace:
I20260709 13:19:55.793547  4218 rpcz_store.cc:276] 0709 13:19:54.024741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.352138 (+327397us) service_pool.cc:224] Handling call
0709 13:19:54.352408 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.704321 (+1351913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.784725 (+ 80404us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003c3cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:55.784946 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3106215680}
I20260709 13:19:55.795204  4218 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:55.749616  8009 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.797024  4213 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:55.782027  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:55.802038  4215 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:55.802491  4218 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:55.807835  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 80601.5us
I20260709 13:19:55.809357  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:55.811803  4213 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:55.790139  4214 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
W20260709 13:19:55.816665  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49080.3us
I20260709 13:19:55.816725  7996 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:55.818935  8009 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:55.819098  7996 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.819646  8009 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.820325  8009 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.822146  8009 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:19:55.825644  8009 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.824187  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:55.826867  4924 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:55.824160  4186 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:55.828261  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:55.829602  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:55.830971  8002 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:55.826207  8009 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.837628  7833 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:55.839653  7833 raft_consensus.cc:2764] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:55.840543  7833 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.840973  7833 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:55.841493  7833 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.841046  8010 consensus_queue.cc:1059] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:55.841858  7865 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:55.842674  7865 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:55.843057  7865 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.845968  8009 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:55.846592  8009 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:55.854665  4259 leader_election.cc:400] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:19:55.855324  4259 leader_election.cc:403] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:55.857422  7567 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:55.858069  4222 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:19:55.859339  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:19:55.861822  4261 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.619s (SENT)
I20260709 13:19:55.859665  7567 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:55.859762  7865 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:55.870601  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:55.871536  4261 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.619s (SENT)
I20260709 13:19:55.872148  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:55.873270  4259 leader_election.cc:400] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:19:55.873790  4259 leader_election.cc:403] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:55.875592  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:55.869309  7865 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:55.877473  7865 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.879218  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 386) took 2667 ms. Trace:
I20260709 13:19:55.878783  7865 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:55.879608  4141 rpcz_store.cc:276] 0709 13:19:53.211567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.410966 (+1199399us) service_pool.cc:224] Handling call
0709 13:19:54.830969 (+420003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.831514 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.879021 (+1047507us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54002a0650. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:55.879158 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964825472}
I20260709 13:19:55.877386  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:55.880120  7567 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:55.903857  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.886937  7567 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:55.916558  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:55.919034  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:55.922762  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:55.901286  8011 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:55.920331  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:55.936187  4138 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:19:55.913537  7865 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:55.921800  7898 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:55.908170  8002 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:55.922438  7932 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:55.919510  7872 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.951356  8017 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:19:55.927865  7890 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:19:55.961438  8017 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.947494  8014 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.963335  8014 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.965898  8014 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:55.954283  8016 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.954761  7898 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:55.935820  8010 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:19:55.955256  8009 raft_consensus.cc:3055] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:55.957880  7833 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:55.959049  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 87564.7us
I20260709 13:19:55.936960  8011 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:55.914254  7567 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.969216  7872 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:55.987188  7872 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:55.968962  8009 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:55.988431  7872 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.992178  4143 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
W20260709 13:19:55.995700  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 115702us
I20260709 13:19:55.999737  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:56.007321  4261 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.674s (SENT)
W20260709 13:19:56.008445  4261 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.674s (SENT)
I20260709 13:19:56.009004  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:56.013721  8009 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:56.017026  8011 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:55.968099  7898 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.020355  7898 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.969182  8017 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.033140  7567 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.035733  8017 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:56.040918  8010 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:56.053263  8010 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.040688  8020 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:56.056281  8010 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:56.046301  7833 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:56.056550  7922 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:56.047595  8009 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.050055  4045 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:55.993036  7872 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:19:56.059372  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59717.3us
W20260709 13:19:56.066521  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 104994us
I20260709 13:19:56.067361  7932 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:56.057323  7833 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:56.066571  4138 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:56.073614  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 208880us
I20260709 13:19:56.068176  4045 catalog_manager.cc:5697] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:19:56.083634  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.088783  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.089555  4145 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 7. Ops: []
I20260709 13:19:56.089860  7922 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:56.067094  7872 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.091169  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.085487  4147 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:56.092316  4294 raft_consensus.cc:2393] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:56.093468  4920 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:56.093647  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.087544  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.086781  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.094800  4144 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:56.095021  4139 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:56.088881  4138 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:56.098201  4141 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:56.097533  8010 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:56.070694  7279 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.101099  8022 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:56.101606  8022 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:56.101761  7279 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:56.102250  7833 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:56.102769  7833 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:56.102591  8022 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.103816  8022 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:56.104730  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 96364.3us
I20260709 13:19:56.105976  4142 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:56.112789  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.113106  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.113842  4295 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:56.065856  8023 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.116715  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.117481  4144 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 5: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:56.115219  4138 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:56.119472  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.119565  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.120440  4289 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:56.120584  4294 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:56.103755  7833 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.121627  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.121865  7996 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:56.122396  7833 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.123881  4261 leader_election.cc:400] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:56.124287  4261 leader_election.cc:403] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:56.125061  8010 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7.
I20260709 13:19:56.104592  7279 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:56.126492  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:56.127961  4139 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:56.150902  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.152045  4294 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.127413  8010 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:56.154093  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:56.155799  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48796.7us
I20260709 13:19:56.157019  4295 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:56.158793  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.159499  4289 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.156612  8023 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:19:56.164839  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:56.164891  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 71606.9us
I20260709 13:19:56.168785  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:56.169196  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.154209  7996 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:56.169953  4289 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:19:56.173439  4292 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:56.174045  8028 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:56.174717  7996 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.177760  7867 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:56.178288  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.178541  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.184430  4140 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:19:56.179507  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.179563  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:56.180922  8025 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:56.181149  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.209427  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.221185  4287 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.203526  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:56.205442  4146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1898) took 2526 ms (client timeout 1760 ms). Trace:
W20260709 13:19:56.219743  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49140.7us
I20260709 13:19:56.184811  4291 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.221261  4290 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:56.222134  4146 rpcz_store.cc:269] 0709 13:19:53.679240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.191935 (+512695us) service_pool.cc:224] Handling call
0709 13:19:56.205186 (+2013251us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54003da754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:56.205358 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333540608}
I20260709 13:19:56.226089  4294 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:56.216622  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:56.227005  4293 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:56.203317  7872 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.238003  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:56.241673  7866 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:56.244771  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47939.5us
I20260709 13:19:56.202183  7996 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:56.181514  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.259829  4289 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:56.258222  7866 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:56.261610  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 1.33939e+06us
W20260709 13:19:56.264283  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.262037  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.265352  4292 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:56.264153  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.257140  7869 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.574s	user 0.017s	sys 0.002s
I20260709 13:19:56.269310  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.275703  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.277062  4261 leader_election.cc:400] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:19:56.262420  7977 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.266150  8026 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:56.281277  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 82241.1us
I20260709 13:19:56.269285  7376 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:56.292834  4291 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:56.276767  7869 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:56.298269  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:56.298302  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.298943  4287 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:56.299376  4139 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:56.281421  8026 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:56.301061  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.299885  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.301348  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.303682  4290 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:56.307309  4146 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:56.285979  7996 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.291522  7376 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:56.294902  7977 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:19:56.313602  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.317148  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.317919  4287 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:19:56.319051  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.320497  7996 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:56.322736  7983 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.565s	user 0.003s	sys 0.005s
I20260709 13:19:56.324513  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2125) took 2566 ms. Trace:
I20260709 13:19:56.325033  8026 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.324944  4296 rpcz_store.cc:276] 0709 13:19:53.758486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.143584 (+385098us) service_pool.cc:224] Handling call
0709 13:19:54.241035 (+ 97451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.307095 (+ 66060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.307133 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.327488 (+ 20355us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.560543 (+233055us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:54.560582 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.560651 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.322036 (+1761385us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:19:56.323949 (+  1913us) raft_consensus.cc:1685] finished
0709 13:19:56.323979 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.324240 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2959,"raft.queue_time_us":20864,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":36096,"spinlock_wait_cycles":19093888,"thread_start_us":108581,"threads_started":1,"wal-append.queue_time_us":240830}
I20260709 13:19:56.335016  4290 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.336747  4291 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:56.323597  7996 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:56.346248  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.348713  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.316694  7376 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.275429  7866 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.354229  7866 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.356300  4290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ca04a09529497898d86f573a0e1189"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:56.357658  4290 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:56.358150  4290 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.361285  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:56.365118  7875 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.000s
I20260709 13:19:56.376719  7872 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:56.378072  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.378926  4141 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:56.380831  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.381644  4145 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:56.360886  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.382715  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.383468  4145 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:56.383837  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.384784  4143 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:56.380125  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.386461  4217 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:56.372670  4290 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.360899  7977 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:56.389295  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 91106.8us
I20260709 13:19:56.437227  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.457635  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.344419  8010 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:56.471958  4292 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
W20260709 13:19:56.475390  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 61385.4us
W20260709 13:19:56.476615  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 164913us
I20260709 13:19:56.479112  4145 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:56.481709  4141 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:56.483126  4146 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:56.483309  4290 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:56.479637  4145 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:56.426321  8026 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.486742  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:56.489310  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.494519  7867 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.494809  4290 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:56.495312  7867 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.496189  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.497128  4290 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:19:56.497491  4140 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:19:56.505381  4145 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.506654  4145 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:56.509709  7867 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:56.511829  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:56.512794  4143 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
W20260709 13:19:56.515944  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 915410us
I20260709 13:19:56.521281  8020 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:56.527693  8028 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:56.527850  8021 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:56.528671  8021 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:56.529677  7376 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.530550  7872 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:56.531641  8021 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:56.533942  7875 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:56.534350  4186 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:56.536557  8022 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:56.528322  8028 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:56.539111  4892 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:56.540789  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:56.543766  4290 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:56.545675  4147 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:19:56.503017  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:56.546000  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.547163  4294 raft_consensus.cc:2410] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:19:56.547065  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48553.5us
I20260709 13:19:56.496235  8011 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.559983  4145 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:19:56.558552  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:56.559120  4138 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:19:56.536265  7875 consensus_queue.cc:1059] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:19:56.504516  8010 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:56.560027  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.561580  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:56.578996  4290 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:56.585600  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:56.586578  7737 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.587512  7737 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:56.592921  7890 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:56.595592  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:56.596530  7995 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:56.597048  7995 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.597393  7995 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:56.599290  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.601670  7981 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:56.602398  7981 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:56.606223  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1956) took 1221 ms. Trace:
I20260709 13:19:56.607074  4217 rpcz_store.cc:276] 0709 13:19:55.385217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.727628 (+342411us) service_pool.cc:224] Handling call
0709 13:19:56.605984 (+878356us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54003c32d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:56.606139 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511756544}
I20260709 13:19:56.580658  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:56.612541  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.613292  4296 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:56.616398  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 66766.3us
I20260709 13:19:56.617506  4290 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:56.549728  7996 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:56.620409  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:56.622385  4144 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:56.623121  4295 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:56.635465  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:56.638095  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.633322  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:56.645879  4288 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:56.649240  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:56.649966  4222 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:56.655850  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:56.647996  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:56.656718  4220 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:56.659312  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:56.660297  4213 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:19:56.667657  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:56.665007  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:56.674115  8019 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:56.674774  8019 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.653272  7567 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:56.675217  8019 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.589676  7737 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.622119  8020 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:56.678954  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61722.7us
I20260709 13:19:56.624442  7376 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:56.686724  4221 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:56.653425  7933 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:56.661996  7871 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:56.702306  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.722019  4220 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:56.691355  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:56.703992  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.671181  7279 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:56.676390  8034 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.688426  8020 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.702922  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:56.705927  4261 leader_election.cc:400] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:19:56.750993  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.707288  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:56.755439  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.756664  4219 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:56.758397  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.760133  4218 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:56.736505  4924 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:19:56.773442  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.774844  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.775763  4222 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:56.776964  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.777762  4214 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:56.781935  7933 consensus_queue.cc:1059] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:56.766177  8034 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.680480  8028 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:56.655107  8022 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:19:56.751117  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45381.8us
I20260709 13:19:56.751693  4217 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:56.763082  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.765326  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:56.765779  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.812989  4291 raft_consensus.cc:2393] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:56.712324  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.813841  4221 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 5: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:56.769372  4218 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:56.705664  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.677210  7875 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:19:56.741336  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.805338  4214 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:56.816116  4220 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.819083  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:56.828234  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:56.832094  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 287841us
I20260709 13:19:56.845343  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.766474  8020 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.861343  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.866405  4222 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:56.870918  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.871243  4291 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:56.873040  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:56.874358  4293 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:56.878932  4950 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee900 after lost signal to thread 3024
W20260709 13:19:56.880362  4950 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee880 after lost signal to thread 4079
W20260709 13:19:56.882031  4950 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef180 after lost signal to thread 4171
W20260709 13:19:56.882375  4950 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef160 after lost signal to thread 4172
I20260709 13:19:56.884194  7869 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:56.886909  7869 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:56.888835  7869 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:56.893294  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.748914  7866 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:19:56.897364  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:56.902571  4950 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb100 after lost signal to thread 4246
W20260709 13:19:56.906855  4950 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6480 after lost signal to thread 4320
I20260709 13:19:56.908849  4920 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
W20260709 13:19:56.912537  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 254619us
I20260709 13:19:56.916314  4289 raft_consensus.cc:1240] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:19:56.918195  4950 debug-util.cc:398] Leaking SignalData structure 0x7b08002baf40 after lost signal to thread 4953
W20260709 13:19:56.918655  4950 debug-util.cc:398] Leaking SignalData structure 0x7b08003c15e0 after lost signal to thread 4954
I20260709 13:19:56.921504  4922 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:19:56.956640  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.981958  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:56.982800  4293 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:56.983167  4214 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:19:56.985275  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:56.986337  4213 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:57.001679  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.002561  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 339135us
I20260709 13:19:56.912178  7567 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:57.019663  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:57.023108  4214 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:56.877311  7942 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:57.024883  7942 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:57.026532  7942 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:56.868135  8028 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.976153  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:56.976822  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59256.4us
I20260709 13:19:56.980772  4220 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:57.028990  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:56.851538  8010 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:57.030390  8010 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.031985  4287 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:56.974192  8009 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:57.020443  8033 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260709 13:19:57.028910  8028 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:56.981257  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:56.965842  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 348008us
I20260709 13:19:57.058573  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:57.059945  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:57.060640  4293 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:57.061584  4222 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:57.061100  4293 pending_rounds.cc:85] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:19:57.068089  4293 pending_rounds.cc:107] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:57.068560  4293 raft_consensus.cc:2889] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:57.057833  4033 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.582s	user 0.008s	sys 0.011s
I20260709 13:19:57.085670  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:57.051301  7279 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:57.103292  4222 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:19:57.103338  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:57.112879  4296 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:57.111052  4222 pending_rounds.cc:85] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 5
W20260709 13:19:57.113317  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 294346us
I20260709 13:19:57.114512  4222 pending_rounds.cc:107] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:19:57.115768  4222 raft_consensus.cc:2889] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.116423  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:57.111377  4221 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:19:57.110916  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:57.111568  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 374423us
I20260709 13:19:57.124653  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:57.130012  8042 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:57.131632  8042 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:57.134016  8044 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:57.135355  7869 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:57.137110  8038 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:19:57.137776  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:57.152129  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:57.163854  8028 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:57.165926  7833 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:57.166519  7833 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:57.123909  7567 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.176872  7279 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.178018  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:57.178901  4920 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:57.181507  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:57.181318  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:57.184513  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:57.184703  4922 raft_consensus.cc:2376] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10. Re-sending same reply.
I20260709 13:19:57.189601  4217 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 4.
I20260709 13:19:57.112038  8022 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:57.125979  7981 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:57.176231  8026 consensus_meta.cc:287] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.000s
I20260709 13:19:57.207252  4293 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:57.167706  7833 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.208822  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:57.212649  8010 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:57.213959  8034 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:57.156211  8049 consensus_queue.cc:1059] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:19:57.216800  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:57.218050  4221 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:57.218704  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:57.219931  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:57.221532  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:57.233851  7867 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:57.244992  4287 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:57.245684  4219 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:57.226293  4291 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:57.243330  4214 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:19:57.248616  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:57.227799  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45199us
I20260709 13:19:57.230034  4927 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:19:57.228268  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:57.247310  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:57.232281  4222 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:57.226408  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 80253.1us
I20260709 13:19:57.227348  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:57.250257  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:57.250286  4288 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:19:57.259018  4293 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:57.188268  8048 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:57.260064  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.260250  4296 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:57.257822  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:57.260286  4289 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:57.262488  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:57.245021  7867 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:57.263304  4213 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
W20260709 13:19:57.224875  7995 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.627s	user 0.017s	sys 0.000s
I20260709 13:19:57.257751  4218 raft_consensus.cc:2376] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 8. Re-sending same reply.
W20260709 13:19:57.268926  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.272112  4112 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.272493  4214 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:57.232151  4893 connection.cc:256] RPC call timeout handler was delayed by -1.9851892459998908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
I20260709 13:19:57.275779  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:57.292063  4893 connection.cc:256] RPC call timeout handler was delayed by -1.5723160669999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26389999999999997s for a response
I20260709 13:19:57.294938  4218 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:57.281831  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:57.288741  8048 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:57.265055  7833 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:57.311707  4222 raft_consensus.cc:1240] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:57.309158  4112 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:57.236590  7981 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:19:57.273694  7376 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.329519  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:57.330530  4289 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:57.327119  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 64314.5us
I20260709 13:19:57.298105  8048 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.299173  8045 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.365581  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:57.360385  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.282029  8051 raft_consensus.cc:2764] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:57.268177  7867 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.284482  7995 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:57.377156  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 81359.5us
I20260709 13:19:57.382016  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.383786  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:19:57.384855  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.384474  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.367274  8045 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:57.330103  8034 consensus_queue.cc:1059] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:19:57.379227  7871 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.005s	sys 0.018s
I20260709 13:19:57.382067  7737 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:57.267055  8042 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.352958  7376 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.382035  8010 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:57.392474  8051 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.416288  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 385293us
I20260709 13:19:57.417726  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:57.397255  8026 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:57.447474  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.403275  7981 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.401027  8045 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:57.411443  7871 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.006s	sys 0.019s
I20260709 13:19:57.430959  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:57.407760  7867 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.450413  4219 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:57.414021  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.403900  7737 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:19:57.468822  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 88658.2us
I20260709 13:19:57.404388  8034 consensus_queue.cc:1243] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer b81584b21ed144698954548303f1e507 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:57.411309  8010 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:57.441130  8011 consensus_meta.cc:287] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.863s	user 0.013s	sys 0.000s
W20260709 13:19:57.434715  8019 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.005s
W20260709 13:19:57.479512  4892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.021s	sys 0.026s
W20260709 13:19:57.491159  4892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.021s	sys 0.027s
W20260709 13:19:57.485594  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54756.3us
I20260709 13:19:57.494201  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:57.497434  4292 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:57.476926  8042 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.488925  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:57.473409  7871 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:57.483409  7737 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.465013  7567 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:19:57.491472  8010 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.433254  8051 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.487818  7981 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:57.499548  7279 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:57.499879  8009 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.540139  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:19:57.490379  7996 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:57.534437  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:19:57.555671  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 504862us
I20260709 13:19:57.554874  8034 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:57.589718  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.525473  8011 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:57.557368  7279 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:19:57.561724  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 147773us
I20260709 13:19:57.563122  8009 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.508530  8019 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.576203  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:57.577538  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.591046  8011 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:57.537837  8026 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:57.536980  7922 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:57.556743  8056 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:57.594676  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.610376  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.572817  8021 raft_consensus.cc:3055] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:57.542732  8050 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:19:57.596975  7279 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.600445  4186 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.575790  7942 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:57.598767  7567 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:57.604591  4290 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:57.612540  4112 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.588706  7996 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:57.637084  8063 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:57.609997  7871 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.600847  8011 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.619117  4295 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:57.582572  7981 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.631901  8051 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:57.633416  8064 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:57.645143  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:57.635468  7567 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.637388  7996 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.617252  4185 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:19:57.619405  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.604251  8072 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:57.606675  7922 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:57.614771  8021 raft_consensus.cc:740] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:57.615718  8069 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:57.619038  7942 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.624871  8034 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:57.616204  7995 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:57.697964  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 53167.2us
I20260709 13:19:57.640432  8071 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:57.641064  8056 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:19:57.714696  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 95412.8us
I20260709 13:19:57.623203  7869 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:19:57.652411  8072 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:57.727044  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 107397us
W20260709 13:19:57.733037  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 111570us
I20260709 13:19:57.650449  7866 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:19:57.702891  8052 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.179s	user 0.000s	sys 0.002s
W20260709 13:19:57.740645  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 203623us
I20260709 13:19:57.702215  7898 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.704806  7942 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.703184  8026 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.699774  8069 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:57.703845  8074 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:57.723363  8022 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:57.603294  4033 maintenance_manager.cc:643] P bc702ba481ed4ff7b99697ca2b44c086: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 3.525s	user 0.165s	sys 0.080s Metrics: {"bytes_written":29311,"cfile_init":1,"dirs.queue_time_us":60467,"dirs.run_cpu_time_us":504,"dirs.run_wall_time_us":1301,"drs_written":1,"lbm_read_time_us":658,"lbm_reads_lt_1ms":4,"lbm_write_time_us":36093,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"rows_written":63,"thread_start_us":276507,"threads_started":2,"wal-append.queue_time_us":387236}
I20260709 13:19:57.719723  8073 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.718765  8028 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:57.758965  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 53519.6us
I20260709 13:19:57.713829  8071 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:57.760720  4216 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:57.761366  8019 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:57.761598  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:57.768967  4295 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.719548  7922 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:57.704159  8051 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:57.736773  8072 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.799665  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:57.801076  8046 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:19:57.801692  7981 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:57.801277  7922 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.762929  8026 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.804177  8076 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:57.804917  8026 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:57.806108  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:57.807019  4144 raft_consensus.cc:606] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.807413  4144 raft_consensus.cc:614] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:57.806156  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.774891  8020 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.007s
W20260709 13:19:57.822114  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50751.4us
I20260709 13:19:57.798336  8074 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:57.757968  7898 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.798880  8028 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:19:57.842703  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 123638us
W20260709 13:19:57.844623  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45052us
W20260709 13:19:57.847208  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.847003  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.847105  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:57.840713  4034 maintenance_manager.cc:419] P bc702ba481ed4ff7b99697ca2b44c086: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7388 bytes on disk
W20260709 13:19:57.863116  8068 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:19:57.865428  8066 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:19:57.865739  8081 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:57.779623  7866 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:19:57.872853  8065 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
W20260709 13:19:57.886883  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 123661us
I20260709 13:19:57.867853  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:57.890229  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 112395us
I20260709 13:19:57.773284  8073 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.898902  8073 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:57.899679  8055 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:57.891767  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 508018us
I20260709 13:19:57.901516  4291 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:57.902312  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:57.772238  8021 consensus_queue.cc:260] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.853928  7867 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:57.884238  7833 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.556s	user 0.017s	sys 0.000s
I20260709 13:19:57.896180  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:57.835450  8020 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.910390  4033 maintenance_manager.cc:643] P bc702ba481ed4ff7b99697ca2b44c086: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.036s	user 0.002s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":10640,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3}
I20260709 13:19:57.913020  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:19:57.922003  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.923909  7567 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:57.924146  8019 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:19:57.934473  8019 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.937211  8019 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:57.902592  8051 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:57.938090  8051 raft_consensus.cc:697] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:57.939294  8051 consensus_queue.cc:237] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.907915  8022 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:57.941133  8083 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.942044  7898 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:57.887384  7981 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:57.945139  8079 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:57.953996  8074 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.954450  8028 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.956470  8086 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:19:57.957347  8043 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:57.957687  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:57.957856  8043 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:57.966111  7279 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.966747  7737 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:57.969295  7279 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:57.969784  7737 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:57.973853  4295 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
W20260709 13:19:57.974756  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61879.7us
I20260709 13:19:57.977427  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:57.978556  4144 raft_consensus.cc:606] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:57.840476  8069 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.945726  8079 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.985196  8085 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:57.999337  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:57.983461  7867 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.981412  7833 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:19:58.001350  8077 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.200s	user 0.000s	sys 0.005s
I20260709 13:19:58.001729  8070 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 13:19:58.040931  8084 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:19:58.043037  8078 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:57.930922  8034 consensus_queue.cc:1059] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:19:57.909734  8071 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.046159  7376 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:58.046643  8071 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.977845  8026 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:58.025107  4295 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:57.982098  8019 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:58.029191  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 71602.4us
I20260709 13:19:58.030387  8020 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:58.030818  7867 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.029235  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:58.033187  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:58.034770  8043 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.038256  7942 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:57.992856  8079 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:58.058530  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 211538us
I20260709 13:19:58.063302  8080 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:19:58.063956  8084 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:58.072404  8084 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:58.073629  8084 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.075996  8084 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:58.065583  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145725us
W20260709 13:19:58.067545  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 211858us
I20260709 13:19:58.052949  8069 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.048779  8026 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:19:57.981503  8073 consensus_queue.cc:1059] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:19:58.085001  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.094681  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:58.085561  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.068681  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:58.096329  4144 raft_consensus.cc:606] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:58.085652  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.096813  4144 raft_consensus.cc:614] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:58.087218  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.090480  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:58.092808  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:19:58.087016  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:58.101949  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:58.103637  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.104059  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:58.104784  4145 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:58.107678  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.111927  4145 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:58.116060  4142 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.112399  4186 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:58.113834  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:19:58.100129  8010 consensus_meta.cc:287] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.006s
I20260709 13:19:58.122033  8075 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:19:58.098335  8070 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:58.124713  7867 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:58.124876  7376 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:58.125844  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:58.127049  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:58.118703  8019 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:58.130903  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.132112  8009 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:58.098613  8026 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.136574  8010 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.137384  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 2346) took 1526 ms. Trace:
I20260709 13:19:58.137861  4290 rpcz_store.cc:276] 0709 13:19:56.611389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.635027 (+ 23638us) service_pool.cc:224] Handling call
0709 13:19:58.137118 (+1502091us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54002788d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:58.137306 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222940928}
I20260709 13:19:58.138382  7942 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:58.139003  8010 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:58.140605  8090 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.141311  8090 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.143015  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.143882  8090 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:58.144748  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:58.103325  8043 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.146993  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.155932  4140 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:58.124768  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.146965  4141 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:58.160514  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48254.4us
I20260709 13:19:58.161998  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:58.166172  4142 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:58.119938  8020 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:58.171999  4144 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:19:58.173848  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 112628us
W20260709 13:19:58.185199  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 71465.2us
W20260709 13:19:58.170797  8011 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.516s	user 0.014s	sys 0.000s
W20260709 13:19:58.191231  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 98914.6us
I20260709 13:19:58.192948  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:58.174873  7867 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.170226  8022 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:58.206516  7279 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:58.180265  8100 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.217605  8010 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:58.218219  8100 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.220156  8049 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.220881  8049 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.221933  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:58.223315  8019 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:58.224553  8093 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:58.224704  8019 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:58.225268  8019 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:58.226866  8092 raft_consensus.cc:3055] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:58.198556  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:58.197142  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:58.176017  8020 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.207844  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.228808  4144 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:58.210115  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.210367  8083 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:58.211218  8045 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.730s	user 0.012s	sys 0.005s
I20260709 13:19:58.184953  7898 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.216607  8009 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:58.243769  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:58.227564  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.229964  4140 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:58.228256  4142 raft_consensus.cc:2376] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13. Re-sending same reply.
I20260709 13:19:58.236202  7279 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:58.237685  7866 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:58.225279  8093 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:58.197630  8011 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.232209  8020 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:58.257303  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 83205.7us
I20260709 13:19:58.226409  8019 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.272730  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:19:58.237012  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44235.6us
I20260709 13:19:58.264652  4296 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:58.190582  8085 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:58.232411  8092 raft_consensus.cc:740] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:58.266870  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:58.288166  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:58.293046  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.293728  4142 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.306411  4221 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:19:58.309041  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.284097  7279 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.265079  8056 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:58.273641  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:19:58.261587  8011 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:58.261530  8074 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:58.312991  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.329649  4220 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:58.325095  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:58.327466  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 342449us
W20260709 13:19:58.328138  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55612.6us
I20260709 13:19:58.289896  8083 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:58.335091  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:58.338311  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.339164  4892 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:58.341080  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:58.248871  8045 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.344696  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:58.345079  4892 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:58.345145  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.346287  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.347965  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:19:58.349095  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.345624  4139 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
W20260709 13:19:58.349577  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.352077  4216 raft_consensus.cc:2410] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:58.248458  8079 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.353288  4290 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260709 13:19:58.350363  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.327898  7996 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.314271  8056 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:58.337460  8019 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:58.335919  8048 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:58.305891  7866 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:19:58.326529  8107 raft_consensus.cc:2764] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:58.365617  4220 raft_consensus.cc:2368] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:19:58.302094  8078 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:58.335489  8074 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:58.347481  8075 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.398309  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.378999  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:58.433283  4289 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:19:58.433640  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:58.385010  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:58.386341  8108 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:58.387975  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.440795  8106 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
W20260709 13:19:58.441412  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.391294  8103 log.cc:927] Time spent T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:58.347182  8083 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:58.347076  8051 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:19:58.347333  8071 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:58.411460  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.357384  8073 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:58.397716  4295 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:58.418279  4290 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:58.418689  4147 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:19:58.418960  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:58.376518  8048 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:58.259397  8093 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.420095  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:58.378634  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.427376  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:58.464855  4287 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:19:58.465131  4220 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:58.466176  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.466890  4220 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
W20260709 13:19:58.434912  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.437459  4288 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:58.467795  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:58.437937  8074 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:58.441009  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.469074  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:58.391178  8099 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:19:58.469102  8074 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.470649  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:58.471266  4220 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:58.445847  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:58.417548  8075 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.476636  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:58.479393  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:58.449956  7737 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.484488  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:58.459136  8072 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.660s	user 0.017s	sys 0.003s
I20260709 13:19:58.529038  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:58.535966  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43598.1us
I20260709 13:19:58.537616  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:58.538400  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55866us
I20260709 13:19:58.539428  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:58.539510  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:58.375355  7996 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.540197  4924 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:58.541738  4287 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:58.541987  4187 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:58.461027  8073 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.548489  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:19:58.554550  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 62743us
I20260709 13:19:58.536078  4216 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:19:58.562501  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.567863  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 554) took 1043 ms. Trace:
I20260709 13:19:58.562868  8049 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:58.475592  8048 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:58.568722  4296 rpcz_store.cc:276] 0709 13:19:57.524653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.525118 (+   465us) service_pool.cc:224] Handling call
0709 13:19:57.546218 (+ 21100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.282050 (+735832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.567424 (+285374us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b540042b8d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:19:58.567753 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651589888}
I20260709 13:19:58.485718  8075 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.481698  8071 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:58.576037  4187 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:58.551520  8073 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:58.573194  4110 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:58.554316  8107 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:58.607187  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.608642  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:58.609824  4220 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:19:58.611449  4112 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:19:58.612767  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da0810d325774d7181018ff01e71333a"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:58.611871  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:58.614532  4140 raft_consensus.cc:606] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:58.614917  4220 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:58.616511  4216 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:58.618305  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.619616  8097 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:58.620399  8097 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.620963  8097 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.621102  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.555420  7737 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.600544  8049 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:58.636826  7898 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:19:58.654109  8109 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:19:58.655304  4287 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:58.659480  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:58.651508  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.434594  8085 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.422861  8092 consensus_queue.cc:260] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.604023  8026 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.665920  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:58.580480  8083 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.673377  4219 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:58.635200  8097 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.676744  7922 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:58.638803  4220 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:58.662760  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:19:58.683735  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.544618  8072 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.685859  4221 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
W20260709 13:19:58.637192  4261 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.707s (SENT)
I20260709 13:19:58.571952  7833 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
W20260709 13:19:58.697782  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.705189  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:19:58.701231  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:58.706576  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:58.707309  8093 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:58.708580  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 71437.6us
I20260709 13:19:58.708645  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:19:58.709600  4261 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.724s (SENT)
I20260709 13:19:58.709981  4294 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:58.710641  4261 leader_election.cc:336] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.732s (SENT)
I20260709 13:19:58.711140  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:58.711314  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:58.712073  8093 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.657691  8021 raft_consensus.cc:3060] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.693701  7898 consensus_queue.cc:1243] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:58.540694  8056 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.728510  8079 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:58.728788  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:58.729683  4218 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:19:58.730551  8098 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:58.730837  8111 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:58.731592  4218 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:58.732187  8053 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.732753  8053 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.733072  8045 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:58.733165  8053 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:58.735198  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44076.9us
I20260709 13:19:58.615023  8086 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.739301  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:58.739584  4218 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:58.731092  8098 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:58.655722  8069 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:58.702013  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:58.766201  8097 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:58.765834  8071 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.766611  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:58.773240  7922 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:58.775130  7996 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:58.776945  7737 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:58.776998  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:19:58.777894  8070 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:58.844794  4924 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.778373  8075 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.616076  8091 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:58.780932  4293 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:58.804323  4221 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:19:58.854565  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 247016us
W20260709 13:19:58.809882  4142 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.000s
I20260709 13:19:58.856709  4142 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
W20260709 13:19:58.816964  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.858659  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.836697  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:58.737836  8054 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.866359  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:58.861792  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:19:58.867694  4146 raft_consensus.cc:606] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:19:58.808292  8078 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.873176  8034 consensus_queue.cc:1059] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:58.875430  8034 raft_consensus.cc:3055] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:58.877391  4187 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:58.877856  8054 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.836885  7376 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.845726  7922 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:19:58.837046  8069 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:58.887336  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.893164  4221 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
W20260709 13:19:58.887946  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 174470us
I20260709 13:19:58.807224  7890 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:19:58.868603  8084 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.003s
I20260709 13:19:58.853602  8049 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.894578  4294 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:58.876148  8034 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:19:58.907088  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:58.915688  4290 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:19:58.918545  4261 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.760s (SENT)
I20260709 13:19:58.919492  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:58.924899  8049 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:19:58.931483  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.889199  8078 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:58.894577  7376 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:58.928123  8049 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:58.930550  8043 consensus_meta.cc:287] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.006s
I20260709 13:19:58.929615  8123 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:59.001868  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.929534  4927 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:19:58.930320  8098 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.007229  4924 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:59.027280  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:59.001963  4920 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:59.015540  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 97154.2us
I20260709 13:19:59.018209  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:59.045372  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:59.019982  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.046588  4145 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:19:59.029979  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:59.026268  8074 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.007s
I20260709 13:19:59.004105  8045 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.035329  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:19:59.014254  8076 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.045586  4142 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
W20260709 13:19:59.064194  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.003108  7942 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:59.048166  4261 connection.cc:256] RPC call timeout handler was delayed by -3.2166612789997089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 13:19:59.066337  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:59.066744  4261 connection.cc:256] RPC call timeout handler was delayed by -3.1483571240000856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 13:19:59.067080  4147 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:19:59.067111  4261 connection.cc:256] RPC call timeout handler was delayed by -3.050257123999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:19:59.067852  4261 connection.cc:256] RPC call timeout handler was delayed by -3.0420612789998813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22999999999999998s for a response
I20260709 13:19:59.058343  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:59.061862  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:19:59.068470  4261 connection.cc:256] RPC call timeout handler was delayed by -2.9422571239999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:19:59.059158  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:59.069419  4261 connection.cc:256] RPC call timeout handler was delayed by -2.9179571239999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:19:59.070040  4261 connection.cc:256] RPC call timeout handler was delayed by -2.854957124000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 13:19:59.070453  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:19:59.070442  4261 connection.cc:256] RPC call timeout handler was delayed by -2.783857123999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:19:59.072523  4261 connection.cc:256] RPC call timeout handler was delayed by -2.7790996399999131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:19:59.073045  4261 connection.cc:256] RPC call timeout handler was delayed by -2.6029571240001133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 13:19:59.074167  4138 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:19:59.074218  4261 connection.cc:256] RPC call timeout handler was delayed by -2.6011571240001103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:19:59.078192  4261 connection.cc:256] RPC call timeout handler was delayed by -2.5246571239999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
I20260709 13:19:59.091399  8100 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:59.087877  8076 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:59.089515  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 54317.8us
I20260709 13:19:59.094381  4218 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:19:59.094753  4218 pending_rounds.cc:85] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 4
W20260709 13:19:59.091411  4261 connection.cc:256] RPC call timeout handler was delayed by -2.5165571239999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 13:19:59.095291  4261 connection.cc:256] RPC call timeout handler was delayed by -2.48955712399993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 13:19:59.095790  4261 connection.cc:256] RPC call timeout handler was delayed by -2.4300612789998013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.298s for a response
I20260709 13:19:59.095912  8090 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:59.096158  4261 connection.cc:256] RPC call timeout handler was delayed by -2.3130612789998395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.311s for a response
I20260709 13:19:59.097476  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:59.119029  4138 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.098145  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:59.098889  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:59.095014  4218 pending_rounds.cc:107] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:59.125178  4218 raft_consensus.cc:2889] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.109464  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:59.114737  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:59.126888  4140 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:19:59.128904  4140 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:59.131500  4140 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:59.115303  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:19:59.076891  8028 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.017s	sys 0.014s
I20260709 13:19:59.114302  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:19:59.069870  8098 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.111692  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:59.066090  7942 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:59.144325  4261 connection.cc:256] RPC call timeout handler was delayed by -2.27046954299999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 13:19:59.152855  4261 connection.cc:256] RPC call timeout handler was delayed by -2.2365612789997158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3195s for a response
W20260709 13:19:59.153419  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7800054839997301s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:19:59.163645  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.095130  8076 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:59.175530  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:59.171768  4141 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:59.110271  7867 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.180071  4139 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
W20260709 13:19:59.190050  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 312613us
I20260709 13:19:59.096839  8090 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:19:59.152001  8028 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.018s	sys 0.014s
I20260709 13:19:59.109603  8130 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:59.052203  8069 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.074168  8045 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.151701  8072 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:59.042840  7922 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:59.132901  7898 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.252789  7898 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:59.255652  7898 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:59.152956  8100 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.256704  8100 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.258790  4140 raft_consensus.cc:1240] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:59.259337  8100 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:59.173331  8048 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.564s	user 0.015s	sys 0.000s
I20260709 13:19:59.260442  8048 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.262982  8048 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:19:59.206894  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:59.201097  8054 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:59.264400  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57648.2us
I20260709 13:19:59.217751  8075 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:59.266430  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:19:59.268028  4296 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:59.268725  8122 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:19:59.170079  8085 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.272889  8085 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:59.220851  7867 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.198871  4142 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:19:59.118772  8074 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:19:59.281736  4138 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:19:59.282079  4216 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:59.239820  8090 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.240571  7376 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:59.243376  8073 consensus_meta.cc:287] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.001s
I20260709 13:19:59.245219  4922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42928 (request call id 297) took 1104 ms. Trace:
I20260709 13:19:59.245846  4214 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:59.247181  4927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 501) took 1134 ms. Trace:
W20260709 13:19:59.272078  8129 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:59.283277  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:59.097097  8034 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.291308  4147 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:59.284742  8009 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:59.292265  8048 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:59.293744  4216 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:59.229099  7833 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:59.305117  4142 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:59.307387  4138 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:19:59.301934  4922 rpcz_store.cc:276] 0709 13:19:58.140803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.144458 (+  3655us) service_pool.cc:224] Handling call
0709 13:19:59.244923 (+1100465us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54002b2354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:59.245107 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245353728}
I20260709 13:19:59.303035  4927 rpcz_store.cc:276] 0709 13:19:58.112353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.112535 (+   182us) service_pool.cc:224] Handling call
0709 13:19:59.246947 (+1134412us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400156154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:19:59.247103 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845931776}
I20260709 13:19:59.235946  8130 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:19:59.278839  7867 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:59.243852  8022 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:59.293265  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.377419  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.352743  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 209093us
I20260709 13:19:59.381085  4141 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:59.383185  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:19:59.353976  4218 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:59.373252  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:59.312034  8090 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:59.392148  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:19:59.375536  8021 consensus_meta.cc:287] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.006s
W20260709 13:19:59.379377  8086 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.005s
I20260709 13:19:59.398478  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:19:59.411646  4216 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:59.377471  8020 consensus_meta.cc:287] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.114s	user 0.015s	sys 0.002s
W20260709 13:19:59.382767  8019 consensus_meta.cc:287] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.981s	user 0.016s	sys 0.000s
I20260709 13:19:59.404157  4147 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:19:59.418895  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.333482  8073 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:19:59.444901  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.298193  7942 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.447167  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:59.394483  8091 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:59.395186  8078 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:19:59.462357  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.486253  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 113197us
I20260709 13:19:59.489144  7279 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:19:59.506423  8117 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:19:59.507975  8136 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:19:59.491906  8074 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.497952  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:59.497377  7890 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:59.509929  8074 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.493194  4138 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:19:59.498080  8137 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:59.514611  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.496495  4141 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260709 13:19:59.447139  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2434) took 1136 ms. Trace:
I20260709 13:19:59.518949  4217 rpcz_store.cc:276] 0709 13:19:58.311188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.326613 (+ 15425us) service_pool.cc:224] Handling call
0709 13:19:58.327064 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.328733 (+  1669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.328772 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.337861 (+  9089us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.884625 (+546764us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:58.884674 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.884755 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.419808 (+535053us) raft_consensus.cc:1685] finished
0709 13:19:59.419845 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.447059 (+ 27214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16112,"raft.queue_time_us":1095,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4543,"thread_start_us":486799,"threads_started":1,"wal-append.queue_time_us":705101}
I20260709 13:19:59.521906  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:19:59.444146  8086 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:59.417629  8049 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:59.564652  4920 raft_consensus.cc:2393] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:19:59.513375  8053 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.767s	user 0.014s	sys 0.003s
I20260709 13:19:59.403271  8085 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:59.577296  4217 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:19:59.484812  4213 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:19:59.534070  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:19:59.541203  4216 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
W20260709 13:19:59.540321  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.526304  7942 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.402524  8075 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:19:59.524402  8043 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:59.590240  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.593962  8093 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:59.524698  8051 consensus_queue.cc:1175] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34e6205f3c1d434193126fef20d73800" responder_term: 11 status { last_received { term: 10 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:59.599869  8054 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.606910  4221 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:59.609894  8092 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:59.611486  8135 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:19:59.622408  4144 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:59.626632  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 567) took 1022 ms. Trace:
W20260709 13:19:59.526204  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.448222  8020 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.557794  8130 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:59.817363  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2172) took 1266 ms. Trace:
I20260709 13:19:59.676465  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2390) took 1018 ms. Trace:
I20260709 13:19:59.773952  8073 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:19:59.641606  8074 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:19:59.637643  4259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.032s	sys 0.043s
W20260709 13:19:59.844724  4259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.036s	sys 0.056s
I20260709 13:19:59.845665  8049 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.846190  8049 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.847283  8148 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:59.848003  8148 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.808102  8026 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:19:59.848578  8043 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:19:59.849911  8054 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.844125  4213 pending_rounds.cc:85] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 7
I20260709 13:19:59.667402  4296 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
W20260709 13:19:59.850267  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 280696us
I20260709 13:19:59.851166  8148 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:19:59.744818  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.852475  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:19:59.851150  4213 pending_rounds.cc:107] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:59.853468  4215 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:59.853680  4213 raft_consensus.cc:2889] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:59.837651  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.746662  4218 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:59.855839  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.841952  4290 rpcz_store.cc:276] 0709 13:19:58.658173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.023521 (+365348us) service_pool.cc:224] Handling call
0709 13:19:59.024025 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.024331 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:59.407814 (+383483us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.675671 (+267857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.675937 (+   266us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:59.676010 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.676118 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.676360 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23429,"prepare.queue_time_us":182125,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2910,"raft.queue_time_us":26964,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":40171,"thread_start_us":626847,"threads_started":2}
I20260709 13:19:59.860852  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:19:59.840662  4287 rpcz_store.cc:276] 0709 13:19:58.551586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.791732 (+240146us) service_pool.cc:224] Handling call
0709 13:19:58.792464 (+   732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.792993 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:59.007075 (+214082us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.816268 (+809193us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b180033e920. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3e88a4bc 00007fee3bbd848b 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a
0709 13:19:59.816624 (+   356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.816713 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:59.816931 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.817048 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.817260 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19242,"prepare.queue_time_us":266190,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":135,"spinlock_wait_cycles":3313920,"thread_start_us":310843,"threads_started":2,"wal-append.queue_time_us":335988}
I20260709 13:19:59.884815  4290 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:59.861584  4922 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:19:59.855799  4293 rpcz_store.cc:276] 0709 13:19:58.604296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.950725 (+346429us) service_pool.cc:224] Handling call
0709 13:19:59.002081 (+ 51356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.002382 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:59.301169 (+298787us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.625987 (+324818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.626095 (+   108us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:59.626177 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.626301 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.626529 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65251,"prepare.queue_time_us":167648,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":13675,"raft.queue_time_us":958,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":6038,"thread_start_us":601130,"threads_started":2}
I20260709 13:19:59.888931  7279 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:59.890741  4290 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:19:59.891769  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:19:59.893060  4290 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.890416  7279 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.857832  4217 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:59.774748  8137 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:59.857563  8028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.009s	sys 0.016s
I20260709 13:19:59.903620  4290 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:59.911355  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59077.4us
I20260709 13:19:59.910382  4293 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:59.916289  8091 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:59.917022  8091 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.917558  8091 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.861563  8074 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:59.923103  4893 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.034s
I20260709 13:19:59.859282  4291 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:20:00.025461  4893 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.009s	sys 0.034s
W20260709 13:20:00.025934  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 629586us
I20260709 13:19:59.926103  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:00.029158  4288 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:19:59.934231  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.026288  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:00.030453  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.030534  4291 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:19:59.937686  7279 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:00.031515  4187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.025s	sys 0.044s
W20260709 13:20:00.031831  4187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.025s	sys 0.044s
W20260709 13:19:59.949229  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.017680  8054 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.017926  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:00.019021  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:00.035077  4293 raft_consensus.cc:2410] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:19:59.896938  8096 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.860085  7890 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:19:59.860283  8019 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.032147  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 795170us
I20260709 13:19:59.855836  8053 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:19:59.910540  8048 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:00.068828  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.043035  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:00.066330  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48491.4us
I20260709 13:20:00.096180  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:00.025681  8020 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.078253  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:19:59.911768  8148 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:00.084050  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:00.099400  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:00.044147  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:00.088018  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:00.100653  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:00.101867  4187 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:00.102002  4288 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.104614  4287 raft_consensus.cc:2393] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:00.127736  4290 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:20:00.128274  4290 pending_rounds.cc:85] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 4
I20260709 13:20:00.128569  4290 pending_rounds.cc:107] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:20:00.128865  4290 raft_consensus.cc:2889] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.085691  7890 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.131593  7890 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.132112  8148 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.134099  8148 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:00.134555  8148 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.134960  8148 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:00.135581  8009 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 13:20:00.069016  8026 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.136416  8134 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.164353  8009 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:00.164549  8134 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.164951  8134 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.165160  8026 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:00.167376  8026 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:00.137778  8126 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.213s	user 0.001s	sys 0.006s
I20260709 13:20:00.104598  8124 raft_consensus.cc:2764] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:00.138267  8123 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:00.169135  8123 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:00.170066  8123 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:00.138943  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.173344  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2170) took 1628 ms. Trace:
I20260709 13:19:59.923754  8137 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.173832  4295 rpcz_store.cc:276] 0709 13:19:58.545390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.568015 (+ 22625us) service_pool.cc:224] Handling call
0709 13:19:58.600809 (+ 32794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.601346 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.601391 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.602049 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.855635 (+253586us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:58.855675 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.855837 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.137241 (+1281404us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:00.172918 (+ 35677us) raft_consensus.cc:1685] finished
0709 13:20:00.172951 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.173276 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3415,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4681,"spinlock_wait_cycles":13977344,"thread_start_us":179678,"threads_started":1,"wal-append.queue_time_us":287503}
I20260709 13:20:00.139856  8053 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.140551  4220 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:00.176508  8137 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:00.104380  8028 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.176988  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2432) took 1871 ms. Trace:
I20260709 13:20:00.080456  8096 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.177559  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2443) took 1861 ms. Trace:
I20260709 13:20:00.177996  4220 rpcz_store.cc:276] 0709 13:19:58.316512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.683611 (+367099us) service_pool.cc:224] Handling call
0709 13:19:58.684007 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.176817 (+1492810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.177332 (+   515us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003c37d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:00.177503 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3348985600}
I20260709 13:20:00.179415  8096 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.068020  8084 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:20:00.140995  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:00.072502  7977 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:20:00.069754  8138 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:00.141139  8048 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:00.141858  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:00.184824  4291 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:00.176119  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:00.182301  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:00.143596  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:00.185624  4295 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:20:00.050683  8074 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.186323  4288 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:00.151820  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:00.186959  4287 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:20:00.152977  4289 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:00.177352  4214 rpcz_store.cc:276] 0709 13:19:58.305524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.305691 (+   167us) service_pool.cc:224] Handling call
0709 13:19:58.306318 (+   627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.302726 (+996408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.176769 (+874043us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54003c3cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:00.176932 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159798144}
I20260709 13:20:00.151191  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:00.186138  4293 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:00.189570  4290 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:00.190676  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:00.191306  4288 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:00.187877  8048 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:00.192092  8048 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:00.196081  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2182) took 1596 ms. Trace:
I20260709 13:20:00.196674  4294 rpcz_store.cc:276] 0709 13:19:58.599680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.929581 (+329901us) service_pool.cc:224] Handling call
0709 13:19:59.003961 (+ 74380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.144502 (+140541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.144550 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.179669 (+ 35119us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.590858 (+411189us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:59.590928 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.593630 (+  2702us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.195869 (+602239us) raft_consensus.cc:1685] finished
0709 13:20:00.195891 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.196016 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12214,"raft.queue_time_us":148664,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":45454,"thread_start_us":434305,"threads_started":2,"wal-append.queue_time_us":961005}
I20260709 13:20:00.095870  8019 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.202909  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2184) took 1546 ms. Trace:
I20260709 13:20:00.203505  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:00.205044  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2435) took 1893 ms. Trace:
I20260709 13:20:00.205407  4215 rpcz_store.cc:276] 0709 13:19:58.311481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.311766 (+   285us) service_pool.cc:224] Handling call
0709 13:19:58.326459 (+ 14693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.853963 (+1527504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.204815 (+350852us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000267d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:00.204986 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3510838528}
I20260709 13:20:00.203329  4296 rpcz_store.cc:276] 0709 13:19:58.657135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.704704 (+ 47569us) service_pool.cc:224] Handling call
0709 13:20:00.202728 (+1498024us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400434754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:00.202855 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292112128}
I20260709 13:20:00.222078  4288 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:00.231632  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 529) took 1029 ms. Trace:
I20260709 13:20:00.232266  4920 rpcz_store.cc:276] 0709 13:19:59.175030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.175228 (+   198us) service_pool.cc:224] Handling call
0709 13:20:00.204159 (+1028931us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540062b454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:00.204286 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892063488}
I20260709 13:20:00.234474  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:00.188313  8124 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:20:00.286700  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 82901.6us
I20260709 13:20:00.288457  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:00.239650  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:00.194111  8073 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:00.293773  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:00.199873  8026 raft_consensus.cc:2764] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:20:00.296239  4294 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:00.189455  8085 consensus_queue.cc:1059] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:20:00.307642  4215 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:20:00.288118  8124 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:00.312472  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.313277  8084 raft_consensus.cc:3055] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:00.313745  8056 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:00.290325  8020 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.290108  7833 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:00.317104  8026 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:00.320585  8022 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:00.351207  8022 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:00.321457  7922 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:00.322945  8074 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.324961  8045 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.329276  8134 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.295370  8073 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:00.372977  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2445) took 1921 ms. Trace:
I20260709 13:20:00.350584  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1938) took 1310 ms. Trace:
I20260709 13:20:00.304695  8148 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:00.345819  8124 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:00.376214  4147 rpcz_store.cc:276] 0709 13:19:59.040695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.067928 (+ 27233us) service_pool.cc:224] Handling call
0709 13:20:00.350394 (+1282466us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540022f1d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:00.350523 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337699968}
I20260709 13:20:00.346066  8084 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:00.379937  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 563) took 2179 ms. Trace:
I20260709 13:20:00.355234  8026 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.373529  4221 rpcz_store.cc:276] 0709 13:19:58.451757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.896632 (+444875us) service_pool.cc:224] Handling call
0709 13:19:58.897147 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.840090 (+942943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.372659 (+532569us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54000244d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:00.372901 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631240576}
W20260709 13:20:00.394523  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.381698  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 560) took 2641 ms. Trace:
I20260709 13:20:00.395206  4213 rpcz_store.cc:276] 0709 13:19:57.734207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.734418 (+   211us) service_pool.cc:224] Handling call
0709 13:19:57.734941 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.856230 (+2121289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.375313 (+519083us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400215a54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:00.375500 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3877855104}
I20260709 13:20:00.384068  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 570) took 1297 ms. Trace:
I20260709 13:20:00.396668  4218 rpcz_store.cc:276] 0709 13:19:59.086391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.510776 (+424385us) service_pool.cc:224] Handling call
0709 13:19:59.511191 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.861779 (+350588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.383793 (+522014us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400216e54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:00.384001 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540870400}
W20260709 13:20:00.384977  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.400182  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.389994  8043 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:00.354298  8020 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.393038  8084 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:00.382457  8022 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.388935  8073 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:00.383798  4222 rpcz_store.cc:276] 0709 13:19:58.187746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.187905 (+   159us) service_pool.cc:224] Handling call
0709 13:19:58.188217 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.006150 (+817933us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:59.031051 (+ 24901us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.334474 (+303423us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.342460 (+  7986us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.342678 (+   218us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:59.342731 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.360576 (+1017845us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b540041aad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:00.360644 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.360706 (+    62us) raft_consensus.cc:1685] finished
0709 13:20:00.367274 (+  6568us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.367484 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27033,"prepare.queue_time_us":17624,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":6027,"raft.queue_time_us":28001,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":17439,"spinlock_wait_cycles":1748150144,"thread_start_us":249008,"threads_started":1,"wal-append.queue_time_us":705700}
W20260709 13:20:00.412446  4110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.001s	sys 0.010s
W20260709 13:20:00.418814  4110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.002s	sys 0.010s
W20260709 13:20:00.419661  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 528022us
W20260709 13:20:00.421252  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.418562  4287 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:20:00.426569  4111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.015s	sys 0.042s
I20260709 13:20:00.403800  8026 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:00.429649  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.417328  8092 consensus_meta.cc:287] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.574s	user 0.002s	sys 0.010s
I20260709 13:20:00.395408  8045 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:00.427021  4111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.015s	sys 0.042s
I20260709 13:20:00.436106  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:00.438644  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 371036us
I20260709 13:20:00.407135  8074 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:00.438822  4222 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:20:00.447290  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:00.448029  4222 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:00.448975  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:00.450042  7279 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.436851  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:00.440310  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:00.450907  4289 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:20:00.416574  8096 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.408242  8043 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.444113  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:00.459344  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:00.462555  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:00.457957  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:00.451711  4287 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:00.452636  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:00.455071  4926 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:20:00.455189  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 166825us
I20260709 13:20:00.418411  8138 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:00.450614  7279 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.465782  4222 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
W20260709 13:20:00.466470  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.473982  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:00.474112  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.474797  4222 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:20:00.452441  8073 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.478410  8075 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:00.456246  8034 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:00.481213  8134 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.455063  8074 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.466086  8055 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.462879  8045 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.463749  8096 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.466566  8043 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.477043  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:00.484200  7279 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.517185  7279 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:20:00.485989  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 389894us
I20260709 13:20:00.466835  4186 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:00.519146  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52370us
W20260709 13:20:00.520030  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.520817  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:00.492410  4222 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:20:00.500895  4288 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:00.524020  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:00.528246  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 51304.1us
I20260709 13:20:00.533643  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:00.533696  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:00.555572  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:00.533924  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:00.501318  8148 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:00.561897  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:00.512676  8051 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:00.553648  8028 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.562595  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:00.559794  8086 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:00.531275  8177 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:00.583866  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:00.517971  8019 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:00.512653  8075 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:00.553877  8046 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.034s	sys 0.034s
W20260709 13:20:00.605576  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 243285us
W20260709 13:20:00.574465  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.484911  8138 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.584975  4287 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:20:00.576157  8107 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:00.585831  8051 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.518352  8055 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:00.583113  7833 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:20:00.624955  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69481.6us
I20260709 13:20:00.631358  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:00.588119  8086 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.626406  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2448) took 2008 ms. Trace:
W20260709 13:20:00.626358  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 386794us
W20260709 13:20:00.626552  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 164971us
I20260709 13:20:00.587510  8177 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:00.605758  8046 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.034s	sys 0.035s
I20260709 13:20:00.589016  8076 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.628003  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:00.638610  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 79529.9us
I20260709 13:20:00.638129  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:00.634443  4219 rpcz_store.cc:276] 0709 13:19:58.618504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.149067 (+530563us) service_pool.cc:224] Handling call
0709 13:19:59.149574 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.555946 (+406372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.555978 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.854411 (+298433us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.224280 (+369869us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:00.224322 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.322692 (+ 98370us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400025dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:00.322743 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.606518 (+283775us) raft_consensus.cc:1685] finished
0709 13:20:00.606538 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.626345 (+ 19807us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":427,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":20130,"spinlock_wait_cycles":933418368,"thread_start_us":369345,"threads_started":1,"wal-append.queue_time_us":650847}
I20260709 13:20:00.619097  8172 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:00.624476  8165 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:00.585088  8148 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.648358  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:00.630573  8051 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:00.608551  8164 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:20:00.653824  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.633337  8078 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:00.670884  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:00.646617  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 184155us
W20260709 13:20:00.634152  8091 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.716s	user 0.004s	sys 0.010s
I20260709 13:20:00.587157  8028 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.638855  8086 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.634219  8171 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.653239  8134 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:20:00.672032  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.642652  8019 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:00.659623  8093 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:00.674867  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:00.643656  8076 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.669636  8165 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:00.677968  8049 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.831s	user 0.011s	sys 0.001s
I20260709 13:20:00.669571  8178 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:00.643201  8177 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:00.642597  8107 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:00.633978  7833 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:00.642338  8092 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:20:00.663196  8020 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:00.705732  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47153.8us
W20260709 13:20:00.711747  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62782.5us
I20260709 13:20:00.639436  8085 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:20:00.702320  8019 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:00.673784  8078 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:00.704473  8172 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.731204  8076 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.759187  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:00.780467  4112 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:00.781769  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:00.763906  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 110238us
W20260709 13:20:00.763969  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 107294us
W20260709 13:20:00.785421  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.789399  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:00.756279  8182 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:00.792620  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.682291  8091 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:00.758301  7833 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:00.702140  8124 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.784924  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:00.698436  8164 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:20:00.771883  8020 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:00.759614  8178 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:00.841166  7279 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:00.772614  8019 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.733917  8163 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:20:00.843554  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 205480us
I20260709 13:20:00.844039  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:00.847572  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 172831us
I20260709 13:20:00.842805  8074 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.683693  8075 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:00.739451  8049 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:00.774191  8158 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.793326  8045 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.880503  8046 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:20:00.924871  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 162378us
I20260709 13:20:00.840484  8043 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.701912  8171 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:00.965598  7279 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:00.992679  7279 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.993197  7279 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:00.885479  8020 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:00.894022  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.029812  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.862138  8130 raft_consensus.cc:2764] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:20:00.975800  8182 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:00.966830  8123 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.995921  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 213990us
I20260709 13:20:01.015218  8084 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.017529  4926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 527) took 2132 ms. Trace:
W20260709 13:20:01.092291  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 103501us
I20260709 13:20:00.886008  8096 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:01.038676  8055 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:01.057695  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:01.060039  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:01.062078  4217 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.045444  8020 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:00.992619  8078 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.106784  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.992182  8046 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:01.123905  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.044425  8167 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.414s	user 0.000s	sys 0.001s
I20260709 13:20:01.093159  8204 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:01.132308  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 72380.1us
W20260709 13:20:01.159370  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 101792us
I20260709 13:20:01.026314  8045 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:20:01.165462  4143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 392) took 2124 ms (client timeout 2215 ms). Trace:
I20260709 13:20:01.096324  4926 rpcz_store.cc:276] 0709 13:19:58.884817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.885056 (+   239us) service_pool.cc:224] Handling call
0709 13:19:58.898519 (+ 13463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.465763 (+1567244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.017230 (+551467us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540061f154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:01.017429 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3559417600}
I20260709 13:20:00.991812  8098 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:01.110370  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:01.196441  4218 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.198753  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:01.190107  4143 rpcz_store.cc:269] 0709 13:19:59.041415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.069646 (+ 28231us) service_pool.cc:224] Handling call
0709 13:20:01.153029 (+2083383us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540022e7d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:01.165346 (+ 12317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3669570304}
I20260709 13:20:01.214547  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2460) took 1832 ms. Trace:
W20260709 13:20:01.229368  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 444495us
W20260709 13:20:01.230823  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55293.1us
W20260709 13:20:01.230930  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 54910.7us
I20260709 13:20:01.215564  4217 rpcz_store.cc:276] 0709 13:19:59.382257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.899417 (+517160us) service_pool.cc:224] Handling call
0709 13:19:59.912114 (+ 12697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.119110 (+1206996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.214091 (+ 94981us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002f3ad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:01.214442 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644032384}
W20260709 13:20:01.233743  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.174623  8197 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:20:01.234405  4892 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:01.171582  8046 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:01.285616  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 79299.3us
I20260709 13:20:01.130860  8209 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:01.026940  8158 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.303308  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:01.149319  8130 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.107739  8055 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.165s
W20260709 13:20:01.309849  4893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.746s (SENT) [suppressed 25 similar messages]
I20260709 13:20:01.332722  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:01.316632  7279 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.293406  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59093us
I20260709 13:20:01.350687  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:01.355301  4289 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:01.170506  8138 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:01.174762  8074 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:20:01.271726  8175 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.593s	user 0.001s	sys 0.000s
W20260709 13:20:01.279690  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.189803  8045 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:01.296327  8180 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.564s	user 0.000s	sys 0.001s
W20260709 13:20:01.400432  8181 log.cc:927] Time spent T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.607s	user 0.000s	sys 0.001s
W20260709 13:20:01.402225  8196 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.448s	user 0.001s	sys 0.000s
I20260709 13:20:01.292519  8096 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:20:01.380090  8074 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.406138  8074 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:01.389159  7890 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:20:01.412099  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2463) took 1900 ms. Trace:
I20260709 13:20:01.413797  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2462) took 1905 ms. Trace:
I20260709 13:20:01.275395  8148 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:01.292752  8075 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.388633  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 56091.8us
I20260709 13:20:01.131237  8123 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.402065  8201 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.379272  7279 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:01.477882  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:01.478832  4222 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:01.414309  4220 rpcz_store.cc:276] 0709 13:19:59.508210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.178914 (+670704us) service_pool.cc:224] Handling call
0709 13:20:00.179191 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.179487 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.179516 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.179919 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.465795 (+285876us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:00.465835 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.465898 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.413504 (+947606us) raft_consensus.cc:1685] finished
0709 13:20:01.413532 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.413722 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":978,"raft.queue_time_us":3884,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5619,"thread_start_us":285529,"threads_started":1,"wal-append.queue_time_us":449975}
W20260709 13:20:01.392441  7942 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.521s	user 0.014s	sys 0.000s
I20260709 13:20:01.319221  8028 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:00.988749  8107 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.379631  8170 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.681s	user 0.001s	sys 0.001s
I20260709 13:20:01.279240  8172 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:01.479902  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:01.412774  4214 rpcz_store.cc:276] 0709 13:19:59.512059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.188973 (+676914us) service_pool.cc:224] Handling call
0709 13:20:00.189272 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.218841 (+ 29569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.218989 (+   148us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.289207 (+ 70218us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.632404 (+343197us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:00.632500 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.632590 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.411820 (+779230us) raft_consensus.cc:1685] finished
0709 13:20:01.411843 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.412019 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16194,"raft.queue_time_us":46639,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4308,"thread_start_us":317666,"threads_started":1,"wal-append.queue_time_us":430302}
I20260709 13:20:01.274338  8098 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:01.477392  8130 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.483036  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:01.494621  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:01.494199  7279 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:01.522006  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 212021us
I20260709 13:20:01.526754  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:01.527017  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:01.572618  4222 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:01.497262  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:01.481472  8092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.004s	sys 0.019s
I20260709 13:20:01.493633  8069 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.483103  8165 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:01.316579  8203 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.242s
I20260709 13:20:01.528388  7890 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.597033  4185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.059s	sys 0.107s
W20260709 13:20:01.611795  4185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.060s	sys 0.107s
I20260709 13:20:01.613679  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:01.614882  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:01.539752  8048 consensus_meta.cc:287] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.345s	user 0.015s	sys 0.000s
I20260709 13:20:01.594622  8091 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:01.567487  8034 consensus_meta.cc:287] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.064s	user 0.010s	sys 0.003s
I20260709 13:20:01.623927  4219 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:01.435019  8198 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.226s
I20260709 13:20:01.464570  7898 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:01.196442  8204 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.417225  8200 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:20:01.413338  8022 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.434267  8191 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
W20260709 13:20:01.657550  8026 consensus_meta.cc:287] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.210s	user 0.007s	sys 0.006s
W20260709 13:20:01.633428  8174 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.298s	user 0.000s	sys 0.000s
I20260709 13:20:01.738852  4290 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:01.622648  8130 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:20:01.643615  7922 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.280s	user 0.006s	sys 0.002s
I20260709 13:20:01.742983  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:01.661237  8053 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.643726  8048 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.644711  8028 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:01.617439  8069 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:01.582736  8124 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:01.654609  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2457) took 2554 ms. Trace:
W20260709 13:20:01.738435  8086 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.031s	user 0.006s	sys 0.006s
W20260709 13:20:01.603133  8092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.005s	sys 0.020s
I20260709 13:20:01.266023  8078 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.664021  4219 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:01.765089  4216 rpcz_store.cc:276] 0709 13:19:59.100646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.844472 (+743826us) service_pool.cc:224] Handling call
0709 13:19:59.844894 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.887699 (+ 42805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.887735 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.903071 (+ 15336us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.514072 (+611001us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:00.514131 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.514230 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.654317 (+1140087us) raft_consensus.cc:1685] finished
0709 13:20:01.654339 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.654530 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16602,"raft.queue_time_us":42274,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":9018,"thread_start_us":434460,"threads_started":1,"wal-append.queue_time_us":706880}
I20260709 13:20:01.675202  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:01.665452  4218 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:20:01.686875  4891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.004s	sys 0.008s
I20260709 13:20:01.354905  8209 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:01.656327  8076 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.818s	user 0.004s	sys 0.003s
W20260709 13:20:01.585464  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 91257.2us
I20260709 13:20:01.495889  8075 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.596807  8217 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:01.470077  8182 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.695291  7898 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.737268  8184 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:20:01.657971  8134 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:01.596905  7942 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
W20260709 13:20:01.757056  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.610467  8090 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 2.208s	user 0.013s	sys 0.004s
I20260709 13:20:01.716933  8049 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:01.625617  7890 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.657675  7977 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:20:01.493992  8201 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.775324  4891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.004s	sys 0.008s
I20260709 13:20:01.379069  8178 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.770313  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.662819  8216 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:20:01.804842  8163 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.778311  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 163617us
W20260709 13:20:01.779878  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 104807us
I20260709 13:20:01.780437  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:01.788492  7279 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.791436  4288 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:01.769811  8171 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:01.779404  8177 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.011s	user 0.008s	sys 0.004s
I20260709 13:20:01.821762  8090 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.758731  8053 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.784904  8217 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:01.731401  8022 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.891873  8206 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
W20260709 13:20:01.822244  4261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.009s	sys 0.022s
W20260709 13:20:01.905231  4261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.010s	sys 0.022s
I20260709 13:20:01.799129  8134 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.662281  8172 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:01.777616  4287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.057s	sys 0.143s
I20260709 13:20:01.906569  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:01.846122  7279 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.907272  4287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.057s	sys 0.143s
I20260709 13:20:01.848544  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:01.908008  4927 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.908162  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2406) took 1121 ms. Trace:
I20260709 13:20:01.849450  8123 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:01.849978  8163 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.850450  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:01.917953  4292 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:01.851358  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:01.853443  8219 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:01.848631  8232 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.923833  8232 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:01.909370  8098 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:01.897699  8090 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.928306  8074 consensus_meta.cc:287] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.002s
I20260709 13:20:01.945418  8074 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.940958  8048 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:01.878233  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:01.852499  8213 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:01.878635  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:01.963984  4222 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:01.964049  4288 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:01.745471  8026 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.825068  8198 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.835132  8194 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:20:01.893149  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 113722us
W20260709 13:20:01.804533  8020 consensus_meta.cc:287] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.001s
I20260709 13:20:01.900717  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2392) took 1877 ms. Trace:
I20260709 13:20:01.837158  8049 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:01.903599  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:01.889144  7833 consensus_meta.cc:287] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.004s	user 0.005s	sys 0.012s
W20260709 13:20:01.889644  8056 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.542s	user 0.012s	sys 0.002s
W20260709 13:20:01.848237  8193 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.810s	user 0.000s	sys 0.001s
I20260709 13:20:01.780788  8086 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:01.909448  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 1.23857e+06us
I20260709 13:20:01.909832  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:01.908799  4287 rpcz_store.cc:276] 0709 13:20:00.787146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.788443 (+  1297us) service_pool.cc:224] Handling call
0709 13:20:00.788741 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.788975 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:01.059622 (+270647us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.240877 (+181255us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.907767 (+666890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.907824 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:01.907872 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.907942 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.908092 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1103100,"raft.queue_time_us":303838,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":181,"thread_start_us":1065736,"threads_started":3,"wal-append.queue_time_us":426435}
I20260709 13:20:01.786381  8076 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:01.919497  4290 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:01.908771  8054 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:20:01.891901  8177 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:01.946195  8043 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.811187  8168 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.935678  4927 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:01.941998  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:01.929137  8212 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:01.935021  8051 consensus_meta.cc:287] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.256s	user 0.014s	sys 0.001s
I20260709 13:20:01.944056  8090 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:01.957172  8164 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:20:01.929298  8208 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.957129  8204 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:01.957542  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:01.957798  8231 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.959347  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:01.899622  8217 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.033485  4291 rpcz_store.cc:276] 0709 13:20:00.022868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.185461 (+162593us) service_pool.cc:224] Handling call
0709 13:20:00.185772 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.298649 (+112877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.298696 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.305910 (+  7214us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.691115 (+385205us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:00.691163 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.024727 (+333564us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540042b3d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:01.024809 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.893494 (+868685us) raft_consensus.cc:1685] finished
0709 13:20:01.893516 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.900622 (+  7106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":647,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5855,"spinlock_wait_cycles":258556288,"thread_start_us":334860,"threads_started":1,"wal-append.queue_time_us":885669}
I20260709 13:20:02.039726  4215 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.908723  8199 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.062852  8198 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.045755  8020 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.064093  8075 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:01.939985  8209 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.064797  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:02.198324  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:01.938170  8022 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:01.955633  8172 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:02.079315  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 95370.8us
I20260709 13:20:02.182550  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:02.184309  4924 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:02.075851  4923 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:20:02.186632  7279 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.233832  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:02.287693  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.302716  4220 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:02.322052  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 88251.8us
I20260709 13:20:02.323014  4926 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:02.209059  4292 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:02.170275  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:01.942624  8045 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.035061  8179 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:02.090785  8222 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:02.203047  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2469) took 1769 ms. Trace:
I20260709 13:20:02.076151  8194 raft_consensus.cc:697] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:02.169448  8224 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.182636  8054 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:02.327941  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145490us
I20260709 13:20:02.328574  4215 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:02.356209  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:02.070928  4146 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:02.065891  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:02.237161  8019 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.247s	user 0.013s	sys 0.000s
I20260709 13:20:02.248873  8020 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.337213  7279 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:20:02.335512  4221 rpcz_store.cc:276] 0709 13:20:00.433480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.434898 (+  1418us) service_pool.cc:224] Handling call
0709 13:20:00.435314 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.443136 (+  7822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.443178 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.443723 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.647396 (+203673us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:00.647453 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.647613 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.202812 (+1555199us) raft_consensus.cc:1685] finished
0709 13:20:02.202842 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.202987 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7933,"thread_start_us":164620,"threads_started":1,"wal-append.queue_time_us":295405}
I20260709 13:20:02.142480  8069 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:02.257694  8046 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.901s	user 0.014s	sys 0.002s
I20260709 13:20:02.408245  4928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6b9a320ff854b5998471937010702d5"
dest_uuid: "b81584b21ed144698954548303f1e507"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:33560
I20260709 13:20:02.408985  4928 raft_consensus.cc:606] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:20:02.409235  8046 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.199188  4287 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:02.234421  8164 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:02.411893  8046 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.238430  7898 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.257967  8209 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.358556  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.204588  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:02.231992  8232 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.208634  8098 consensus_queue.cc:1059] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 13:20:02.203390  8231 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.208472  8168 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.246721  8028 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.064651  7833 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.232563  8074 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.247184  8086 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.040835  8134 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.364490  8172 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:02.372519  8203 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.372522  8207 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.414356  8186 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.266s	user 0.001s	sys 0.008s
W20260709 13:20:02.463733  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 359083us
I20260709 13:20:02.406687  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.406417  8224 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.465953  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:02.203241  8212 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.407588  8123 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:02.428900  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.335820  8178 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:20:02.444900  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 379101us
I20260709 13:20:02.065614  8049 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.340592  8022 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:02.462918  8075 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.450359  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:02.508893  4147 raft_consensus.cc:2393] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:02.335970  8204 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:02.203508  8043 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.202797  8051 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.354254  8054 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:02.339607  8034 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.547230  8034 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.412096  8164 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:02.549181  8164 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.550626  8164 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.405983  8019 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.446436  8209 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.466686  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:02.206240  8208 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.474954  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:02.562350  4215 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:02.562778  8212 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.564543  4296 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:02.567229  8198 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.477077  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:02.568698  4143 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:02.454974  8073 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.963s	user 0.013s	sys 0.004s
I20260709 13:20:02.570041  8034 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.535684  8204 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.571564  4221 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:02.462354  8232 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:02.478698  4213 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 8. Ops: [6.5-6.5]
I20260709 13:20:02.500675  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:02.471853  8203 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.500936  4142 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:02.500448  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:02.603080  4144 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:02.601125  8242 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:20:02.504297  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:02.349246  8124 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:02.451649  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:02.509269  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:02.511926  8084 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 1.363s	user 0.015s	sys 0.000s
I20260709 13:20:02.457934  8028 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.512316  8049 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.512832  8130 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:02.513044  8172 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:02.478084  8123 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.622334  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:02.515785  8022 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.539773  8134 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.542271  8051 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.544139  8224 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:02.545699  7833 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.203204  8199 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.646898  8199 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.382864  8179 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.482945  8178 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:02.467103  4920 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:02.568933  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:02.360673  8222 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.573105  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2482) took 1059 ms. Trace:
I20260709 13:20:02.652838  4214 rpcz_store.cc:276] 0709 13:20:01.513988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.539595 (+ 25607us) service_pool.cc:224] Handling call
0709 13:20:01.540027 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:01.540506 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.540548 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:01.960272 (+419724us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b2c00010988. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:01.960708 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:20:02.337130 (+376422us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:02.337174 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.337274 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.553601 (+216327us) raft_consensus.cc:1685] finished
0709 13:20:02.553626 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.573038 (+ 19412us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98636,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":70,"spinlock_wait_cycles":7738624,"thread_start_us":376065,"threads_started":1,"wal-append.queue_time_us":516857}
I20260709 13:20:02.575126  4215 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:20:02.460618  8226 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:02.636358  8228 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.613286  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:02.669842  4143 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:20:02.670003  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:02.604625  8239 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:20:02.564179  8208 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.480618  8207 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:02.519768  8074 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
W20260709 13:20:02.627018  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 208752us
I20260709 13:20:02.654698  8178 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:02.606222  8235 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.614955  8232 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:02.536203  8075 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.693816  8022 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.694985  8207 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.695410  8179 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.695703  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2412) took 1019 ms. Trace:
I20260709 13:20:02.696240  4296 rpcz_store.cc:276] 0709 13:20:01.676058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.676992 (+   934us) service_pool.cc:224] Handling call
0709 13:20:01.677375 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.564944 (+887569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.695463 (+130519us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b5400354dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:02.695642 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039824640}
I20260709 13:20:02.655952  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.698433  8222 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.699321  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:02.700414  4215 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:02.414093  8194 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.704475  8203 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.704540  8163 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.706743  8085 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:02.707618  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:02.640638  8123 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:02.620491  4141 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:02.671625  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.740994  4214 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:02.742432  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:02.743315  4214 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:02.635596  8177 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:02.673907  8243 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:20:02.680079  8019 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:02.537993  8231 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:02.685144  4144 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:02.655821  8076 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:02.690315  8232 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.681813  8228 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.709830  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.784004  4215 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
W20260709 13:20:02.748298  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.700567  8209 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:02.755918  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:02.707397  8085 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:02.674467  8226 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:02.786201  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 302340us
I20260709 13:20:02.798832  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.822147  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:02.822208  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 618189us
I20260709 13:20:02.826879  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:02.826869  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:02.827725  4922 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:02.711638  8235 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.773634  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.836553  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2479) took 1358 ms. Trace:
I20260709 13:20:02.849670  4220 rpcz_store.cc:276] 0709 13:20:01.478134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.479586 (+  1452us) service_pool.cc:224] Handling call
0709 13:20:02.836185 (+1356599us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54002f0654. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:02.836448 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754452864}
I20260709 13:20:02.850613  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.852034  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:02.852280  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:02.850328  4214 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:20:02.852164  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:02.855521  4927 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:02.852612  8019 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:20:02.859352  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:02.860452  4221 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:02.861625  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:02.862366  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:02.863036  4147 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.865295  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:02.835705  8217 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.000s
I20260709 13:20:02.862659  4139 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:02.861966  8085 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.866796  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:02.867472  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:02.833030  8249 log.cc:927] Time spent T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:20:02.816846  8043 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.885694  4921 raft_consensus.cc:2410] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:20:02.919620  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.965309  4147 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:02.967628  4220 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:02.969146  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:02.953373  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 101215us
I20260709 13:20:02.973327  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:02.975143  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:02.978520  4214 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:02.979839  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 576) took 1044 ms. Trace:
I20260709 13:20:02.980332  4214 rpcz_store.cc:276] 0709 13:20:01.935907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.938899 (+1002992us) service_pool.cc:224] Handling call
0709 13:20:02.953008 (+ 14109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.979362 (+ 26354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.979743 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:02.988629  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 204827us
I20260709 13:20:02.989069  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:02.990772  4147 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:02.870133  8019 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:03.000675  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:20:02.938108  8078 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.153s	user 0.012s	sys 0.004s
W20260709 13:20:02.909667  8210 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:03.034248  4140 raft_consensus.cc:2410] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:02.884676  8231 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:03.026366  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.027828  8253 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:02.898344  8130 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:02.861658  8226 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:02.991346  8217 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:02.854820  8204 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:03.050021  8130 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:03.052959  8202 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.857s	user 0.004s	sys 0.022s
I20260709 13:20:03.054001  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:03.040889  8253 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:03.055197  8253 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.054373  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2485) took 1137 ms. Trace:
I20260709 13:20:02.983968  8172 raft_consensus.cc:2764] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:03.039644  4147 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:02.911350  8224 raft_consensus.cc:476] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:20:03.041251  8254 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:03.059412  8224 raft_consensus.cc:2764] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:20:03.059814  8254 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.060643  8231 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:03.061776  8231 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.056862  4216 rpcz_store.cc:276] 0709 13:20:01.917312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.284674 (+367362us) service_pool.cc:224] Handling call
0709 13:20:02.285275 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.324418 (+ 39143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.324472 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:02.325260 (+   788us) log.cc:844] Serialized 26 byte log entry
0709 13:20:02.737936 (+412676us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:02.737996 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.738101 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.054171 (+316070us) raft_consensus.cc:1685] finished
0709 13:20:03.054190 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.054317 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41355,"raft.queue_time_us":41494,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9154,"thread_start_us":266690,"threads_started":1,"wal-append.queue_time_us":605028}
I20260709 13:20:03.066854  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.068749  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.070596  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.082957  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:03.085568  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.005570  8028 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:03.089547  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.091596  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.094830  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:03.052273  8130 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:03.096928  4187 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:03.102973  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:03.085639  8226 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.104950  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.112097  4147 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:03.106005  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.106890  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.113821  4218 raft_consensus.cc:2410] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:20:03.112394  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 136041us
I20260709 13:20:03.114280  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2488) took 1074 ms. Trace:
I20260709 13:20:03.114646  4218 rpcz_store.cc:276] 0709 13:20:02.040025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.106516 (+1066491us) service_pool.cc:224] Handling call
0709 13:20:03.114210 (+  7694us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.082458  8085 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.088317  8098 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:03.120426  8226 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.117177  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.123518  4216 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:03.107652  8177 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:03.126853  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.094590  8204 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:20:03.128019  4146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1933) took 4085 ms (client timeout 1683 ms). Trace:
I20260709 13:20:03.104760  4919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 535) took 1114 ms. Trace:
I20260709 13:20:03.109985  8182 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:03.138374  4146 rpcz_store.cc:269] 0709 13:19:59.038854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.058469 (+ 19615us) service_pool.cc:224] Handling call
0709 13:20:03.123699 (+4065230us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b5400285d54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:03.123801 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6775059840}
I20260709 13:20:03.144640  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:03.150226  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 271030us
I20260709 13:20:03.129802  8233 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:03.146126  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:03.167804  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.149619  8228 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.147416  8177 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:03.178149  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2487) took 1228 ms. Trace:
I20260709 13:20:03.210362  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.182814  8253 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.211383  4217 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:03.209244  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 507) took 1303 ms. Trace:
I20260709 13:20:03.212873  8253 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:03.183633  8271 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:03.212918  4920 rpcz_store.cc:276] 0709 13:20:01.905969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.906201 (+   232us) service_pool.cc:224] Handling call
0709 13:20:03.208996 (+1302795us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54006e0354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:03.209159 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286791552}
I20260709 13:20:03.213809  8271 raft_consensus.cc:697] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:03.214967  8054 consensus_meta.cc:287] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.007s
I20260709 13:20:03.214855  8271 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.215445  8054 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:03.216734  4139 raft_consensus.cc:2393] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:03.184329  8257 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 13:20:03.184716  8254 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.185122  8124 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:03.193077  4187 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.965s (SENT)
I20260709 13:20:03.197041  8217 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.200781  8226 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.202404  8201 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.207959  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1975) took 2049 ms. Trace:
I20260709 13:20:03.208766  4221 rpcz_store.cc:276] 0709 13:20:01.949902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.863025 (+913123us) service_pool.cc:224] Handling call
0709 13:20:02.863407 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.863644 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:03.067309 (+203665us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.177807 (+110498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.177863 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:03.177916 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.177984 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.178095 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8693,"prepare.queue_time_us":140586,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":6434,"raft.queue_time_us":9504,"thread_start_us":304571,"threads_started":2}
I20260709 13:20:03.150292  8224 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:03.222083  4214 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:20:03.227324  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.150111  8172 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:20:03.129120  8019 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.241472  4213 rpcz_store.cc:276] 0709 13:20:01.158238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.158463 (+   225us) service_pool.cc:224] Handling call
0709 13:20:01.415924 (+257461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.623600 (+1207676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.122615 (+499015us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003c2dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:03.207614 (+ 84999us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54003c2dd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:03.207850 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3033976576}
W20260709 13:20:03.218678  8164 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.004s
I20260709 13:20:03.257112  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.259083  4143 raft_consensus.cc:2410] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:03.240830  8253 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.238796  8124 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.266769  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.267966  4146 raft_consensus.cc:2410] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:20:03.217828  8233 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:03.294986  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 577) took 1720 ms. Trace:
I20260709 13:20:03.295341  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.307677  4289 rpcz_store.cc:276] 0709 13:20:01.574417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.601157 (+ 26740us) service_pool.cc:224] Handling call
0709 13:20:01.601469 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.955012 (+353543us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:01.955042 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.955079 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:01.955109 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.294661 (+1339552us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400259ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:03.294721 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.294909 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812613376}
I20260709 13:20:03.309177  4221 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:03.297960  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.263389  8026 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.313829  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.314710  4146 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:03.310834  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.316723  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.317097  4138 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:03.323829  4219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1976) took 2122 ms (client timeout 2065 ms). Trace:
I20260709 13:20:03.323135  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.317706  4213 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:03.319200  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.312193  8226 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.355182  4217 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:20:03.355281  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:03.345811  8123 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
I20260709 13:20:03.354089  8158 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:03.349494  4219 rpcz_store.cc:269] 0709 13:20:01.198326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.198472 (+   146us) service_pool.cc:224] Handling call
0709 13:20:03.320729 (+2122257us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54002ef754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:03.320854 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976080640}
I20260709 13:20:03.360942  8233 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.361620  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.269969  8253 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.344616  8172 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:03.363377  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:03.380800  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.419986  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:03.420673  4221 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
W20260709 13:20:03.389252  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.215s (SENT)
I20260709 13:20:03.414516  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.421571  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:03.422094  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:03.424088  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.141013  4919 rpcz_store.cc:276] 0709 13:20:01.919678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.046082 (+126404us) service_pool.cc:224] Handling call
0709 13:20:02.155380 (+109298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.208358 (+ 52978us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:02.474102 (+265744us) log.cc:844] Serialized 14 byte log entry
0709 13:20:02.902718 (+428616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:02.926045 (+ 23327us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:02.935474 (+  9429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.988498 (+ 53024us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.034020 (+ 45522us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1644,"prepare.queue_time_us":399929,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":3332,"raft.queue_time_us":30412,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":33346,"thread_start_us":561774,"threads_started":2,"wal-append.queue_time_us":560567}
I20260709 13:20:03.320147  8177 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.428586  8054 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:03.430460  8178 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.720s	user 0.003s	sys 0.007s
I20260709 13:20:03.430848  8172 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:03.432184  8275 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:03.434705  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.447149  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.447623  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.447890  4147 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:03.435087  8253 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:03.436550  8217 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:20:03.439080  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2486) took 1518 ms. Trace:
I20260709 13:20:03.452760  4222 rpcz_store.cc:276] 0709 13:20:01.920852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.438199 (+1517347us) service_pool.cc:224] Handling call
0709 13:20:03.438536 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.438743 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.438765 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.438803 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:03.438842 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.438902 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.439028 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.439996  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.443610  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.444489  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.447886  4146 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:03.450076  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.456089  4222 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:03.456251  4147 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:20:03.457588  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.458456  4147 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:03.450106  4140 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:03.373523  8123 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.461493  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:03.460116  4261 connection.cc:256] RPC call timeout handler was delayed by -3.4883643000000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:20:03.366222  8226 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.463999  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.464946  4146 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
W20260709 13:20:03.463030  4261 connection.cc:256] RPC call timeout handler was delayed by -3.4271642999999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:20:03.466055  4261 connection.cc:256] RPC call timeout handler was delayed by -3.42176429999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:20:03.466547  4261 connection.cc:256] RPC call timeout handler was delayed by -3.3956642999999076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260709 13:20:03.467700  4261 connection.cc:256] RPC call timeout handler was delayed by -3.3695643000000928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:20:03.468104  4261 connection.cc:256] RPC call timeout handler was delayed by -3.3353643000000375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 13:20:03.469270  4261 connection.cc:256] RPC call timeout handler was delayed by -3.3353643000000375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:20:03.447976  8224 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:03.456810  8253 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:03.448530  8178 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:03.469818  4261 connection.cc:256] RPC call timeout handler was delayed by -3.3263643000000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 13:20:03.471381  8172 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:03.472679  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 577) took 1500 ms. Trace:
I20260709 13:20:03.465378  8277 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:03.602515  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.474880  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.492481  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.492589  4215 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:03.608410  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:03.604194  4261 connection.cc:256] RPC call timeout handler was delayed by -3.2939642999999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:20:03.610775  4261 connection.cc:256] RPC call timeout handler was delayed by -3.1526642999999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:20:03.611209  4261 connection.cc:256] RPC call timeout handler was delayed by -3.102264299999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 13:20:03.611539  4261 connection.cc:256] RPC call timeout handler was delayed by -3.0329643000000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 13:20:03.611841  4261 connection.cc:256] RPC call timeout handler was delayed by -2.9915642999999363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:20:03.612154  4261 connection.cc:256] RPC call timeout handler was delayed by -2.8664642999999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 13:20:03.552075  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.612474  4261 connection.cc:256] RPC call timeout handler was delayed by -2.6243643000000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2473s for a response
W20260709 13:20:03.612834  4261 connection.cc:256] RPC call timeout handler was delayed by -2.3804643000000851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27440000000000003s for a response
W20260709 13:20:03.613130  4261 connection.cc:256] RPC call timeout handler was delayed by -2.0600643000000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31000000000000005s for a response
I20260709 13:20:03.613721  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.614349  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.615258  4140 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:03.477438  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.460126  8231 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.603158  4220 rpcz_store.cc:276] 0709 13:20:01.971978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.989651 (+1017673us) service_pool.cc:224] Handling call
0709 13:20:02.990103 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.092564 (+102461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.092596 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.093060 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.178072 (+ 85012us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:03.178106 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.178211 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.472455 (+294244us) raft_consensus.cc:1685] finished
0709 13:20:03.472478 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.472620 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101954,"raft.queue_time_us":102352,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":13581,"thread_start_us":51044,"threads_started":1,"wal-append.queue_time_us":212120}
I20260709 13:20:03.621791  4146 raft_consensus.cc:2410] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:03.634021  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.632637  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2495) took 1395 ms. Trace:
I20260709 13:20:03.662328  4222 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:20:03.630244  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2498) took 1258 ms. Trace:
I20260709 13:20:03.684034  4143 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:03.621274  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.627718  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.475891  7898 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:20:03.645465  4893 leader_election.cc:336] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.746s (SENT)
W20260709 13:20:03.625909  4031 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a35e1cee8a15436dbfaf75dd67824aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 32ebd3bc4af5446f94d9f3ac7c8cf53c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:03.687738  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:03.699204  4031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 73398.6us
I20260709 13:20:03.685506  4216 rpcz_store.cc:276] 0709 13:20:02.237574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.084716 (+847142us) service_pool.cc:224] Handling call
0709 13:20:03.123193 (+ 38477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.124363 (+  1170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.632212 (+507849us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b54003c2dd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:03.632538 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87334656}
I20260709 13:20:03.683686  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:03.616212  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:03.650503  8276 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.289s	user 0.003s	sys 0.000s
I20260709 13:20:03.705406  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:03.629508  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.700901  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55471.5us
I20260709 13:20:03.687386  4144 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:03.706739  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.702092  4261 leader_election.cc:400] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:20:03.710970  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.711777  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.712252  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:03.712586  4138 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:03.708835  4140 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:03.686218  4217 rpcz_store.cc:276] 0709 13:20:02.372220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.217816 (+845596us) service_pool.cc:224] Handling call
0709 13:20:03.218347 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.358074 (+139727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.629834 (+271760us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002f3ad4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:03.630174 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314077568}
I20260709 13:20:03.669657  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:03.711866  4216 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:20:03.713621  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.622681  4218 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:20:03.714851  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45322.7us
I20260709 13:20:03.715597  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:03.622007  8098 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:03.720974  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.644752  8053 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.647972  8226 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.703508  8278 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:03.622335  8178 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.729247  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:03.698468  7898 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:03.637569  8235 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:03.652029  8123 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.734345  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:03.654098  8045 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:03.641708  8075 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:03.742138  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:03.786623  8164 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:20:03.786934  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44866.1us
I20260709 13:20:03.787393  8164 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:03.788106  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:03.788767  8164 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.789553  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:03.731400  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.791196  4146 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:03.792625  8019 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:03.793282  8019 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.793643  8019 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.743444  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.744391  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:03.726629  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.608654  8253 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:03.757157  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.800908  4144 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:03.801154  4138 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:03.802255  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.803509  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.804276  4138 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:03.776283  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:03.725347  8098 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:03.537209  8224 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.617254  8277 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:03.728154  8096 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:03.785377  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:03.817121  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.797767  4216 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:03.798300  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.818485  4146 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:03.819546  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.734269  8172 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:03.805961  4140 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:03.807423  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:03.805881  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2185) took 1043 ms. Trace:
I20260709 13:20:03.805784  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.830657  4138 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:03.809458  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:03.812971  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:03.814481  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:03.739874  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:03.822033  4925 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:03.734104  8234 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:03.856251  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:03.857568  4296 raft_consensus.cc:2410] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:20:03.857939  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:03.859083  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:03.862819  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:03.863598  4294 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:03.865245  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2506) took 1090 ms. Trace:
I20260709 13:20:03.866139  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:03.865875  4215 rpcz_store.cc:276] 0709 13:20:02.774965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.798410 (+ 23445us) service_pool.cc:224] Handling call
0709 13:20:03.864984 (+1066574us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540041a5d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:03.865169 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585239808}
I20260709 13:20:03.868516  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:03.869180  4294 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.872928  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:03.873675  4293 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:03.876483  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:03.876699  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:03.877241  4287 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:03.877563  4296 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.878847  4928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33560 (request call id 0) took 1663 ms. Trace:
I20260709 13:20:03.879302  4928 rpcz_store.cc:276] 0709 13:20:02.215639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.330104 (+114465us) service_pool.cc:224] Handling call
0709 13:20:03.878550 (+1548446us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b4c000bd380. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3cfaea20 00007fee3cfbfa29 00007fee3cf85644 00007fee3cfacf2d 00007fee3cfacb93 00007fee3ecdcc92 00007fee3ecdc84a 00007fee43caa60a 00007fee3d2307d4 00007fee3d230762 00007fee3d230691
0709 13:20:03.878712 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15601408}
I20260709 13:20:03.887055  7890 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:03.904196  4142 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:03.909195  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2497) took 1661 ms. Trace:
I20260709 13:20:03.913241  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:03.915134  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:03.921665  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:03.923084  8282 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:20:03.922411  4287 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:20:03.921725  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:03.931519  4288 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.909759  4218 rpcz_store.cc:276] 0709 13:20:02.247401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.115324 (+867923us) service_pool.cc:224] Handling call
0709 13:20:03.116214 (+   890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.714825 (+598611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.908843 (+194018us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54003c32d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:03.909115 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164079872}
I20260709 13:20:03.942167  4892 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:03.830265  4141 rpcz_store.cc:276] 0709 13:20:02.762861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.765962 (+  3101us) service_pool.cc:224] Handling call
0709 13:20:02.766555 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.766941 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:02.809100 (+ 42159us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.639797 (+830697us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b1800440680. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a 00007fee3ececa2a
0709 13:20:03.805360 (+165563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.805416 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:03.805467 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.805577 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.805827 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41910,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":13368,"spinlock_wait_cycles":22450944,"thread_start_us":165274,"threads_started":1}
I20260709 13:20:03.983582  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:03.711455  8231 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:03.845866  8091 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:20:04.120306  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.146525  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 357036us
I20260709 13:20:04.195842  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:04.204674  4288 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
W20260709 13:20:04.171087  8124 consensus_meta.cc:287] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.009s
I20260709 13:20:03.800323  8278 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.151321  7890 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.151856  7942 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:04.152794  8019 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:03.847770  8271 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.750758  8279 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.154625  8172 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.984561  7898 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.158185  4294 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:04.252195  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.252646  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.192956  8091 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:04.160615  8179 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.160805  8078 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:04.166704  8053 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.164074  8234 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:04.032830  8098 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:04.183907  8233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.039s	sys 0.079s
I20260709 13:20:04.160262  8075 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.237694  7942 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.237520  8124 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.264577  8172 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.272046  8091 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:04.302467  8283 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:04.302610  8172 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:04.287976  8233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.040s	sys 0.079s
I20260709 13:20:04.303431  8168 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:04.246166  7890 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.305723  8234 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.296417  8075 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:04.278815  8053 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.284632  8278 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:04.285395  8179 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.319614  8179 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:04.297206  8208 consensus_queue.cc:1175] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b81584b21ed144698954548303f1e507" responder_term: 11 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:03.982895  4138 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:04.151333  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2191) took 1289 ms. Trace:
I20260709 13:20:04.376281  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 413) took 1333 ms. Trace:
W20260709 13:20:04.151501  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.487663  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.485600  4140 rpcz_store.cc:276] 0709 13:20:02.861787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.829517 (+967730us) service_pool.cc:224] Handling call
0709 13:20:03.829896 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.150933 (+321037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.150970 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.151016 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:04.151069 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.151142 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.151271 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320633,"raft.queue_time_us":321345,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118}
I20260709 13:20:04.491760  4140 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:20:04.150966  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 341549us
I20260709 13:20:04.380090  4144 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:04.493377  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1940) took 1262 ms. Trace:
I20260709 13:20:04.493914  4144 rpcz_store.cc:276] 0709 13:20:03.230576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.184771 (+954195us) service_pool.cc:224] Handling call
0709 13:20:04.379454 (+194683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.492954 (+113500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.493268 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.494707  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:04.495381  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:04.164613  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 425050us
W20260709 13:20:04.166558  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 307558us
I20260709 13:20:04.170413  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:04.164618  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:04.386070  4213 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:04.164655  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:04.387398  4214 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:04.387614  4221 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:04.152488  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.585347  4287 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:04.586604  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.587567  4287 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:04.175287  4293 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:04.253715  4294 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:20:04.589831  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.177136  4296 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:04.590922  4293 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:04.592219  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.593060  4296 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:04.594308  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.253208  4288 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:20:04.395613  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:04.595188  4296 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:04.595976  4291 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:04.413491  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 242361us
W20260709 13:20:04.191061  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.165185  4919 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:04.420852  7890 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:04.295579  7898 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:04.605026  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:04.293450  7942 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.424984  8019 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:04.445083  8045 consensus_meta.cc:287] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.007s
I20260709 13:20:04.310971  8053 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.449784  8075 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:04.282251  8078 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.309468  8098 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.610361  4215 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:04.612552  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.474393  8172 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.614324  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.615381  4288 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:04.614845  8172 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:04.616283  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 445863us
I20260709 13:20:04.619010  8172 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:04.474920  8124 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:04.619825  8123 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:04.616217  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:04.621385  8233 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:04.484838  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2195) took 1621 ms. Trace:
I20260709 13:20:04.486194  8231 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:04.620107  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.622527  4138 rpcz_store.cc:276] 0709 13:20:02.862796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.831899 (+969103us) service_pool.cc:224] Handling call
0709 13:20:03.832369 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.481595 (+649226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.484478 (+  2883us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.624423  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.624687  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:04.625397  4287 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:04.626250  4138 raft_consensus.cc:2410] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:04.626466  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:04.626653  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.496753  4144 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
I20260709 13:20:04.483170  4141 rpcz_store.cc:276] 0709 13:20:03.042657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.373053 (+1330396us) service_pool.cc:224] Handling call
0709 13:20:04.374557 (+  1504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.375167 (+   610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.375211 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.375288 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:04.375365 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.375521 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.375801 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.500452  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2204) took 1267 ms. Trace:
I20260709 13:20:04.640750  4140 rpcz_store.cc:276] 0709 13:20:03.231388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.490437 (+1259049us) service_pool.cc:224] Handling call
0709 13:20:04.491062 (+   625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.492254 (+  1192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.498705 (+  6451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.569496  4112 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:04.581111  8294 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:04.589941  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:04.590377  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:04.395329  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 199386us
I20260709 13:20:04.398219  4289 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:04.599861  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:04.592077  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.622042  8233 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.335258  8277 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:04.628167  8256 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:04.673228  8256 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:04.673267  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.674001  8256 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.674193  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.675769  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.629021  8179 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:04.676957  8179 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:04.678503  8179 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:04.680677  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 182641us
I20260709 13:20:04.681191  8096 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.681777  8096 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.682158  8096 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.682318  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.607117  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.650389  4145 raft_consensus.cc:2410] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:20:04.611992  8085 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:04.656472  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.656136  8233 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:04.626735  8078 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:04.652680  8294 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:04.668645  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 68976.5us
I20260709 13:20:04.669494  4140 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:04.670238  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:04.671074  4144 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:20:04.671677  4293 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:04.690673  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.684597  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2206) took 1452 ms. Trace:
I20260709 13:20:04.581225  8300 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:04.604315  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:04.693315  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:04.693399  8235 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:20:04.672098  8253 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:04.693651  4143 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:04.693476  4288 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:04.692443  4291 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:04.631735  8123 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:04.699856  4296 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:04.698786  4138 rpcz_store.cc:276] 0709 13:20:03.231893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.627501 (+1395608us) service_pool.cc:224] Handling call
0709 13:20:04.628181 (+   680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.684030 (+ 55849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.684070 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.684167 (+    97us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:04.684215 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.684302 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.684494 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20489,"raft.queue_time_us":26770}
I20260709 13:20:04.700851  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:04.700851  4928 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
W20260709 13:20:04.703766  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 114204us
I20260709 13:20:04.680701  8302 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.714178  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 51470.8us
I20260709 13:20:04.715333  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:04.715865  8124 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:04.716446  8124 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.706226  8123 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:04.716799  8124 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.718181  8123 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.722888  8213 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:04.723372  8158 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:04.723974  8158 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:04.724390  8158 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:04.727849  8286 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.423s	user 0.001s	sys 0.000s
I20260709 13:20:04.703037  8304 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:04.728820  8304 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:20:04.730041  8287 log.cc:927] Time spent T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.429s	user 0.001s	sys 0.000s
I20260709 13:20:04.732966  4920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 543) took 1025 ms. Trace:
I20260709 13:20:04.733199  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.733960  4293 raft_consensus.cc:2376] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9. Re-sending same reply.
I20260709 13:20:04.734572  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1983) took 1498 ms. Trace:
I20260709 13:20:04.735126  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.735900  4293 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:20:04.736387  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 1978) took 1569 ms. Trace:
I20260709 13:20:04.736879  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.701395  8294 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:04.722874  4186 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:04.740689  4293 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:04.699966  8300 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.740046  4112 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:04.736733  4213 rpcz_store.cc:276] 0709 13:20:03.167217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.455124 (+287907us) service_pool.cc:224] Handling call
0709 13:20:03.455525 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.609368 (+1153843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.736017 (+126649us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540001f254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:04.736260 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138123136}
I20260709 13:20:04.734982  4221 rpcz_store.cc:276] 0709 13:20:03.236222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.421539 (+185317us) service_pool.cc:224] Handling call
0709 13:20:04.734211 (+1312672us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54000244d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:04.734483 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143528320}
I20260709 13:20:04.720078  8123 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.746577  4294 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:20:04.747397  4287 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:20:04.753953  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:04.743520  4185 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:04.760895  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:04.761895  4292 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:04.762938  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:04.765736  8300 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:04.771660  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 411) took 1766 ms. Trace:
W20260709 13:20:04.772540  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 73748.1us
I20260709 13:20:04.772691  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.773528  4287 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:20:04.774502  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.775693  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.775810  8054 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:04.776235  8054 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.776608  8054 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.764154  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.777019  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 406) took 1904 ms. Trace:
I20260709 13:20:04.772171  4147 rpcz_store.cc:276] 0709 13:20:03.005222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.952018 (+946796us) service_pool.cc:224] Handling call
0709 13:20:04.145722 (+193704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.177786 (+ 32064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.177821 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.178366 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.710200 (+531834us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:04.755387 (+ 45187us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.770987 (+ 15600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.771096 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.771157 (+    61us) raft_consensus.cc:1685] finished
0709 13:20:04.771168 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.771463 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46709,"raft.queue_time_us":55201,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":14460,"thread_start_us":458277,"threads_started":1,"wal-append.queue_time_us":416568}
I20260709 13:20:04.787700  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.733503  4920 rpcz_store.cc:276] 0709 13:20:03.707114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.707273 (+   159us) service_pool.cc:224] Handling call
0709 13:20:03.707764 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.712871 (+  5107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.712904 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.727789 (+ 14885us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.140633 (+412844us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:04.238581 (+ 97948us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.688149 (+449568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.692944 (+  4795us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.729110 (+ 36166us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:04.731772 (+  2662us) raft_consensus.cc:1685] finished
0709 13:20:04.731929 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.732212 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4593,"prepare.queue_time_us":187356,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":76788,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":11661,"spinlock_wait_cycles":13783808,"thread_start_us":850570,"threads_started":3,"wal-append.queue_time_us":549907}
I20260709 13:20:04.730054  8304 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:04.801079  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:04.808917  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 139032us
I20260709 13:20:04.809460  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2190) took 1850 ms. Trace:
I20260709 13:20:04.779529  8253 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:04.809863  4921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 544) took 1068 ms. Trace:
I20260709 13:20:04.779965  4139 rpcz_store.cc:276] 0709 13:20:02.868226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.863462 (+995236us) service_pool.cc:224] Handling call
0709 13:20:03.864003 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.374659 (+510656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.374792 (+   133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.376190 (+  1398us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.577319 (+201129us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:04.577359 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.606848 (+ 29489us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.771906 (+165058us) raft_consensus.cc:1685] finished
0709 13:20:04.771948 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.772262 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286596,"raft.queue_time_us":287908,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":423389,"threads_started":2,"wal-append.queue_time_us":313336}
I20260709 13:20:04.798389  4288 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:04.812506  4293 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:04.751809  8302 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:04.810918  4146 rpcz_store.cc:276] 0709 13:20:02.861487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.820680 (+959193us) service_pool.cc:224] Handling call
0709 13:20:03.821101 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.821393 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:04.381738 (+560345us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.657634 (+275896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.661408 (+  3774us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:04.699079 (+ 37671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.701529 (+  2450us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.711811 (+ 10282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30989,"prepare.queue_time_us":507189,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":82261,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":5004,"thread_start_us":426891,"threads_started":2,"wal-append.queue_time_us":210703}
I20260709 13:20:04.824764  8158 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.825825  8096 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.826865  8302 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:04.827482  8158 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:04.828015  8096 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:04.828310  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:04.820664  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:04.830638  8233 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.831818  8317 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:04.813616  4921 rpcz_store.cc:276] 0709 13:20:03.740949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.742809 (+  1860us) service_pool.cc:224] Handling call
0709 13:20:03.749720 (+  6911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.752146 (+  2426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.752177 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.753263 (+  1086us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.128199 (+374936us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:04.128268 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.128433 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.726758 (+598325us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:04.809221 (+ 82463us) raft_consensus.cc:1685] finished
0709 13:20:04.809246 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.809644 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1708,"raft.queue_time_us":1901,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":6960,"spinlock_wait_cycles":13536000,"thread_start_us":348114,"threads_started":1,"wal-append.queue_time_us":481224}
I20260709 13:20:04.833307  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:04.834582  8277 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:04.835176  8277 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:04.835428  8300 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:04.836781  8290 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.828754  4141 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:04.834909  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:04.838696  8277 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.840227  4293 raft_consensus.cc:2393] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:04.841903  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.842368  8053 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.843288  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.840597  8290 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:04.840718  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:04.844585  8290 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.845315  8290 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:04.845347  8278 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.847043  8233 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:04.847725  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:04.848901  8278 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:04.849586  8278 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:04.833264  8317 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:04.864801  8053 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:04.870610  8271 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.012s
I20260709 13:20:04.871348  8271 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:04.858862  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 136245us
I20260709 13:20:04.814865  8213 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:04.843146  8098 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:20:04.874122  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 132375us
W20260709 13:20:04.880688  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 105787us
I20260709 13:20:04.886122  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:04.877369  8098 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.896067  4219 raft_consensus.cc:2410] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:04.891830  4292 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:04.896418  4185 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:04.900480  4293 raft_consensus.cc:2410] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:20:04.895236  8098 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.918257  8318 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.786065  8230 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:20:04.921080  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:04.922866  8318 raft_consensus.cc:2764] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:20:04.935351  8319 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:04.938267  8319 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:04.937213  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:04.951737  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 104183us
I20260709 13:20:04.954301  4288 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:20:04.948593  8319 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:04.966404  8124 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:04.850669  8278 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:04.988602  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 579) took 1330 ms. Trace:
I20260709 13:20:04.989182  4219 rpcz_store.cc:276] 0709 13:20:03.657881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.659021 (+  1140us) service_pool.cc:224] Handling call
0709 13:20:03.857799 (+198778us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbdeee 0000000000375939 00007fee43c311e0 00007fee43cfa0c4 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:20:04.988272 (+1130473us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b5400181854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:04.988517 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294924032}
I20260709 13:20:04.997094  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 2429) took 1131 ms. Trace:
I20260709 13:20:04.997545  4289 rpcz_store.cc:276] 0709 13:20:03.865334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.865890 (+   556us) service_pool.cc:224] Handling call
0709 13:20:04.996817 (+1130927us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400278dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:04.997012 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220185856}
I20260709 13:20:04.999761  4289 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:05.000948  4295 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:20:05.001138  4288 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:05.003965  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 590) took 1087 ms. Trace:
I20260709 13:20:05.010038  4295 rpcz_store.cc:276] 0709 13:20:03.916834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.921830 (+  4996us) service_pool.cc:224] Handling call
0709 13:20:05.000536 (+1078706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.001523 (+   987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.003684 (+  2161us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400278dd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:05.003865 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479702400}
I20260709 13:20:05.011880  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.005419  8319 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:04.958213  8318 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:05.032230  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2442) took 1085 ms. Trace:
I20260709 13:20:05.009491  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2441) took 1062 ms. Trace:
I20260709 13:20:05.012473  8253 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:05.013309  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 394059us
I20260709 13:20:05.018674  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:05.018806  8124 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:05.020241  7942 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.023454  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.025197  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.027518  8256 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.029316  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 2443) took 1082 ms. Trace:
W20260709 13:20:05.029632  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.958499  8317 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:05.057034  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49120.6us
I20260709 13:20:05.033720  4295 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:05.044574  4289 rpcz_store.cc:276] 0709 13:20:03.946565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.998780 (+1052215us) service_pool.cc:224] Handling call
0709 13:20:04.999271 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.000219 (+   948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.009379 (+  9160us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:05.054042  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 79410us
I20260709 13:20:05.035066  4294 rpcz_store.cc:276] 0709 13:20:03.947065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.031228 (+1084163us) service_pool.cc:224] Handling call
0709 13:20:05.031635 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.031883 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.031910 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.031962 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:05.031993 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.032045 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.032148 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:05.012585  8091 consensus_meta.cc:287] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.017s
I20260709 13:20:05.060149  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:05.004524  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45142.6us
I20260709 13:20:05.054986  4292 rpcz_store.cc:276] 0709 13:20:03.947370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.763835 (+816465us) service_pool.cc:224] Handling call
0709 13:20:05.029111 (+265276us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003539d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:05.029243 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254238976}
I20260709 13:20:05.046854  4288 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:05.057437  4296 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
W20260709 13:20:05.060901  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83927.1us
I20260709 13:20:05.063719  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.043504  8318 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:05.066473  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2440) took 1115 ms. Trace:
I20260709 13:20:05.071322  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:05.073427  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:05.074851  4290 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:20:05.076628  8078 consensus_queue.cc:1059] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:05.078310  8078 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:05.078734  8078 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:05.081143  8230 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:05.081724  8230 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.082178  8230 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.088459  8091 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.091825  8091 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:05.093883  8256 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.095249  8319 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.101352  4291 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:05.101876  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:05.102972  4217 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:05.071837  7942 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.066437  4219 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:20:05.109241  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.051530  8290 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.068780  8318 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:05.088093  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.069476  4288 rpcz_store.cc:276] 0709 13:20:03.946296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.984549 (+1038253us) service_pool.cc:224] Handling call
0709 13:20:05.000919 (+ 16370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.061610 (+ 60691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.061870 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:05.032323  8054 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.118436  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.124049  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.112524  8277 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:20:05.096115  4143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 416) took 2052 ms (client timeout 2224 ms). Trace:
I20260709 13:20:05.023357  8294 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.127717  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 1942) took 1769 ms. Trace:
I20260709 13:20:05.128266  4141 rpcz_store.cc:276] 0709 13:20:03.358661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.657438 (+1298777us) service_pool.cc:224] Handling call
0709 13:20:04.710585 (+ 53147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.838296 (+127711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.123221 (+284925us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400068954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:05.127635 (+  4414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271003392}
W20260709 13:20:05.126400  4143 rpcz_store.cc:269] 0709 13:20:03.043836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.687292 (+643456us) service_pool.cc:224] Handling call
0709 13:20:05.095708 (+1408416us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b5400265554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:05.096011 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2205950720}
I20260709 13:20:05.138616  4290 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:05.139004  4289 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:05.032807  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eff857a690104e20896367b8755773e0"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:05.145185  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.145995  4290 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:20:05.148703  4292 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:20:05.150100  4295 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:20:05.152041  8290 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:05.153501  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:05.155753  4218 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:05.110277  8256 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.156461  8124 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:05.156858  8256 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.157758  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.158608  4287 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:20:05.159603  8256 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:05.160328  8315 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 13:20:05.156026  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:05.163160  4221 raft_consensus.cc:606] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:05.164006  4221 raft_consensus.cc:614] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:05.166090  4290 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:05.167182  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.168645  4217 raft_consensus.cc:2410] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:05.171257  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:05.172580  8322 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:20:05.079842  8078 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.143872  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:05.176678  4214 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:05.178030  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:05.130645  8277 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:04.984299  8213 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.180469  4296 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.181245  7942 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.187888  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:05.188521  7942 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.130954  8253 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.189518  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:05.191653  4213 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:20:05.188534  4142 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:05.193107  8325 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:20:05.194516  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 409) took 2255 ms. Trace:
I20260709 13:20:05.130468  8271 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:20:05.194937  4142 rpcz_store.cc:276] 0709 13:20:02.938910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.905503 (+966593us) service_pool.cc:224] Handling call
0709 13:20:03.905826 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.193292 (+1287466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.194140 (+   848us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400265a54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:05.194425 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2756552576}
I20260709 13:20:05.195513  8271 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:05.195983  8271 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:05.185953  8277 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:05.199504  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.200255  4214 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:05.205433  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49529.6us
I20260709 13:20:05.191829  8253 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:05.221107  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:05.204849  7942 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.228785  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:05.214076  8235 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:20:05.233174  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:05.233812  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.234589  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 61285.7us
I20260709 13:20:05.236158  4216 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:05.235857  4215 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:05.243889  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:05.239241  4145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2172) took 2777 ms (client timeout 1965 ms). Trace:
I20260709 13:20:05.250826  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:05.252902  4145 rpcz_store.cc:269] 0709 13:20:02.450226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.451339 (+  1113us) service_pool.cc:224] Handling call
0709 13:20:05.215022 (+2763683us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5400287654. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:05.227831 (+ 12809us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4646336896}
I20260709 13:20:05.256721  4213 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:20:05.197265  8271 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.269385  4217 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:05.269107  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2438) took 1323 ms. Trace:
I20260709 13:20:05.251119  8304 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:05.280663  4219 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:05.245980  8302 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:20:05.287155  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.301767  8043 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:20:05.302780  8208 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:20:05.309424  8298 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:05.310284  8298 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.310915  8298 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:05.282404  8304 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.321326  8294 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.352665  8271 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.328202  8304 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.360765  8098 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.367125  8230 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.370309  8098 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:05.335763  8318 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.395679  8230 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.415388  8318 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.429683  8298 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.433686  8277 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.436671  8277 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:05.439685  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:05.451833  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:05.452764  4921 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:05.453590  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2220) took 1063 ms. Trace:
I20260709 13:20:05.452792  4920 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:05.455283  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:05.454016  4287 rpcz_store.cc:276] 0709 13:20:04.390400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.159348 (+768948us) service_pool.cc:224] Handling call
0709 13:20:05.159698 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.160109 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:05.267420 (+107311us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.453184 (+185764us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.453248 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:05.453296 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.453364 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.453495 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12001,"prepare.queue_time_us":90465,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":4130,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":144,"thread_start_us":211850,"threads_started":2,"wal-append.queue_time_us":114507}
I20260709 13:20:05.459554  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.460325  4287 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:05.454356  4893 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.801s (SENT)
I20260709 13:20:05.464150  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.448990  8304 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.475462  8342 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:05.476631  8342 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.477419  8342 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.473834  8298 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.486160  8298 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:05.492198  4287 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:05.492673  8304 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.513720  8342 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.519227  8342 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:05.538555  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:05.539970  8230 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:05.540570  8230 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.541020  8230 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.543871  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2223) took 1142 ms. Trace:
I20260709 13:20:05.544418  4290 rpcz_store.cc:276] 0709 13:20:04.401241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.167077 (+765836us) service_pool.cc:224] Handling call
0709 13:20:05.167411 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.173017 (+  5606us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:05.274134 (+101117us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.543382 (+269248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.543451 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:05.543536 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.543625 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.543795 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42954,"prepare.queue_time_us":116957,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":161,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"thread_start_us":46965,"threads_started":2,"wal-append.queue_time_us":19013}
I20260709 13:20:05.552951  8226 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:05.554633  8294 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:05.555111  8294 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:05.557075  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2240) took 1148 ms. Trace:
I20260709 13:20:05.557516  4290 rpcz_store.cc:276] 0709 13:20:04.408853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.551853 (+1143000us) service_pool.cc:224] Handling call
0709 13:20:05.552617 (+   764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.553098 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.553135 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.553177 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:05.553222 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.553494 (+   272us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.556962 (+  3468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:05.566672  4290 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:20:05.567986  4290 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:05.569254  4290 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:05.574659  4290 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:20:05.581067  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.583452  4185 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:05.583503  4296 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:05.584002  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:05.589650  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:05.590039  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:05.590837  4925 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:05.590965  4221 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:05.589650  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.593945  4220 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:05.596889  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.605813  4221 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.611313  8043 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:05.611965  8043 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.612406  8043 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:05.604775  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2225) took 1202 ms. Trace:
I20260709 13:20:05.614835  4291 rpcz_store.cc:276] 0709 13:20:04.402112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.236873 (+834761us) service_pool.cc:224] Handling call
0709 13:20:05.265776 (+ 28903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.290749 (+ 24973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.290791 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.537358 (+246567us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.575971 (+ 38613us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:05.578483 (+  2512us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.579154 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.579243 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.604322 (+ 25079us) raft_consensus.cc:1685] finished
0709 13:20:05.604388 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.604661 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":59,"raft.queue_time_us":5929,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":20583,"thread_start_us":37932,"threads_started":1,"wal-append.queue_time_us":37591}
I20260709 13:20:05.634006  4215 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:05.637115  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.651302  4290 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.651538  8091 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:05.652861  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.654343  4215 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.658869  8123 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:05.649024  8256 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:05.659587  8123 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:05.660105  8123 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.663156  4290 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:05.630162  4291 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:05.665936  4291 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:05.673316  8319 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:05.674093  8319 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:05.674464  4291 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.675400  8319 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.663411  4294 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:05.677707  8319 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:05.680116  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.684240  4925 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:05.687556  8043 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.678205  4291 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.676419  4220 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:05.698372  4893 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:05.701339  8342 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:05.702178  8342 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:05.703552  8342 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.689749  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.715582  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.720255  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:05.725129  4221 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:20:05.727532  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:05.729004  8277 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:20:05.729038  8341 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:05.729985  8341 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:05.731072  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.731230  8341 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.733158  8317 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.733788  8317 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.736274  8317 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:05.743613  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.737140  8277 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:05.749653  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.750327  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.751225  4213 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.751328  8277 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:20:05.753434  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.708182  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.754647  4218 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.754642  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.755777  8277 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:20:05.757576  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.758685  8277 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:05.759718  8317 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:05.760774  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:20:05.761848  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.762741  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:05.762954  8277 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:05.765826  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.766216  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:05.765830  8256 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:05.767185  8256 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.767627  8256 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.687829  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.767338  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:05.774562  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.775444  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.776103  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:05.776909  4296 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:05.777199  8123 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.778426  4296 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:05.779325  4289 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:05.772639  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:05.779855  8277 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:20:05.780918  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.783150  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.776150  4290 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:20:05.785010  8054 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.786324  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.787175  4217 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:05.788326  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.788630  8277 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:05.779383  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.789654  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:05.789553  8054 consensus_queue.cc:1059] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:05.790390  4289 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:20:05.791086  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.791380  8349 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:05.791635  8124 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:05.792044  8349 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:05.793313  4296 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:05.793632  8124 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:05.794263  8124 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:05.795423  8124 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.796387  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:05.797910  8213 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:05.799070  8213 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:05.799409  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:05.799916  8213 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:05.801649  8043 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.805154  8226 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:05.821031  8208 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:20:05.814679  4292 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:05.809263  8253 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:05.798002  8277 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:05.809836  8213 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:05.832732  4213 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:05.834107  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:05.810261  4288 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:05.830766  8208 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:05.835389  8208 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:05.836477  8208 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.556406  8294 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.837828  8208 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.838343  8294 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.811064  8256 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.845729  4213 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:05.846035  8256 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:05.850764  4217 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:05.855882  4220 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:05.793458  8349 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:05.870373  8349 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:05.875806  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.876823  8253 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.877692  8253 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.882690  8253 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:05.273933  4293 rpcz_store.cc:276] 0709 13:20:03.945688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.906882 (+961194us) service_pool.cc:224] Handling call
0709 13:20:04.956514 (+ 49632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.975380 (+ 18866us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:05.111673 (+136293us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.267998 (+156325us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.268152 (+   154us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:05.268236 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.268380 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.268606 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46674,"prepare.queue_time_us":193854,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":12784,"thread_start_us":238338,"threads_started":2}
I20260709 13:20:05.812956  4289 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:05.826593  4218 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
W20260709 13:20:05.807991  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.833511  8213 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.905285  4221 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:05.810058  4290 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:05.868160  4287 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:20:05.897655  4213 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:05.902148  4218 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:05.906669  4287 pending_rounds.cc:85] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:20:05.906987  4287 pending_rounds.cc:107] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:20:05.907316  4287 raft_consensus.cc:2889] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:05.911337  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:05.912644  4112 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:05.913853  4112 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:05.915244  8234 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:05.917364  8234 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:05.918110  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:05.927057  8091 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:05.919153  8234 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:05.888180  4219 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:05.917361  8043 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:05.929020  8226 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:05.954285  4215 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
I20260709 13:20:05.956123  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:05.959856  4291 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:20:05.960630  4291 pending_rounds.cc:85] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 4
I20260709 13:20:05.960997  4291 pending_rounds.cc:107] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:20:05.962025  4925 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:05.961390  4291 raft_consensus.cc:2889] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:05.997021  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:05.953589  8043 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:05.963093  8319 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:05.964213  8091 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:05.956702  8226 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:05.947851  8294 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:20:05.968142  8298 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:06.011463  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 213251us
W20260709 13:20:06.016870  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.010198  8091 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:06.019515  8043 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.028776  7898 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:06.030961  8123 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:06.012240  8360 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:20:06.032563  8360 consensus_queue.cc:1243] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:06.032444  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:06.033289  4920 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.033715  8360 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:06.034541  8360 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:06.035544  8360 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.037241  8360 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.038640  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:06.040688  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2217) took 1651 ms. Trace:
I20260709 13:20:06.041170  4292 rpcz_store.cc:276] 0709 13:20:04.389092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.150060 (+760968us) service_pool.cc:224] Handling call
0709 13:20:05.814393 (+664333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.831704 (+ 17311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.040419 (+208715us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400434750. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:06.040613 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526842624}
I20260709 13:20:06.046018  7898 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:06.047359  7898 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:06.049525  8019 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:06.050197  8019 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:06.013571  8319 raft_consensus.cc:697] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:06.051849  8319 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.025345  8226 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.061322  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:06.024062  8349 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:06.015762  8298 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 15 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:06.083335  4920 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:06.072492  8354 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:06.085223  8354 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:06.084671  8091 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.084995  8298 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:06.086637  8091 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:06.086436  8354 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:06.088728  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 829497us
I20260709 13:20:06.091463  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:06.048702  7898 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.106184  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:06.107743  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
W20260709 13:20:06.109118  4295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.019s	sys 0.030s
W20260709 13:20:06.109553  4295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.020s	sys 0.030s
I20260709 13:20:06.110333  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2236) took 1703 ms. Trace:
I20260709 13:20:06.110867  4287 rpcz_store.cc:276] 0709 13:20:04.407269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.493555 (+1086286us) service_pool.cc:224] Handling call
0709 13:20:05.867535 (+373980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.907822 (+ 40287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.110101 (+202279us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54002783d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:06.110262 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859027200}
I20260709 13:20:06.110515  8256 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:06.113510  4217 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:06.115972  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.110364  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2219) took 1720 ms. Trace:
I20260709 13:20:06.127892  8344 consensus_queue.cc:1059] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:06.097157  8349 raft_consensus.cc:697] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:06.120620  4295 rpcz_store.cc:276] 0709 13:20:04.390035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.150982 (+760947us) service_pool.cc:224] Handling call
0709 13:20:05.151354 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.151918 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.151950 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.183052 (+ 31102us) log.cc:844] Serialized 26 byte log entry
0709 13:20:06.110000 (+926948us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:06.110052 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.110141 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.110192 (+    51us) raft_consensus.cc:1685] finished
0709 13:20:06.110203 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.110310 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":254,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":873254,"threads_started":1,"wal-append.queue_time_us":192009}
W20260709 13:20:06.142567  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.130244  8344 raft_consensus.cc:3055] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:06.143682  8344 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:06.143904  8019 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:06.140208  8123 raft_consensus.cc:2764] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:20:06.145139  8344 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:06.147125  8344 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:06.147027  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:06.146729  8349 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:06.151408  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 43746.2us
I20260709 13:20:06.151141  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:06.158195  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.164543  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.168929  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:06.170643  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.152444  8341 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:06.168318  8123 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:06.169056  8019 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.186090  4217 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:06.186324  8098 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:06.186877  8085 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.187388  8085 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.188020  8363 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.189057  8019 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.186151  8213 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:20:06.191637  8019 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:06.174764  8318 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:06.200821  8341 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:06.209760  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.180778  8123 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.217906  8123 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:06.221772  8078 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:06.232870  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57084.6us
I20260709 13:20:06.234551  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:06.237768  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:06.239367  8124 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:20:06.241063  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55513.1us
I20260709 13:20:06.241997  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:06.243016  4217 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:20:06.242457  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:06.243456  8124 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:06.244203  8318 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:06.245029  8124 raft_consensus.cc:697] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:06.245326  8298 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.246830  8341 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:06.246270  8124 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:06.251724  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:06.252858  4217 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:06.275971  4187 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:06.253075  7898 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:06.296799  8085 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:06.297925  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:06.289857  8371 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:20:06.312958  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:06.323673  8302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.006s	sys 0.005s
I20260709 13:20:06.316372  7898 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:06.329979  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:06.326686  4289 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:06.328529  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:06.326404  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.333621  4287 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.317155  8124 raft_consensus.cc:2764] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:20:06.329087  8318 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.337980  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.337924  8318 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:06.343231  4145 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:06.338451  4143 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:20:06.329306  8302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.006s	sys 0.006s
I20260709 13:20:06.351073  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2226) took 1152 ms. Trace:
I20260709 13:20:06.351768  4142 rpcz_store.cc:276] 0709 13:20:05.198935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.317184 (+1118249us) service_pool.cc:224] Handling call
0709 13:20:06.350955 (+ 33771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:06.345098  4143 pending_rounds.cc:85] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 4
I20260709 13:20:06.351269  8371 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.361287  8371 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.356493  4143 pending_rounds.cc:107] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:20:06.364872  4143 raft_consensus.cc:2889] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.358467  8123 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.359246  8211 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:06.331705  8213 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.365808  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.370827  4145 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:06.384637  4287 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:06.394270  4293 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:06.394332  4294 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:06.396541  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:06.359272  8235 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:06.401666  8235 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:06.396245  4294 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:06.415122  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.407526  4294 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:06.381517  8371 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:06.420426  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.422353  8302 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.390233  8213 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.413527  8344 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:20:06.428258  8213 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:06.428968  4141 raft_consensus.cc:2410] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:20:06.432786  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:06.433113  8085 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:06.434638  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.434942  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:06.435462  4140 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:06.432133  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.430943  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.437578  4146 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.438345  4144 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:20:06.438800  4144 pending_rounds.cc:85] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 8
I20260709 13:20:06.439055  4144 pending_rounds.cc:107] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:20:06.439294  4144 raft_consensus.cc:2889] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.431741  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.431360  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.418360  4294 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:06.442121  4147 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:06.444751  4138 raft_consensus.cc:2410] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:20:06.446354  4138 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:06.420167  8342 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:06.430528  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.463701  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.451936  8123 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:06.493172  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:06.497141  4144 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:06.465356  7898 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:06.527840  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 121951us
I20260709 13:20:06.558442  4144 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:06.560102  4143 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:06.562620  4145 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
W20260709 13:20:06.567603  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 236560us
W20260709 13:20:06.573941  4317 debug-util.cc:398] Leaking SignalData structure 0x7b0800050480 after lost signal to thread 3024
I20260709 13:20:06.576781  7898 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:06.580204  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.614159  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.637245  4294 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:20:06.638242  4294 pending_rounds.cc:85] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 8
I20260709 13:20:06.638612  4294 pending_rounds.cc:107] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:20:06.638993  4294 raft_consensus.cc:2889] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:06.640517  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 111016us
I20260709 13:20:06.645026  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:06.645895  4287 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:06.738090  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.740100  4219 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:20:06.742686  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.738306  8387 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:20:06.749681  4147 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
W20260709 13:20:06.664208  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.502s (SENT) [suppressed 21 similar messages]
W20260709 13:20:06.779186  8380 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
W20260709 13:20:06.785948  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.786176  4140 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
W20260709 13:20:06.787995  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.792172  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.792255  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:06.816181  4145 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:06.789480  4142 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
W20260709 13:20:06.822048  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.830804  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 166636us
I20260709 13:20:06.833259  8271 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:06.834084  8271 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.838948  4221 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:06.813167  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:06.863922  4287 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:06.775326  8290 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:06.906028  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:06.782063  8344 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:06.795051  8384 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.792609  8078 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.940675  8078 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:06.930856  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:06.930850  8342 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.942824  4222 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:06.943362  8078 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:06.944614  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:06.928124  8271 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:06.933370  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:06.937747  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:06.939358  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:06.958909  4215 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:06.930624  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 44355.7us
W20260709 13:20:06.955379  4214 consensus_meta.cc:287] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.754s	user 0.013s	sys 0.013s
I20260709 13:20:06.940945  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:06.963349  4214 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:06.961990  4221 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
W20260709 13:20:06.963953  4214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2525) took 1766 ms (client timeout 1857 ms). Trace:
I20260709 13:20:06.964854  4217 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:06.964331  4214 rpcz_store.cc:269] 0709 13:20:05.197753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.199148 (+  1395us) service_pool.cc:224] Handling call
0709 13:20:06.963866 (+1764718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:06.989570  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:06.993834  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:06.994925  4214 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:20:06.995491  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:06.963155  8344 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:06.996307  4215 raft_consensus.cc:2368] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10.
I20260709 13:20:06.996883  4214 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:06.998277  8344 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:06.917793  8290 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.006361  4219 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:07.007447  8290 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:06.969960  8271 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:07.009979  4146 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.003s
I20260709 13:20:07.010217  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:07.015647  4217 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:07.016402  4146 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:06.965036  8208 raft_consensus.cc:2764] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:20:07.026444  4219 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:07.043272  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:07.052024  4219 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:06.966317  8384 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:07.054041  8290 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.066586  4220 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:07.018217  8271 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.074800  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:07.077653  4216 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:07.081143  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:07.080940  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:07.083981  4214 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:07.050149  8390 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:20:07.071834  8290 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:07.119572  8335 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.789s	user 0.008s	sys 0.011s
I20260709 13:20:07.122100  8278 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:07.125057  8381 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:20:07.127324  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:07.137363  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:07.138456  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 58456us
I20260709 13:20:07.140807  4219 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:07.141418  4222 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:07.135459  8230 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.593s	user 0.015s	sys 0.015s
I20260709 13:20:07.143343  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:07.151372  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.145738  8054 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:07.155781  8054 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:07.156985  8054 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:07.158524  8054 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.152662  4217 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
W20260709 13:20:07.170064  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.170782  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:07.137327  8399 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:07.178169  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:07.180166  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.173243  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:07.182135  4220 raft_consensus.cc:2376] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14. Re-sending same reply.
I20260709 13:20:07.176875  8384 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:07.198027  4222 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:07.199258  4893 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.626s (SENT)
I20260709 13:20:07.203639  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:07.207247  4214 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:07.207530  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:07.136168  8278 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.211876  8290 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.144472  8230 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:07.213096  4111 connection.cc:256] RPC call timeout handler was delayed by -2.1111049530002219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 13:20:07.220937  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.228610  4220 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:07.207508  8234 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 13:20:07.244207  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.233242  8392 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.164s	user 0.001s	sys 0.001s
W20260709 13:20:07.279075  4111 connection.cc:256] RPC call timeout handler was delayed by -1.9824049530000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:20:07.279879  4111 connection.cc:256] RPC call timeout handler was delayed by -1.9239049530001466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 13:20:07.282459  8332 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.939s	user 0.014s	sys 0.019s
W20260709 13:20:07.286506  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.287475  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.288527  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.288677  8385 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.390s	user 0.000s	sys 0.003s
I20260709 13:20:07.291141  8362 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.292618  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:07.293195  4111 connection.cc:256] RPC call timeout handler was delayed by -1.8732185110000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2858s for a response
W20260709 13:20:07.293838  4111 connection.cc:256] RPC call timeout handler was delayed by -1.8678185109999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2864s for a response
I20260709 13:20:07.294435  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:20:07.294375  4111 connection.cc:256] RPC call timeout handler was delayed by -1.7772049530001368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 13:20:07.296300  4111 connection.cc:256] RPC call timeout handler was delayed by -1.7745049530001324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:20:07.298763  4111 connection.cc:256] RPC call timeout handler was delayed by -1.6242049530001168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2348s for a response
I20260709 13:20:07.230929  8400 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
W20260709 13:20:07.308722  4111 connection.cc:256] RPC call timeout handler was delayed by -1.622453969000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:20:07.310213  4111 connection.cc:256] RPC call timeout handler was delayed by -1.592753969000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260709 13:20:07.310580  4111 connection.cc:256] RPC call timeout handler was delayed by -1.5336545049999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23950000000000002s for a response
W20260709 13:20:07.310963  4111 connection.cc:256] RPC call timeout handler was delayed by -1.476318511000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3299s for a response
W20260709 13:20:07.311283  4111 connection.cc:256] RPC call timeout handler was delayed by -1.1751049530000728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2847s for a response
I20260709 13:20:07.314229  8290 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:20:07.325310  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:07.326601  4139 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:07.326694  8400 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:07.327245  4925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42928 (request call id 304) took 1445 ms. Trace:
I20260709 13:20:07.327852  4925 rpcz_store.cc:276] 0709 13:20:05.881464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.883889 (+  2425us) service_pool.cc:224] Handling call
0709 13:20:05.884748 (+   859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.962646 (+ 77898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.326932 (+1364286us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b54006e0354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:07.327171 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177083264}
I20260709 13:20:07.205871  8399 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:07.327306  8400 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:07.301789  8230 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:07.304507  8271 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.312204  7942 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.306288  8278 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.320235  8404 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:07.339685  8019 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:07.299819  8235 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:07.352214  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 178284us
I20260709 13:20:07.357080  4146 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:07.359184  4146 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:07.366110  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:07.366882  4142 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.366806  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:07.367802  4138 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.356276  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:07.371951  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 150412us
I20260709 13:20:07.376745  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.374755  4261 leader_election.cc:400] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10.
I20260709 13:20:07.378253  4261 leader_election.cc:403] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:20:07.379925  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.380750  4144 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:20:07.375053  4146 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:07.354187  8019 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:07.385661  8410 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:07.386368  8410 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.386603  8019 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:07.388590  8364 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.184s	user 0.007s	sys 0.008s
I20260709 13:20:07.393520  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:07.292634  8362 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:07.381784  4187 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.976s (SENT)
I20260709 13:20:07.383507  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:07.365106  8404 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.372651  8271 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:20:07.345930  7942 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.399598  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.401934  4928 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:07.407742  4145 raft_consensus.cc:2368] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:20:07.403288  4138 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
I20260709 13:20:07.422127  4143 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:07.410034  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:07.429096  4139 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.430487  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.384936  8278 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:07.478978  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 102653us
I20260709 13:20:07.365998  8399 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:07.483038  8417 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.486138  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:07.489413  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.493681  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 111784us
I20260709 13:20:07.487988  8019 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:07.497567  4138 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:07.427227  8054 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:07.342361  8400 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.499572  8417 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.501637  4145 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:20:07.502581  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:07.509701  4289 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:07.496058  4110 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:07.503324  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.511224  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:07.484172  8354 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:07.514914  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:07.515167  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:07.515702  4288 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:20:07.516011  4296 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:07.512926  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:07.517073  4289 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:07.517130  4142 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:07.511231  4144 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:07.514279  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:07.518370  4294 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:07.518591  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.519223  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:07.519248  4144 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:07.520331  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:07.520640  4144 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:07.520992  4294 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:20:07.524901  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.525633  4142 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:07.530184  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:07.531371  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:07.530367  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:07.535254  4289 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:07.544011  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:07.545502  4291 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:07.545868  4294 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:07.546051  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.546722  4145 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:07.544241  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:07.498999  8399 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:20:07.486027  8319 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:07.542588  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.523917  8400 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.553548  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:07.554910  4289 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:07.533306  8360 raft_consensus.cc:2764] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:20:07.571894  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.573549  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.575942  4142 raft_consensus.cc:2368] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:20:07.578773  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:07.567677  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:07.579577  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62030.2us
I20260709 13:20:07.585980  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:07.586392  4294 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:07.580848  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.580291  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.596951  4142 raft_consensus.cc:2368] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11.
I20260709 13:20:07.599572  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.600554  4145 raft_consensus.cc:2368] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9.
I20260709 13:20:07.610580  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:07.614013  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.615290  4145 raft_consensus.cc:2410] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:20:07.617545  4289 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:07.618137  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.587481  8410 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.620316  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.602149  4919 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:07.627383  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.628646  4142 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:20:07.620239  4144 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:07.623838  4289 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:07.642076  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:07.644021  4142 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:07.622053  8413 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:20:07.646590  4138 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:07.647416  4144 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:07.652050  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.655064  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:07.655874  4289 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:07.630060  8425 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:07.639619  8399 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:07.616915  8382 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.220s
I20260709 13:20:07.664620  8421 consensus_queue.cc:1059] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:20:07.677446  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.224s (SENT)
I20260709 13:20:07.678283  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:07.631942  8404 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.676445  4186 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:07.680624  8085 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:07.685006  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:07.680876  8421 raft_consensus.cc:3055] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:07.642438  8410 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:20:07.673528  8415 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260709 13:20:07.671413  8399 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:07.688444  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:07.686400  8354 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:07.712980  4139 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:07.695928  8054 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:07.685460  8362 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:07.688558  8421 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:07.721602  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 140276us
I20260709 13:20:07.718215  7898 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:20:07.724231  8428 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:07.724298  8054 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.724916  8428 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.725790  7898 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:07.725203  8054 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:07.726469  7898 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:07.727766  7898 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.728699  8054 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:07.732131  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:07.717319  8404 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:07.714828  8211 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:07.685690  8425 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:07.699690  8417 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.725343  8428 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:07.745298  8098 consensus_queue.cc:1059] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:07.747634  8404 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:07.774534  8429 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:07.668851  8412 consensus_queue.cc:1175] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34e6205f3c1d434193126fef20d73800" responder_term: 12 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:20:07.787285  8423 log.cc:927] Time spent T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:07.787748  8427 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:07.790321  8432 raft_consensus.cc:3055] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:20:07.793260  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 77034.2us
W20260709 13:20:07.826092  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.772836  8399 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.826931  8417 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:07.752876  8211 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:07.828639  8354 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.892495  8417 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.894089  8211 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.792919  8429 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.894937  8429 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.895193  8417 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.902525  4921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 521) took 1867 ms. Trace:
I20260709 13:20:07.906067  8404 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.906641  8290 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:07.908596  8415 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:07.857307  8318 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:07.910583  8399 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.886528  8425 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:07.901449  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 322790us
I20260709 13:20:07.903906  8278 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10.
I20260709 13:20:07.904640  4921 rpcz_store.cc:276] 0709 13:20:06.034765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.197236 (+162471us) service_pool.cc:224] Handling call
0709 13:20:06.197782 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:06.203200 (+  5418us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:06.262480 (+ 59280us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.262871 (+   391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:06.262956 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:06.263056 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.901416 (+1638360us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b180018d960. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbc32a6 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419
0709 13:20:07.902220 (+   804us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b5400156154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:07.902274 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.902446 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108348,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":147,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":12502,"spinlock_wait_cycles":18118144,"thread_start_us":58644,"threads_started":1}
I20260709 13:20:07.863878  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:07.919157  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.923619  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59858.5us
I20260709 13:20:07.933377  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:07.935042  4317 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2fa0 after lost signal to thread 4079
I20260709 13:20:07.824077  8432 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:07.940760  4317 debug-util.cc:398] Leaking SignalData structure 0x7b0800148be0 after lost signal to thread 4171
I20260709 13:20:07.907423  8290 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:07.929207  8318 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:07.924094  8271 consensus_queue.cc:1243] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:07.955181  4288 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:07.945333  8434 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:20:07.961068  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:07.962555  4289 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:07.962756  8290 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:07.991974  8164 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:20:08.006422  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.008426  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 92225.7us
I20260709 13:20:07.981771  8318 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.965276  8391 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:07.969769  8230 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.971539  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.050143  4921 raft_consensus.cc:2410] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:07.971359  8054 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:07.988996  4289 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:07.965085  4317 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5f00 after lost signal to thread 4246
W20260709 13:20:08.052314  4317 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4420 after lost signal to thread 4247
W20260709 13:20:08.055186  4317 debug-util.cc:398] Leaking SignalData structure 0x7b08003acd60 after lost signal to thread 4320
W20260709 13:20:08.055678  4317 debug-util.cc:398] Leaking SignalData structure 0x7b0800330720 after lost signal to thread 4321
W20260709 13:20:08.058014  4317 debug-util.cc:398] Leaking SignalData structure 0x7b080038ebc0 after lost signal to thread 4953
W20260709 13:20:08.058499  4317 debug-util.cc:398] Leaking SignalData structure 0x7b080035fce0 after lost signal to thread 4954
W20260709 13:20:08.065423  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.069003  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:07.981194  8384 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 13:20:08.070310  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 149639us
I20260709 13:20:08.004190  8434 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.052011  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 138409us
I20260709 13:20:08.073381  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:08.076470  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.046367  8318 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.092196  4289 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:08.129962  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51661.9us
I20260709 13:20:08.144594  4289 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:08.068662  8382 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.128865  8405 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:20:08.164506  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 110424us
I20260709 13:20:08.141546  8164 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:08.142961  8354 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.053546  8391 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.064883  8230 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.124935  8432 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.163918  7942 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.125207  8434 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:08.210659  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 137474us
W20260709 13:20:08.250087  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 118524us
I20260709 13:20:08.253028  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:08.166450  8382 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:08.258031  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 67571.9us
I20260709 13:20:08.231819  7942 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.265105  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:08.271188  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:08.272670  8164 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:08.273166  8164 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:08.273595  8164 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.265878  4294 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:08.208451  8085 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:20:08.253013  4289 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:20:08.284912  4294 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:20:08.284686  4289 pending_rounds.cc:85] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 3
I20260709 13:20:08.286966  4289 pending_rounds.cc:107] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:20:08.287338  4289 raft_consensus.cc:2889] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:08.278591  7942 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.329521  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.349143  4921 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
W20260709 13:20:08.345989  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.351547  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.371752  4919 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:08.337893  8400 consensus_meta.cc:287] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.768s	user 0.013s	sys 0.003s
W20260709 13:20:08.337105  8428 consensus_meta.cc:287] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 13:20:08.339942  8460 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:20:08.394142  8428 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.295630  8354 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:08.293931  8429 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.399461  8429 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.390858  8363 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:20:08.375511  8123 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.400874  8363 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:08.400727  8123 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.401835  8404 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.401584  8363 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.403232  8123 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.394164  8391 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.332665  8434 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.404672  4292 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:08.404981  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.393095  7942 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:08.405694  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47619.9us
I20260709 13:20:08.406152  7942 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.406721  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:08.045657  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:08.408162  4111 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:08.421780  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 168855us
I20260709 13:20:08.423555  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:08.426780  8439 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:20:08.426498  8448 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:20:08.418812  8455 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:08.329648  8379 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:20:08.428865  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:08.429198  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.432588  8445 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:20:08.425139  8230 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.433326  8434 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:08.445035  4187 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:08.460043  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:08.461424  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:08.461995  4289 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.463435  4294 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:08.436303  8458 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:08.473805  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:08.474623  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:08.406733  7942 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.439451  8382 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.483369  4289 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:08.484786  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:08.442420  8460 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:20:08.491847  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.493085  4292 raft_consensus.cc:2410] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:08.471150  8400 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:08.506335  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:08.508390  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 393243us
I20260709 13:20:08.454485  8123 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:20:08.510667  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.453960  8391 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:20:08.514189  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.513954  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:08.515799  4292 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:08.503086  8363 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.509078  8458 raft_consensus.cc:2764] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:20:08.509244  8428 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:08.517118  8450 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:20:08.533871  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.526481  8469 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:08.537896  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:08.539219  8462 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.540614  4294 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:20:08.515105  8400 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.546200  8400 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.553368  8164 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:08.557947  8399 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.003s
I20260709 13:20:08.562628  8318 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.564564  8469 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:08.565937  8469 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.579496  8421 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.581130  8421 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.585170  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.587445  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.599608  8470 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.603675  8318 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.606155  8437 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:08.607728  8391 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:08.614189  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.614869  8391 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.609440  4185 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:08.616001  7942 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.608474  8460 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:08.612864  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.619524  4216 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:08.613586  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:08.615329  4214 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:08.610097  8354 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.621714  4220 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:08.621169  8354 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.617178  8391 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.618036  8428 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:08.612607  8429 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:08.619603  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.620455  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.645392  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.650666  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:08.652788  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.653836  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.611564  8467 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:20:08.659706  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43523.6us
I20260709 13:20:08.664105  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:08.676826  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.681351  4292 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:08.663086  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:08.688958  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.624964  8468 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:08.689965  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:08.631300  8123 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:20:08.712267  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.712579  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2253) took 1197 ms. Trace:
I20260709 13:20:08.712019  8417 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.712998  4288 rpcz_store.cc:276] 0709 13:20:07.515133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.530120 (+ 14987us) service_pool.cc:224] Handling call
0709 13:20:08.712291 (+1182171us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54002594d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:08.712509 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905641216}
I20260709 13:20:08.713312  8417 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:08.715624  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52659.8us
I20260709 13:20:08.715906  8467 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:08.716315  8417 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:08.716566  8467 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:08.717725  8467 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.681092  8354 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.703436  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:08.726620  4186 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:08.693662  8164 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.693377  8468 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.645079  8460 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.743297  8460 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.692113  8360 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:20:08.745198  8234 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.746030  8234 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:08.746657  8234 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.750976  8213 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:08.751864  8213 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:08.752453  8434 consensus_queue.cc:1175] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b81584b21ed144698954548303f1e507" responder_term: 10 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:08.715718  8428 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:20:08.752552  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49232.3us
I20260709 13:20:08.755141  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:08.755745  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:08.756592  8470 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.757015  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:08.757186  8470 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.757745  4287 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.758476  4146 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.759760  8470 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.761293  4293 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:20:08.762431  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:08.760560  8294 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:08.756608  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:08.775341  4146 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:08.776517  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 426) took 1430 ms. Trace:
I20260709 13:20:08.777884  4146 rpcz_store.cc:276] 0709 13:20:07.346486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.346662 (+   176us) service_pool.cc:224] Handling call
0709 13:20:07.347063 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:08.603742 (+1256679us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b58007370d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec3e0aa 00007fee3ecc0447 00007fee3ecd8fe7 00007fee3ecda7de 00007fee3ece4b49 00007fee3ece5416 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4
0709 13:20:08.757736 (+153994us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b58007373d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec3e0aa 00007fee3ecc0447 00007fee3ecd8fe7 00007fee3ecda7de 00007fee3ece4b49 00007fee3ece5416 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4
0709 13:20:08.775924 (+ 18188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.776444 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75120768}
I20260709 13:20:08.785612  4287 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:08.789701  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:08.790164  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:08.791709  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 109189us
I20260709 13:20:08.794893  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:08.797536  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 121523us
I20260709 13:20:08.795687  4217 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:08.785818  8294 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:08.807113  8294 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:08.806291  8213 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.763208  8468 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.786742  7942 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.806428  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.812160  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.792964  8164 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:08.791672  7898 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:08.821507  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.805840  4261 leader_election.cc:336] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.683s (SENT)
I20260709 13:20:08.823922  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:08.830468  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.836632  8436 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.837463  8436 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.837764  8294 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.838181  8434 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:08.838829  8434 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.839149  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:08.840487  8294 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:08.841001  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:08.796867  8349 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:20:08.841696  8429 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:08.842658  8123 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:08.843225  8256 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.845351  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:08.846482  8371 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:08.847069  8371 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:08.848212  8371 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.850492  8391 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.851100  8391 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.851627  8354 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:08.852221  8354 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:08.856766  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.854060  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:08.854182  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:08.809885  8470 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:08.858827  4213 raft_consensus.cc:2376] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10. Re-sending same reply.
I20260709 13:20:08.864923  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.819865  8278 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.866641  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.880424  8235 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.883121  8208 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.883594  8412 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.884215  8412 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:08.887632  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88608.2us
W20260709 13:20:08.896031  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 122755us
I20260709 13:20:08.898398  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:08.854115  8427 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:20:08.858816  8474 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:20:08.904804  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.915062  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:08.915793  4218 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.910108  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:08.924068  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.820827  7942 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.944099  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:08.853259  7898 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.905750  8404 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:08.909303  8294 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.916430  8417 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.920718  8317 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.954155  8427 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:20:08.958298  8476 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:08.959429  4290 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:08.963294  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.921881  8234 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.014513  4925 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
W20260709 13:20:08.965787  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52560.5us
I20260709 13:20:08.966199  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:08.966336  8407 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.971019  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:08.974567  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.018783  4222 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:08.976269  8436 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:08.978298  8404 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.902190  8278 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:08.988744  8468 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:08.991068  8412 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:08.987644  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:08.981788  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:08.995893  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51900.9us
I20260709 13:20:09.010871  4218 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:09.014161  4290 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:09.035849  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.020505  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.016795  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:09.005618  8427 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:08.977406  8417 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:09.012825  8400 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:20:09.022742  8473 log.cc:927] Time spent T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.257s	user 0.004s	sys 0.000s
I20260709 13:20:09.038360  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.085943  4216 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:09.037454  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.041164  4290 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:09.042487  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 60815us
I20260709 13:20:09.043428  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:09.088670  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 53619.1us
I20260709 13:20:09.088739  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.089488  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:09.045096  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:09.050041  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.043064  8349 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:09.096487  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.044183  8427 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:20:09.109580  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.028715  8294 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:20:09.098374  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:09.013423  8317 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.102844  4290 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.117396  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:09.089274  8164 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:09.043349  8436 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:20:09.099277  8399 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:09.110846  8421 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:09.029384  8407 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:09.110944  8349 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:09.131134  8424 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.119410  8437 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.121791  8164 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.143334  4214 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:09.128631  8230 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:09.147910  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 58513.6us
W20260709 13:20:09.153898  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.139380  8091 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.155756  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:09.133023  8421 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:09.161022  4290 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:20:09.161484  4290 pending_rounds.cc:85] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 4
I20260709 13:20:09.129577  8342 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:20:09.161780  4290 pending_rounds.cc:107] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:20:09.165256  4290 raft_consensus.cc:2889] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:09.145267  8164 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.141551  8399 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:09.182456  8404 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:09.182195  8349 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:09.182335  8484 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:20:09.185807  4261 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.502s (SENT)
I20260709 13:20:09.186667  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:09.191414  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.193656  8404 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:09.194446  8317 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:09.196146  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.196938  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.198596  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2484) took 1681 ms. Trace:
I20260709 13:20:09.153900  8230 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.199045  4290 rpcz_store.cc:276] 0709 13:20:07.516815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.543088 (+ 26273us) service_pool.cc:224] Handling call
0709 13:20:07.551846 (+  8758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:08.959285 (+1407439us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54002c54a0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec59dc0 00007fee3ece41c0 00007fee3ece5231 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c
0709 13:20:09.198370 (+239085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.198546 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994506624}
I20260709 13:20:09.204551  8354 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:09.205750  8487 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:20:09.206275  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:09.207711  8418 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:20:09.160105  8412 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:09.207921  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.209364  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.214998  4295 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:09.163115  8421 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.213474  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.145866  8424 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.221187  4296 raft_consensus.cc:2368] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11.
I20260709 13:20:09.229266  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.230121  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.231107  4296 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:20:09.156288  8091 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:09.231262  4295 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:09.239298  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:09.201718  8440 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.203364  8230 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.244239  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.208608  8468 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:09.243139  4296 raft_consensus.cc:2368] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7.
I20260709 13:20:09.185801  8417 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:09.256284  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 138939us
I20260709 13:20:09.257266  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:09.250162  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.250377  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.265141  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:09.266882  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:09.270033  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:09.255080  8234 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:09.273772  4295 raft_consensus.cc:2410] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:09.255465  8304 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.275142  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.281679  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.282648  4296 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:09.263356  8360 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:09.283771  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:09.265309  8467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.004s	sys 0.009s
I20260709 13:20:09.285470  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:09.287956  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.297917  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:09.298723  8491 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:20:09.300611  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.300731  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.301585  4296 raft_consensus.cc:2376] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9. Re-sending same reply.
I20260709 13:20:09.301965  4289 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:09.304577  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.305752  4289 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:09.241849  8211 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:09.310467  4290 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:20:09.310884  4290 pending_rounds.cc:85] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:20:09.311116  4290 pending_rounds.cc:107] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:20:09.311347  4290 raft_consensus.cc:2889] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:09.271428  8470 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:09.293771  8304 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:09.313834  4919 raft_consensus.cc:2410] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:20:09.314713  8360 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:09.315876  8360 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.276149  8417 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:09.317487  8417 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:09.317963  8417 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:09.320288  8493 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:20:09.322633  8091 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:09.278945  8412 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.324395  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:09.327418  4294 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:09.329255  4296 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:09.255676  8440 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:09.293298  8467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.004s	sys 0.010s
I20260709 13:20:09.351241  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.353238  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.354590  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.355193  4215 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:09.365274  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.366555  7898 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:09.371271  7942 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:09.373215  4289 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:20:09.373723  4289 pending_rounds.cc:85] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:20:09.373945  4289 pending_rounds.cc:107] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:20:09.374183  4289 raft_consensus.cc:2889] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:09.375967  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:09.376185  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:09.377669  4143 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:20:09.377584  4147 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:09.378595  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:09.383906  8294 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.384614  8294 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.388857  8234 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.391398  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:09.402081  4919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 524) took 1026 ms. Trace:
I20260709 13:20:09.338656  8399 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.402875  4919 rpcz_store.cc:276] 0709 13:20:08.375906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.404597 (+ 28691us) service_pool.cc:224] Handling call
0709 13:20:09.401688 (+997091us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54002b2354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:09.401963 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087575424}
I20260709 13:20:09.412230  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:09.352100  4221 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:09.356094  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:09.436794  8425 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:09.437600  8425 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:09.438903  8407 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:09.436815  8412 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:09.440080  8412 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.440524  8412 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:09.440729  8304 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:09.444242  4214 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:09.460469  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:09.482297  4215 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:09.493629  4214 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:20:09.389765  8234 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.503400  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.504771  4291 raft_consensus.cc:2410] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:09.481890  8432 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:09.537657  4214 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:20:09.540158  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:09.446894  8434 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:09.496054  8294 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:09.500670  8391 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:09.496985  8418 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:09.499054  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:09.449167  8440 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:09.448189  8425 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:09.446734  8164 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:09.549901  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:09.624248  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.633818  4218 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:09.635444  4291 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:09.451525  8421 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.643483  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:09.656299  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 106499us
I20260709 13:20:09.630213  8424 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:09.648856  4919 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:09.743603  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.633322  8478 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:20:09.743698  4261 leader_election.cc:336] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.956s (SENT)
I20260709 13:20:09.751794  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:09.625293  8418 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.767086  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.681953  8391 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:09.755376  8425 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:09.749028  8440 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:09.786077  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.787591  4291 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:09.655038  8404 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:09.771773  8391 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:09.802397  8164 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:09.823480  4295 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.817193  8391 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:09.829030  8234 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:09.793542  8412 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.829665  8425 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:09.797535  8440 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:09.850114  8401 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.019s	sys 0.048s
I20260709 13:20:09.830559  8404 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.870404  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:09.876626  4291 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:09.871457  8401 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.019s	sys 0.048s
I20260709 13:20:09.865875  8425 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:09.927479  8501 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:20:09.937301  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 226610us
I20260709 13:20:09.913229  8421 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:09.876044  8404 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:09.945395  4291 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:09.937455  8418 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:09.951926  8230 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.690s	user 0.014s	sys 0.004s
I20260709 13:20:09.984959  8412 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:09.983930  8425 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:10.002573  8427 consensus_meta.cc:287] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.881s	user 0.017s	sys 0.006s
W20260709 13:20:10.017454  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.975463  8230 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.031224  4295 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:10.034111  4146 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:10.011873  8399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.022s
I20260709 13:20:10.018949  8512 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:10.035620  8399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.007s	sys 0.022s
I20260709 13:20:10.015565  8427 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.083091  4290 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:10.063243  8440 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:10.048990  8512 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:10.093333  8509 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:20:10.094880  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:10.101006  8506 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.002s
I20260709 13:20:10.108573  8404 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:10.122943  8508 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
W20260709 13:20:10.131027  8516 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
W20260709 13:20:10.131521  8510 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:20:10.130594  8230 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.140944  8427 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:10.150590  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2573) took 1178 ms. Trace:
I20260709 13:20:10.150745  8391 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.151343  4221 rpcz_store.cc:276] 0709 13:20:08.971693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.484304 (+512611us) service_pool.cc:224] Handling call
0709 13:20:09.498149 (+ 13845us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:09.548602 (+ 50453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.548651 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:09.549511 (+   860us) log.cc:844] Serialized 52 byte log entry
0709 13:20:09.889148 (+339637us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:09.889228 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.889356 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.150273 (+260917us) raft_consensus.cc:1685] finished
0709 13:20:10.150303 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.150506 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78313,"raft.queue_time_us":49968,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":78164,"thread_start_us":223954,"threads_started":1,"wal-append.queue_time_us":332942}
I20260709 13:20:10.154368  8391 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.155292  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2555) took 1305 ms. Trace:
I20260709 13:20:10.160666  4213 rpcz_store.cc:276] 0709 13:20:08.850337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.894268 (+ 43931us) service_pool.cc:224] Handling call
0709 13:20:08.894718 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:08.907880 (+ 13162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.907916 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:09.491815 (+583899us) spinlock_profiling.cc:243] Waited 903 us on lock 0x7b2c00010988. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:09.495588 (+  3773us) log.cc:844] Serialized 52 byte log entry
0709 13:20:09.816989 (+321401us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:09.817050 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.817162 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.154754 (+337592us) raft_consensus.cc:1685] finished
0709 13:20:10.154772 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.155213 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39958,"raft.queue_time_us":15544,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5655,"spinlock_wait_cycles":2076544,"thread_start_us":316949,"threads_started":1,"wal-append.queue_time_us":454564}
I20260709 13:20:10.167950  8512 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:10.170913  8432 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.639s	user 0.018s	sys 0.000s
I20260709 13:20:10.172233  4220 raft_consensus.cc:2410] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:20:10.174583  8417 consensus_meta.cc:287] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.856s	user 0.021s	sys 0.001s
I20260709 13:20:10.177235  8417 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.178447  8278 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:10.178926  4291 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:10.179116  8278 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:10.179935  8278 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:10.185743  8432 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.185741  8278 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:10.188388  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:10.197723  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2283) took 1010 ms. Trace:
I20260709 13:20:10.198236  4290 rpcz_store.cc:276] 0709 13:20:09.187164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.335005 (+147841us) service_pool.cc:224] Handling call
0709 13:20:09.340969 (+  5964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.083829 (+742860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.197316 (+113487us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54000b04d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:10.197651 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705926400}
I20260709 13:20:10.215855  4290 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:10.188328  8432 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.227291  8417 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:10.230648  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.235416  4290 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:10.237460  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.253814  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.255587  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.244089  4147 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:20:10.244833  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:10.257846  4920 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.245774  4925 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:10.247116  4111 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:37124 dropped due to backpressure: service queue is full with 50 items
I20260709 13:20:10.261209  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.247340  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.251340  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:10.272193  4142 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:10.256857  8432 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.280220  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.280074  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.280964  4215 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:10.260021  4111 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:37124 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2275)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
I20260709 13:20:10.287765  4145 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:10.289108  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.289757  4145 raft_consensus.cc:2376] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13. Re-sending same reply.
I20260709 13:20:10.290712  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.291949  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.295920  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.298928  4920 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
W20260709 13:20:10.290850  8505 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.489s	user 0.004s	sys 0.000s
I20260709 13:20:10.302246  4925 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:20:10.302860  4925 pending_rounds.cc:85] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Aborting all ops after (but not including) 8
I20260709 13:20:10.303525  4925 pending_rounds.cc:107] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:20:10.303939  4925 raft_consensus.cc:2889] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:10.300565  4185 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:10.307164  8432 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:10.307921  8432 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:10.309307  8432 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:10.304920  8472 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:10.311126  4111 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52134 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.316262  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.322036  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:10.328831  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.331692  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:10.332583  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.324479  8417 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:10.335675  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.332713  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.343696  4145 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:10.345269  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:10.345208  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.329267  8391 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.333854  8278 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:10.348999  4213 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:10.345394  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:37124 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1994)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.356137  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.357264  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:10.337703  8417 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.347705  8391 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:10.348026  8278 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.361052  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.362303  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.364300  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.361171  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.365607  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:10.365986  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.366672  4221 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:10.328398  8123 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:20:10.361763  8417 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.371739  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.375267  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:10.378409  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:10.381538  8404 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:10.383848  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:10.384892  8404 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:10.385389  8404 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.385759  8404 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.379621  8427 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:10.401842  8391 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:10.408453  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2250) took 1033 ms. Trace:
I20260709 13:20:10.408995  4146 rpcz_store.cc:276] 0709 13:20:09.374929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.378286 (+  3357us) service_pool.cc:224] Handling call
0709 13:20:10.408146 (+1029860us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400265554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:10.408307 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504860928}
I20260709 13:20:10.381829  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.413791  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.414793  4143 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:10.413798  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.423220  4140 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:10.423512  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
W20260709 13:20:10.428303  4288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2262) took 1335 ms (client timeout 1644 ms). Trace:
W20260709 13:20:10.428881  4288 rpcz_store.cc:269] 0709 13:20:09.092694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.096080 (+  3386us) service_pool.cc:224] Handling call
0709 13:20:10.428054 (+1331974us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400288f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:10.428232 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2201728384}
I20260709 13:20:10.428323  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.436544  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.437534  4140 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:10.439571  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.440331  4140 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:10.441277  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2528) took 1139 ms. Trace:
I20260709 13:20:10.442420  4294 rpcz_store.cc:276] 0709 13:20:09.301962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.944972 (+643010us) service_pool.cc:224] Handling call
0709 13:20:09.958016 (+ 13044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.958281 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:10.106875 (+148594us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.438113 (+331238us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18003f8440. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3e88a4bc 00007fee3bbd848b 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a
0709 13:20:10.439340 (+  1227us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.440546 (+  1206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.440598 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:10.440647 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.441076 (+   429us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.441221 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15526,"prepare.queue_time_us":172524,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":99,"spinlock_wait_cycles":3116288,"thread_start_us":179274,"threads_started":2,"wal-append.queue_time_us":58289}
I20260709 13:20:10.449120  4143 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:10.450399  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.450747  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.451789  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.452526  4147 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:10.441447  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.435166  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.436568  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2529) took 1134 ms. Trace:
I20260709 13:20:10.458755  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.464380  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.464808  4215 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:10.459085  8538 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.465667  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.460520  8537 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.470117  4147 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:10.470023  8537 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.463752  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.471398  4140 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.466461  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.473909  8537 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.451916  4143 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:10.474661  8538 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:10.477316  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55751.9us
I20260709 13:20:10.477911  8537 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.463734  4291 rpcz_store.cc:276] 0709 13:20:09.302344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.956298 (+653954us) service_pool.cc:224] Handling call
0709 13:20:09.979891 (+ 23593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.179567 (+199676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.436119 (+256552us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400288a54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:10.436463 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457043712}
I20260709 13:20:10.479453  8537 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.478541  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:10.474004  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2013)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.484925  4140 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:10.481788  8537 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.486550  8537 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.492779  8537 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.496001  8537 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.481719  8538 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:10.497061  8538 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:10.498245  8540 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:10.485762  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.500293  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2018)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.498696  8540 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:10.509470  8540 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.511199  8540 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.497267  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:10.508546  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2018)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.497332  8537 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.515277  4111 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2018)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.522048  8537 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:20:10.523110  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2018)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.534075  8540 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:10.538460  8537 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:20:10.536094  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:37124 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2022)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2018)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
I20260709 13:20:10.545660  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.546693  4139 raft_consensus.cc:2410] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:20:10.547180  8213 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:10.546361  4111 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2023)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2022)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2018)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2006)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2004)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2008)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 447)
W20260709 13:20:10.551153  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44632.1us
I20260709 13:20:10.552328  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:10.557545  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.558945  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.559283  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:10.560082  4215 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:10.561245  8540 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:10.561707  8540 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.561544  8417 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.562078  8540 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.563938  8417 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:10.560127  4218 raft_consensus.cc:2410] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:10.569023  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.570096  4145 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:10.571165  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.573508  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.574189  4145 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:10.576335  8540 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.578668  8540 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.580477  8540 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:10.581987  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.583781  4145 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:10.583590  4041 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.594277  4041 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:10.596170  4041 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:10.598415  4041 catalog_manager.cc:5697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 3 to 4, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 4 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:10.601131  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.591859  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:10.601424  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.602618  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.603286  8540 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:10.603706  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.605204  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.606521  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.607798  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.584311  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.608626  4144 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:10.609743  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.611301  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.609838  8540 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:10.611194  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.614097  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.600019  4041 catalog_manager.cc:5697] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:10.615185  8540 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:10.615793  4041 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 7, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 7 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.612713  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.619671  4144 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:10.619248  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:10.603364  4142 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:10.622756  4145 raft_consensus.cc:2410] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:20:10.623265  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.623391  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.623698  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.623919  4144 raft_consensus.cc:2376] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9. Re-sending same reply.
I20260709 13:20:10.624629  4145 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:10.625003  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.625846  4144 raft_consensus.cc:2368] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:10.621093  4041 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 7, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 7 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.627398  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.625742  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.612064  4217 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:10.627195  4041 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 8, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:10.628288  4145 raft_consensus.cc:2376] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 10. Re-sending same reply.
I20260709 13:20:10.631330  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.602617  4221 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.634877  8123 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:10.635522  8123 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.636282  8432 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.636955  8432 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:10.638311  8123 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.639371  8432 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:10.623963  4142 raft_consensus.cc:2376] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8. Re-sending same reply.
I20260709 13:20:10.640967  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.641638  4142 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:10.642488  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.643061  4142 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:10.652480  8540 raft_consensus.cc:2764] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:10.654048  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:10.655596  4111 leader_election.cc:400] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11.
I20260709 13:20:10.655933  4111 leader_election.cc:403] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:10.644034  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.678356  4142 raft_consensus.cc:2368] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:10.628033  4144 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:20:10.682253  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.683712  4145 raft_consensus.cc:2368] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10.
I20260709 13:20:10.685176  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.686208  4145 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:10.687724  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.688112  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.688828  4145 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:10.690354  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.691365  4145 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:10.693301  4221 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:10.695140  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:10.694258  8442 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11.
I20260709 13:20:10.697182  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:10.699726  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.700491  4142 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:10.701908  4142 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:20:10.703882  8442 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:10.704500  8442 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:10.705102  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.705169  8540 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:10.705402  8442 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.706255  8540 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:10.706559  4111 leader_election.cc:400] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7.
I20260709 13:20:10.706771  8540 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.707662  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.708992  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.709620  4142 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:20:10.657699  8539 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:10.698490  4145 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:10.730639  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.730876  4142 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:10.748492  4143 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:10.748692  4142 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:20:10.749047  4142 pending_rounds.cc:85] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 3
I20260709 13:20:10.749248  4142 pending_rounds.cc:107] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:20:10.749480  4142 raft_consensus.cc:2889] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:10.751729  4143 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:20:10.751214  8539 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.774652  8319 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:10.775791  8319 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:10.779613  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 395797us
W20260709 13:20:10.783104  4216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2563) took 1875 ms (client timeout 2066 ms). Trace:
W20260709 13:20:10.783643  4216 rpcz_store.cc:269] 0709 13:20:08.908149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.908812 (+   663us) service_pool.cc:224] Handling call
0709 13:20:10.782827 (+1874015us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400181854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:10.783026 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309141888}
I20260709 13:20:10.790993  4144 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:10.788067  8550 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:10.798981  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 89956.5us
I20260709 13:20:10.800053  8417 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.797294  8319 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.808931  8417 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.811471  8319 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.811668  8417 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:10.816723  4145 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:10.818416  4145 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:10.820605  8404 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.824631  8404 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:10.818380  8540 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.829783  4143 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:10.798590  4261 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items
I20260709 13:20:10.841253  8540 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.843236  4138 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:10.835956  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:10.859367  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59567.9us
I20260709 13:20:10.865998  8404 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:20:10.868103  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69553.2us
W20260709 13:20:10.869364  4261 leader_election.cc:336] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items
I20260709 13:20:10.869815  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:10.872843  4213 consensus_meta.cc:287] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.001s
I20260709 13:20:10.873593  8404 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.880728  4213 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:10.890265  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:10.891326  4147 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:10.898089  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 189200us
W20260709 13:20:10.886080  4261 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items
W20260709 13:20:10.900414  4261 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items
I20260709 13:20:10.900950  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:10.914275  4261 leader_election.cc:336] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items
I20260709 13:20:10.915551  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:10.917989  8417 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.917304  8440 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:10.920733  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:10.927115  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.898257  8558 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.928782  8558 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.932564  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.932757  8440 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:10.933526  8541 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:10.933471  8440 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.932606  8442 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:10.935379  8442 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.935789  8442 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.941288  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:10.942250  4140 raft_consensus.cc:2368] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13.
W20260709 13:20:10.942734  4261 leader_election.cc:336] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52146 dropped due to backpressure: service queue is full with 50 items
I20260709 13:20:10.943563  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:10.945097  8472 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:10.945007  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:10.946426  4925 raft_consensus.cc:2393] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:10.946902  8555 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.946687  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:10.951843  8555 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:20:10.950416  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:10.378723  7898 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:10.948655  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:10.957295  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:10.960855  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:10.961685  4925 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:10.945828  8472 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:10.964514  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.960433  8541 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:10.967262  4295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2260) took 1931 ms (client timeout 2201 ms). Trace:
I20260709 13:20:10.968039  8472 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:10.955758  8558 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.956564  8417 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:10.969480  8417 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:10.970026  8417 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:10.970275  8440 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:20:10.970587  8417 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.970893  8440 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:10.955044  7898 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:10.974550  7898 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:10.976781  8404 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:10.983223  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:10.983958  4220 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.987022  8541 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:11.000139  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.001693  8278 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.005129  4217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2551) took 2156 ms. Trace:
I20260709 13:20:11.005617  4217 rpcz_store.cc:276] 0709 13:20:08.849071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.859506 (+ 10435us) service_pool.cc:224] Handling call
0709 13:20:08.859952 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.639846 (+1779894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.004749 (+364903us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000262d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:11.004993 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4028978944}
W20260709 13:20:11.009016  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 46905.9us
W20260709 13:20:10.967739  4295 rpcz_store.cc:269] 0709 13:20:09.035454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.285233 (+249779us) service_pool.cc:224] Handling call
0709 13:20:10.967043 (+1681810us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54000ec754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:10.967188 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217358592}
I20260709 13:20:10.987733  8541 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.017239  8427 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.018432  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64566.2us
I20260709 13:20:11.019227  8541 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:11.019372  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.020633  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:11.020584  8427 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.023188  8427 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.025260  8550 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:11.025581  8558 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:11.026719  8550 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:11.027160  8539 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:11.028587  4220 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
W20260709 13:20:11.034148  8507 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.084s	user 0.000s	sys 0.006s
I20260709 13:20:11.044633  8559 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:11.031201  8319 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:20:11.052883  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.050770  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.058712  4147 raft_consensus.cc:2410] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:20:11.058782  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.060153  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.049738  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.061188  4141 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:11.061707  4145 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:11.060547  4143 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:11.054102  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:11.048296  8541 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:11.063997  8541 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:11.064502  8427 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:11.062915  8550 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:20:11.065521  8278 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.065379  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.066073  8278 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.068074  8278 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.053155  8558 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:20:11.070338  8442 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.073057  8442 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:11.076901  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:11.065181  8427 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.086050  8427 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:11.081424  8550 consensus_queue.cc:1243] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:20:11.082439  8559 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:11.083369  8558 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:11.087260  8558 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:11.088382  8558 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.089721  8558 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:11.092229  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.092736  8559 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:11.093930  8559 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.099773  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.103030  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:11.030339  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:11.095439  4041 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 1 to 6, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 6 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.105110  8559 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.101852  8555 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:11.107697  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.109776  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:11.111846  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:11.133903  4925 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:11.112738  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:11.122434  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 99376.8us
W20260709 13:20:11.123405  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 93160.5us
I20260709 13:20:11.138355  8421 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:11.136276  4187 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.867s (SENT)
I20260709 13:20:11.138998  8421 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.140318  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.140515  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:11.141214  4291 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.141733  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.142746  8469 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.143086  8404 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:11.139922  4187 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.501s (SENT)
W20260709 13:20:11.145227  4187 leader_election.cc:336] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.040s (SENT)
I20260709 13:20:11.125881  4218 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:11.126519  8412 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:11.153702  4289 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:11.154496  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:11.126659  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.156577  4146 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:11.146235  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:11.147017  4187 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 2.077s (SENT)
I20260709 13:20:11.157855  4288 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:11.147099  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.148555  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.161226  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.162089  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:11.162772  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:11.163045  4925 raft_consensus.cc:2410] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:20:11.163371  4296 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:20:11.164219  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.165767  8440 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:20:11.170989  8440 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:11.166011  8384 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:20:11.172837  8384 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:11.172983  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.173267  8384 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:11.173979  4294 raft_consensus.cc:2410] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:11.174273  8384 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.175048  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:11.175585  8384 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:11.160663  8555 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:11.166651  7898 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:11.177368  7898 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.177690  8555 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.167338  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:11.168277  4292 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:20:11.183650  4111 leader_election.cc:336] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Timed out: RequestConsensusVote RPC to 127.2.243.67:40585 timed out after 1.644s (SENT)
I20260709 13:20:11.184257  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.185828  4293 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:11.187736  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:11.185036  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:11.188475  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.188793  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:11.188068  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.190864  4291 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
W20260709 13:20:11.190780  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67328.8us
I20260709 13:20:11.192128  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.192265  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.192653  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.192835  4291 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:11.194748  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.196853  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.198669  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.202072  4291 raft_consensus.cc:2410] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:20:11.205148  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.206238  4287 raft_consensus.cc:2410] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:11.141222  8421 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.160645  8278 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:11.143381  8469 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.215016  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:11.215983  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.209273  8538 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:11.221647  4925 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:11.217774  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.223016  4292 raft_consensus.cc:2410] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:11.218231  4215 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:11.216935  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.221307  8278 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:11.230926  8091 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.236752  7898 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:11.242750  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:11.221688  8469 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:11.271310  8424 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:20:11.295965  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.323374  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:11.324632  8469 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:11.326277  8278 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.221489  8421 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:11.220811  8391 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:20:11.307642  8548 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.081s	user 0.008s	sys 0.001s
W20260709 13:20:11.312497  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 98662.7us
I20260709 13:20:11.316802  8427 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.317821  8417 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.330868  8427 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:11.332217  4893 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:37124 dropped due to backpressure: service queue is full with 50 items
I20260709 13:20:11.333523  8427 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.333518  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.225867  4261 leader_election.cc:400] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:11.335785  8500 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:11.298410  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 114849us
I20260709 13:20:11.327355  8469 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:11.328214  4187 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.338322  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.339053  4147 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:11.339546  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.339775  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:11.340675  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.342365  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.342844  4219 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:11.343552  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.299566  4296 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:11.344218  4140 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:11.345114  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.340293  4146 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:11.346525  4296 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:11.346793  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.347438  4146 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:11.348353  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.323935  8424 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:11.336175  4261 leader_election.cc:403] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:11.350100  4187 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.342918  4147 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:11.348279  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.331254  4289 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:20:11.351225  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 125511us
I20260709 13:20:11.320180  8440 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:11.360608  4140 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:11.358944  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.362534  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:11.335688  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.351971  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.359275  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.359599  4892 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:11.364722  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.367777  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.368660  4290 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:11.369675  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.371537  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.373318  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.358970  8469 raft_consensus.cc:2764] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:20:11.380009  4296 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:11.366816  4893 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.380156  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:11.396998  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.471310  4143 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:11.377987  8424 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:11.397207  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:11.367851  8427 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:11.377257  8421 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.336293  8500 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:11.447687  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.484984  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:11.397442  8472 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:11.380738  8404 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:11.480356  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 100262us
I20260709 13:20:11.368484  8440 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:11.376139  7898 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:20:11.377447  8386 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:20:11.496973  4187 leader_election.cc:400] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10.
I20260709 13:20:11.382823  8384 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:11.376008  8391 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:20:11.489291  8417 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:11.505244  4168 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4b20 after lost signal to thread 3024
I20260709 13:20:11.493026  8500 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.491047  8435 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.498595  8424 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:11.508587  4141 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:11.518049  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.508919  4219 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:11.481812  8412 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:11.510977  4168 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff120 after lost signal to thread 4079
W20260709 13:20:11.523763  4168 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdd80 after lost signal to thread 4171
I20260709 13:20:11.524636  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:11.524956  4168 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb240 after lost signal to thread 4246
I20260709 13:20:11.504398  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.499904  8440 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.494913  8404 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:11.499806  8278 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:11.504242  8421 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:11.533136  8421 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.533547  8421 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.530568  8404 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.539482  8440 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.367575  8551 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:20:11.494720  8472 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.541045  4296 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:11.540824  4041 catalog_manager.cc:5697] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.540868  8472 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.541931  8440 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:11.542691  4041 catalog_manager.cc:5697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 9, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 9 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:11.525283  4140 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 5.
W20260709 13:20:11.525285  4168 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb2c0 after lost signal to thread 4247
W20260709 13:20:11.545682  4168 debug-util.cc:398] Leaking SignalData structure 0x7b080024e920 after lost signal to thread 4320
W20260709 13:20:11.546000  4168 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd1c0 after lost signal to thread 4321
I20260709 13:20:11.528573  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.548283  8384 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:11.549016  8384 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:11.531744  4219 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:11.514793  8435 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:11.540060  4045 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 161) took 34649 ms (client timeout 15000 ms). Trace:
W20260709 13:20:11.579092  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 131520us
I20260709 13:20:11.558041  8213 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:11.572770  8467 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:20:11.573544  8574 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:11.573390  8468 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:20:11.545871  8565 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 13:20:11.574465  8319 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:11.557673  8469 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:20:11.576489  8489 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:11.577056  4041 catalog_manager.cc:5697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.660681  4041 catalog_manager.cc:5697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:11.662669  4041 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:11.580402  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.664713  4140 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:11.637008  8123 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:11.668025  8580 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:11.668589  8580 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.670825  8580 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.673210  8541 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.674830  8541 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:11.528067  7898 raft_consensus.cc:2764] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:20:11.637643  8576 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:20:11.641242  8384 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:11.642130  8371 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:11.642900  8432 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:11.644119  8412 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.649962  8421 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.651072  8424 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:11.579034  4045 rpcz_store.cc:269] 0709 13:19:36.890651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.036206 (+145555us) service_pool.cc:224] Handling call
0709 13:20:11.539787 (+34503581us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:56.512855 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:56.513507 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:56.513573 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:19:56.513587 (+    14us) tablet.cc:662] Decoding operations
0709 13:19:57.392819 (+879232us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:57.402585 (+  9766us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:57.406136 (+  3551us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:19:57.745087 (+338951us) tablet.cc:701] Row locks acquired
0709 13:19:57.765887 (+ 20800us) write_op.cc:260] PREPARE: finished
0709 13:19:57.798058 (+ 32171us) write_op.cc:270] Start()
0709 13:19:57.833472 (+ 35414us) write_op.cc:276] Timestamp: P: 1783603197774816 usec, L: 0
0709 13:19:57.833514 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:19:57.924022 (+ 90508us) log.cc:844] Serialized 5920 byte log entry
0709 13:19:57.997523 (+ 73501us) op_driver.cc:464] REPLICATION: finished
0709 13:19:58.161360 (+163837us) write_op.cc:301] APPLY: starting
0709 13:19:58.161548 (+   188us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:58.815393 (+653845us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:58.815674 (+   281us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:59.909648 (+1093974us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:00.019119 (+109471us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:20:00.019205 (+    86us) write_op.cc:312] APPLY: finished
0709 13:20:00.019981 (+   776us) log.cc:844] Serialized 139 byte log entry
0709 13:20:00.457525 (+437544us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:00.480741 (+ 23216us) write_op.cc:454] Released schema lock
0709 13:20:00.503717 (+ 22976us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:00.587401 (+ 83684us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:00.592329 (+  4928us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1971909,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":147082,"apply.run_cpu_time_us":60712,"apply.run_wall_time_us":2393532,"cfile_cache_hit":58,"cfile_cache_hit_bytes":60639,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":1,"lbm_read_time_us":99727,"lbm_reads_10-100_ms":4,"lbm_reads_lt_1ms":4,"num_ops":15,"prepare.queue_time_us":189984,"prepare.run_cpu_time_us":13799,"prepare.run_wall_time_us":1411647,"replication_time_us":140957,"spinlock_wait_cycles":3328,"thread_start_us":702397,"threads_started":3,"wal-append.queue_time_us":564527,"wal-append.run_cpu_time_us":2966,"wal-append.run_wall_time_us":1708554}]]}
I20260709 13:20:11.598176  8213 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:11.701284  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:11.701465  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 334715us
I20260709 13:20:11.702494  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.696087  4143 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
W20260709 13:20:11.688266  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 316426us
I20260709 13:20:11.558236  8417 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:11.526793  8558 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.155s
I20260709 13:20:11.601202  8435 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.633019  8472 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.713918  8386 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:11.664037  4041 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 11, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 11 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:11.724638  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.725790  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:11.739557  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.587s (SENT) [suppressed 74 similar messages]
I20260709 13:20:11.715240  8540 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:11.743274  4041 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 9, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 9 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:20:11.740657  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 101131us
I20260709 13:20:11.748477  4143 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:11.755450  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:11.754163  4187 leader_election.cc:400] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13.
I20260709 13:20:11.756875  4187 leader_election.cc:403] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:20:11.761049  4168 debug-util.cc:398] Leaking SignalData structure 0x7b080010fac0 after lost signal to thread 4953
I20260709 13:20:11.759829  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:11.766018  4168 debug-util.cc:398] Leaking SignalData structure 0x7b080031eb20 after lost signal to thread 8354
I20260709 13:20:11.761251  8213 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.782080  8213 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.783885  8230 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:11.752128  8585 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:11.784181  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:11.795070  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 80158.7us
I20260709 13:20:11.788147  4142 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:11.802258  4187 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.799374  8589 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:20:11.785370  8578 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:11.749774  8540 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.757535  8583 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:11.784317  8230 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:11.786800  8472 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:11.798287  8123 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13.
I20260709 13:20:11.796859  7898 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:11.823055  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 96791.8us
W20260709 13:20:11.823760  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84213.1us
I20260709 13:20:11.825335  8417 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:11.807786  8589 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:11.812816  8436 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:11.830973  8589 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:11.829991  8436 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:11.831111  8417 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.831856  8436 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:11.833652  8417 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:11.784785  8585 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.809152  8467 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:20:11.818063  8386 raft_consensus.cc:697] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:11.837186  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.838163  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.838551  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.839076  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.847079  4142 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:11.848165  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.841933  8417 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.852849  8421 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:11.854426  8500 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.823815  8469 consensus_queue.cc:1059] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:20:11.845350  8230 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.856731  8500 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.856979  8123 raft_consensus.cc:3055] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:11.857474  8230 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.860167  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:11.850740  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52533.4us
I20260709 13:20:11.858889  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:11.816512  8583 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:11.843675  8581 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:11.860879  4139 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:11.961778  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 102956us
I20260709 13:20:11.962585  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.963784  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.966763  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.823237  7898 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:11.918817  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:11.976563  4146 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:11.976584  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:11.919152  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:11.977803  4145 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.977929  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:11.905306  8566 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.607s	user 0.006s	sys 0.000s
I20260709 13:20:11.925181  8583 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.902825  8421 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:11.943536  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.989884  4289 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:11.945197  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:11.945627  8585 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:11.946791  4295 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:20:11.993216  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.947067  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.993913  4295 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:11.994333  4288 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
W20260709 13:20:11.994678  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 168203us
I20260709 13:20:11.953200  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.998440  4185 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:11.999374  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:12.001840  4288 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:11.955140  8417 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:11.958874  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.857867  8123 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:11.975227  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:11.975371  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:11.980149  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:11.981679  4296 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:11.982124  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:11.982112  4139 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
W20260709 13:20:12.152325  4139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2019) took 1644 ms (client timeout 1587 ms). Trace:
W20260709 13:20:12.152586  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 170532us
W20260709 13:20:12.152721  4139 rpcz_store.cc:269] 0709 13:20:10.508023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.859877 (+1351854us) service_pool.cc:224] Handling call
0709 13:20:12.152251 (+292374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.993642  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.966739  8580 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:11.966583  8399 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:12.008512  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55393.7us
I20260709 13:20:11.989143  8421 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:11.976109  8404 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.002863  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:12.157027  4145 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:12.158056  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:11.960007  8386 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.003037  8588 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.007215  8278 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:12.146301  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 151016us
I20260709 13:20:12.200205  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:11.983482  8440 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:12.149487  4292 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:12.150542  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 172665us
I20260709 13:20:12.208552  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:11.978425  8427 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:12.210778  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 235491us
I20260709 13:20:12.212904  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:12.169525  8435 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.145098  8590 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:12.177065  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2307) took 1128 ms. Trace:
W20260709 13:20:12.148422  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.160254  8589 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.200853  4289 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 5.
I20260709 13:20:12.162956  8598 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:12.242187  4216 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:20:12.155493  8595 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.181s	user 0.005s	sys 0.004s
W20260709 13:20:12.175347  8582 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.229s	user 0.004s	sys 0.000s
W20260709 13:20:12.153975  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 151278us
I20260709 13:20:12.177632  7898 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:12.222056  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:12.257274  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2548) took 1106 ms. Trace:
I20260709 13:20:12.262080  4287 rpcz_store.cc:276] 0709 13:20:11.150627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.733097 (+582470us) service_pool.cc:224] Handling call
0709 13:20:11.750405 (+ 17308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.752525 (+  2120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.752556 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.752996 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.808049 (+ 55053us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:11.808208 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.808316 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.257085 (+448769us) raft_consensus.cc:1685] finished
0709 13:20:12.257104 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.257220 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1679,"raft.queue_time_us":3916,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":26211,"thread_start_us":20612,"threads_started":1,"wal-append.queue_time_us":62766}
I20260709 13:20:12.229516  4295 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:12.171309  8540 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:12.210562  8427 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.265482  8427 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.261807  4289 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 6.
I20260709 13:20:12.266335  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:12.256834  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:12.155256  8371 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:12.154985  8432 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:12.157243  8467 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:12.171964  8391 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:12.215567  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:12.199087  8421 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:12.219267  4138 rpcz_store.cc:276] 0709 13:20:11.048928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.049082 (+   154us) service_pool.cc:224] Handling call
0709 13:20:11.061157 (+ 12075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.166999 (+1105842us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:20:12.167046 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:12.167111 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:20:12.167173 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.176707 (+  9534us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400378554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:12.176786 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.176980 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31356,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9224,"spinlock_wait_cycles":2542078208}
I20260709 13:20:12.286933  4220 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:12.163236  8436 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.186355  8123 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.288776  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:12.204463  8434 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:20:12.205313  8440 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:12.290406  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47691.9us
I20260709 13:20:12.260279  8589 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:12.306108  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:12.343297  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:12.343956  4213 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:12.207110  8468 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:12.308888  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:12.258456  8435 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:12.310278  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.328598  8371 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.241504  8590 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:12.260973  8588 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:12.346267  8440 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.315929  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:12.245086  8586 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:12.318337  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:12.353358  4295 raft_consensus.cc:2376] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11. Re-sending same reply.
I20260709 13:20:12.229084  8213 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:12.322621  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:12.357590  4287 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.323477  4289 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:20:12.325321  4292 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:12.295843  8230 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.291297  8540 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.242321  8319 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:20:12.345106  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:12.227736  8559 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:12.327135  8391 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:12.368592  8602 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:12.369055  8391 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.370617  8391 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.350021  8417 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:20:12.310082  8580 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:20:12.255538  8592 consensus_queue.cc:1059] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:20:12.368685  8404 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:12.352190  8588 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.343302  8539 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:12.367620  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.351684  8371 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.369112  8602 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.352480  8468 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.378273  8319 consensus_queue.cc:1243] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:12.405035  8319 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:12.405404  8319 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:12.406558  8468 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:12.343211  8594 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:20:12.388710  4287 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:12.406180  8319 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.407529  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:12.408409  8319 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:12.413429  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.414280  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.416124  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.422179  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:12.423087  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.434269  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2299) took 1286 ms. Trace:
I20260709 13:20:12.434784  4294 rpcz_store.cc:276] 0709 13:20:11.147657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.192290 (+ 44633us) service_pool.cc:224] Handling call
0709 13:20:12.417803 (+1225513us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002d64d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:12.434183 (+ 16380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2727136512}
W20260709 13:20:12.443149  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75599.6us
I20260709 13:20:12.444519  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:12.445840  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:12.451016  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.372579  8230 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:12.451174  8579 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.275s	user 0.003s	sys 0.000s
I20260709 13:20:12.380374  8559 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.374991  8417 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:12.454777  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:12.380209  8586 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:12.421242  8602 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.473989  8605 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:12.431936  8588 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:12.478022  8581 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:12.448509  8585 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:12.375942  8540 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.366472  8213 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:12.537525  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.474721  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:12.452836  8399 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:12.452955  8404 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:12.577639  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 102979us
W20260709 13:20:12.574680  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.558359  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 342885us
W20260709 13:20:12.560210  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 258265us
I20260709 13:20:12.471658  8417 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:12.478780  8412 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:12.437096  8539 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.584095  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:12.584350  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.584619  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.588790  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:12.593382  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.596279  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.599243  4221 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:12.572628  8399 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.604326  4214 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:12.581581  8434 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.491101  8586 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.568387  8581 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.621781  8539 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:12.621989  8581 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:12.622474  8539 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:12.585398  8432 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:20:12.624817  8436 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:12.585214  8412 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.626735  8412 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:12.629539  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:12.582440  8404 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:12.614784  8442 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:12.632982  8442 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:12.633277  8404 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.633832  8442 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.635330  8586 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:12.611083  8230 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:12.537312  8605 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.647511  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:12.646624  8581 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:12.667755  8581 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.670135  8581 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:12.672824  8412 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.607780  8399 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.682320  8427 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.683750  8371 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.684366  8427 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:12.686141  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:12.688130  4217 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:12.689558  8427 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.690255  8427 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:12.692024  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 108647us
I20260709 13:20:12.692965  8427 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:12.674654  8421 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.699687  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.694150  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:12.681382  8550 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.702041  8581 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.675158  8559 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:20:12.703258  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.703619  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:12.711261  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.696583  8230 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.699069  8541 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.721108  8612 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:12.713331  8434 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:20:12.750809  8440 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.752089  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:12.753367  8590 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.754118  4919 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:12.754417  8590 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.755188  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:12.755434  4290 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:12.713706  8436 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:20:12.763887  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 60371.3us
I20260709 13:20:12.701527  8617 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.764743  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:12.767109  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:12.694543  8558 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:12.712126  8613 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.730763  8371 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:12.733781  8213 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:12.734324  8601 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.569s	user 0.000s	sys 0.013s
I20260709 13:20:12.737757  8588 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.836624  8584 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:12.837175  8584 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:12.710196  8384 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:12.739598  8540 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:12.741225  8123 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:12.838387  8584 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.839823  8584 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.741617  8602 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.795639  8613 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.841809  8602 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:12.742362  8230 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.843667  8613 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:12.746646  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:12.845813  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 99247.4us
I20260709 13:20:12.846513  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.703107  8412 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:12.781244  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.848261  8427 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.713899  8580 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:12.785493  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.720469  8319 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.849256  4287 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:12.795845  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.799274  4928 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:12.792833  8617 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.777248  8541 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.787178  8417 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.793562  8558 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:12.791550  8278 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 13:20:12.870784  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.877421  4217 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:20:12.791822  8539 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.830415  8627 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.837261  8588 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:12.739429  8500 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:12.847594  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:12.891914  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.843762  8230 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:12.860050  8436 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:12.860139  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 68937.1us
I20260709 13:20:12.870476  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.917804  4219 raft_consensus.cc:2410] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:20:12.872287  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76571.9us
I20260709 13:20:12.765825  8581 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.881057  4112 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:12.785045  8612 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.848317  8412 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.792435  8614 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:12.852241  8319 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.892160  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.918205  4289 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: []
I20260709 13:20:12.712081  8550 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:12.876088  8628 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:20:12.848619  8585 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.923539  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:12.876137  8602 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:12.890017  8500 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:12.917130  8580 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:12.949239  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.886431  8278 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.885703  8622 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:12.916937  8391 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.002s
I20260709 13:20:12.889793  8627 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.925261  8588 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.916528  8467 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:20:12.958559  4186 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:12.959097  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 78134.3us
I20260709 13:20:12.950310  8613 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:12.951586  8404 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.897401  8539 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.950928  8605 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:12.925572  8412 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:12.974432  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.975303  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:12.959925  8622 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.978713  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:12.981930  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:12.982301  4219 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:12.980428  8605 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:12.988799  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:12.968258  8613 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.989560  4928 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:12.993767  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:12.954284  8612 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:20:12.956774  8602 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.965776  8468 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 13:20:13.003649  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50084.5us
I20260709 13:20:13.006026  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:13.007521  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.008725  8588 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:12.991228  8613 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:13.010310  8632 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:12.988919  8421 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:13.012823  8627 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:12.989354  8541 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:12.973412  8278 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:20:13.021530  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:13.034901  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.036046  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.037006  4215 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:13.022148  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:12.996584  8467 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:13.042940  8467 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:13.043380  8467 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:13.043674  8421 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.989554  8622 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.044158  8421 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.044778  8539 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.046078  8412 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:13.021771  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:13.032006  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:12.989112  8500 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:12.997956  8436 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:13.037969  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.038554  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.032401  8627 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.070951  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.019785  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:13.047513  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.048053  4213 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:13.004695  8540 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:13.048931  4219 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:13.048298  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:13.060530  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 141268us
I20260709 13:20:13.075968  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:13.065629  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.084908  4289 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:13.088197  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:13.090633  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:13.091674  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:13.073190  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:13.004765  8440 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:13.046092  8421 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:13.096616  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:13.102146  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:13.001646  8591 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:20:13.068030  8436 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:13.063751  8617 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.109042  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.103044  8592 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:13.105149  8638 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.092095  8417 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.092530  8541 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:13.090197  8435 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:20:13.092952  8319 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.058511  8384 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:13.089036  8639 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.089308  8540 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.097389  8614 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:20:13.090839  8550 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.105417  8434 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:13.123585  8592 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:13.103756  8558 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.108007  8432 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:13.121587  8436 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.122484  8640 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.157157  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.161505  8391 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:13.153250  8432 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.162545  8432 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.130939  8540 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:13.131117  8614 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:13.134423  8468 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:13.135727  8434 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:13.153600  8592 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.210593  8468 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:13.224951  8468 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.226117  8468 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.230957  8436 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.236716  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:13.237658  4288 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:13.219803  8434 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:13.239617  8489 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:20:13.240034  8399 consensus_meta.cc:287] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.004s
I20260709 13:20:13.212080  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.240403  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:13.241285  4290 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:13.241679  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.221357  8602 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.244088  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.244558  4220 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:13.244899  4294 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:13.246333  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.240054  8489 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:13.162191  8391 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.248800  8489 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.249977  8489 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.250396  8391 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.251202  8467 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.252740  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.258038  8605 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:13.260234  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.262449  8500 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.263188  8622 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.277804  4294 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:13.264322  4138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
W20260709 13:20:13.264587  8646 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:13.133534  8639 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:13.272639  8641 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:20:13.210528  8614 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:13.305006  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:13.209249  8558 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.279007  4138 raft_consensus.cc:606] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:13.306931  4138 raft_consensus.cc:614] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:13.268896  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:13.307116  8558 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.312171  8558 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:13.316491  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47664.8us
I20260709 13:20:13.320399  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:13.240492  8399 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.326287  4290 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:13.273046  8123 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:20:13.350275  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 244686us
I20260709 13:20:13.365748  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:13.370405  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:13.373519  4296 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:13.383436  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.324440  8213 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.393297  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:13.305456  8613 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.413533  4921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7"
dest_uuid: "b81584b21ed144698954548303f1e507"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:33560
I20260709 13:20:13.414779  4921 raft_consensus.cc:606] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:13.415098  4921 raft_consensus.cc:614] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:13.415853  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:13.399822  7898 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.385802  8436 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.406241  8602 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:13.441606  4921 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:20:13.445154  4219 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:13.446198  4218 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:13.449641  4893 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:13.483515  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 163191us
I20260709 13:20:13.421729  8650 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.485929  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:13.486263  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.483062  8624 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:13.433372  8602 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:13.444401  8540 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.435776  7898 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.444505  8638 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:13.495102  8639 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.499507  8434 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.514547  4213 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:13.497730  8653 consensus_queue.cc:1059] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:20:13.515600  8653 consensus_queue.cc:1243] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:20:13.496419  8657 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:20:13.500947  8472 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:20:13.517282  8472 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:13.517714  8472 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:13.503147  8436 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:20:13.487854  8611 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:20:13.497643  8540 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:13.522001  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.432309  8649 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:20:13.497143  8651 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:20:13.516180  8653 raft_consensus.cc:3055] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:20:13.529016  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 118409us
I20260709 13:20:13.490162  8213 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.492553  8602 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:13.533181  8434 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:13.534071  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.489899  8654 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:13.544870  4218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:13.553727  4218 raft_consensus.cc:606] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:13.555488  8607 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:13.555924  8607 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:13.554198  8399 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:13.538396  8653 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:13.557475  8386 raft_consensus.cc:3055] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:20:13.557920  8386 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:13.556866  8607 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:13.552263  4187 leader_election.cc:336] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.612s (SENT)
I20260709 13:20:13.558430  8653 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.562579  8653 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.517560  8432 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.558738  8386 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.564978  8432 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.565009  8386 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:13.567087  4138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ca04a09529497898d86f573a0e1189"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:13.567883  4138 raft_consensus.cc:606] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:13.568266  4138 raft_consensus.cc:614] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:13.571405  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.542441  7898 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.542984  8652 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.574890  8654 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:20:13.576764  8633 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.594s	user 0.006s	sys 0.000s
I20260709 13:20:13.574535  8559 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.542282  8614 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.574424  8649 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.574319  8613 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.575369  8540 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:13.607057  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.608453  4145 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:13.607002  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.609094  4139 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:20:13.611400  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.611701  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.612196  4145 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:13.614095  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.614722  4146 raft_consensus.cc:2376] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10. Re-sending same reply.
I20260709 13:20:13.612525  4139 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 7: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:13.599712  8319 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:13.616750  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:13.604277  8607 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.618067  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.619270  4146 raft_consensus.cc:606] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:13.625298  4146 raft_consensus.cc:614] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:13.608170  8442 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.621234  8319 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.605808  8230 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.626745  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.627585  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.632807  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.633204  4141 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.633734  4147 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.603876  8648 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:13.603504  8639 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:13.624419  4143 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:13.638358  4139 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.638710  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.613967  8489 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.631170  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.643409  4144 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:13.630616  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.631345  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.632814  4140 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:13.639511  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.639407  4143 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:13.647358  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.647991  4143 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 6: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:13.601006  8559 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.651393  4139 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:13.631309  8442 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.646279  8489 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.658038  8489 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.661012  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.661708  8442 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.608004  8649 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:13.661360  8668 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:20:13.665723  4140 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:13.672402  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.667927  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.673661  4143 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:13.674602  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.668392  4141 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:13.677335  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.678104  4140 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:13.603983  8652 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.613183  8540 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.595331  8654 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.670300  4147 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:13.681980  4146 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:13.683501  4138 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:13.686257  4217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:13.686589  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.686904  4217 raft_consensus.cc:606] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:13.687093  4140 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:13.687541  4147 raft_consensus.cc:2410] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:20:13.643348  8230 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.692864  4218 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:13.695729  8669 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:20:13.653856  8639 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.654302  8648 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.704746  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:13.712285  4144 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:13.705720  8559 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.681643  8592 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:13.709049  8605 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:13.709585  8319 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.716841  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:13.720405  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:13.718318  4142 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:13.715772  7898 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:13.721589  7898 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.720607  4144 raft_consensus.cc:2376] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11. Re-sending same reply.
I20260709 13:20:13.708177  8622 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.719659  8605 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:13.736147  8540 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.750031  8614 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.728643  7898 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.730641  8230 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:13.731637  8667 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:20:13.752291  8649 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.757104  8602 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.731758  4921 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
W20260709 13:20:13.732524  8670 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:20:13.734560  8648 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.738886  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:13.738831  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:13.765987  4920 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:13.734469  8660 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:20:13.739861  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:13.741319  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:13.741840  8371 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:13.742966  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:13.711153  8639 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.744469  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:13.744807  4187 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.909s (SENT)
I20260709 13:20:13.769804  4145 raft_consensus.cc:2410] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:20:13.767135  8592 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:13.772258  8652 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:13.838182  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:13.832785  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:13.840314  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.840459  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.815415  4213 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:13.798023  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.768569  4919 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:13.794442  4147 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:20:13.779639  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:13.771427  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:13.746199  8391 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:13.849750  4294 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:13.823563  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:13.830386  4140 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:20:13.832393  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:13.851256  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 77837.9us
I20260709 13:20:13.852121  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.834239  4291 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:13.835803  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:13.853696  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.760030  8602 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:13.839619  8670 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:13.829402  8585 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.842265  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.768786  8371 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:13.838152  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:13.880178  4296 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.845813  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:13.846858  4145 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:20:13.841071  4288 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:13.883540  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.885406  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:13.886893  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.854314  4926 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:13.856102  4222 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:13.862339  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.863412  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.838894  4289 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:13.867738  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.841635  4293 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:13.889431  4291 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:13.868167  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.889699  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.869777  4920 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:13.890303  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.874631  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.891417  4293 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:13.875012  4213 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:13.837978  8540 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.846457  8581 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.829079  8399 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:13.876606  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.896836  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:13.914448  4221 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:13.890717  4295 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:20:13.906390  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:13.907011  4291 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:13.846560  8640 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:13.919303  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:13.920449  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.908965  4293 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:13.912778  4259 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:13.913275  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:13.922806  4217 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:13.869928  8319 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:13.924248  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.846836  8489 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:20:13.907692  8651 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:20:13.938463  4296 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:13.898053  8602 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:13.941100  4294 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: []
I20260709 13:20:13.866474  8650 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:20:13.954962  8678 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.861864  8391 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:13.969437  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.853739  8605 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.898090  8585 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.947576  8213 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:13.912395  8540 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.997153  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.923805  8399 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.987901  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:14.001562  4215 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:14.001715  4141 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:20:13.990355  4147 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:20:13.982390  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:14.005270  4217 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:13.920609  8581 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:13.937031  8319 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:13.987726  4143 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:20:13.988600  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:13.997977  4220 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
W20260709 13:20:13.997937  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50221.9us
I20260709 13:20:13.995432  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:14.004453  4142 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:14.007951  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:14.008567  4928 raft_consensus.cc:2410] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:14.009298  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:14.015993  4214 raft_consensus.cc:2410] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:14.018919  4287 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:20:14.019711  4222 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:13.932277  8640 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.030612  4221 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:14.031145  4110 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:20:14.031714  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.032696  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:13.994962  8213 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:14.025251  4218 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:13.957124  8602 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.024119  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:14.018543  8319 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.057096  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:14.047235  4218 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:20:14.039989  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 127293us
I20260709 13:20:14.049546  4215 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
W20260709 13:20:14.066956  8673 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:20:14.043076  8622 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:14.070837  8640 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:14.071642  8640 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:13.963385  8371 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.079273  4186 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:14.082237  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:14.041062  8613 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:14.087672  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:14.089165  8386 consensus_meta.cc:287] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.523s	user 0.014s	sys 0.000s
I20260709 13:20:14.090421  8434 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:14.090936  8434 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.091320  8434 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.093801  8581 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:14.094748  8581 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:14.095351  8581 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.085793  8432 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:20:14.101399  8432 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:14.101858  8432 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:14.102733  8432 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.102957  8434 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.089213  8399 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:14.105027  8399 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:14.105453  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.105578  8399 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:14.086001  8676 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:20:14.118912  4261 leader_election.cc:336] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.587s (SENT)
I20260709 13:20:14.122110  4923 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 6.
I20260709 13:20:14.104103  8432 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:14.108158  8399 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:14.163833  4112 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:14.171012  4141 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:14.174017  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:14.084069  8622 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:14.087329  8655 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:14.155012  8607 consensus_meta.cc:287] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.005s
I20260709 13:20:14.116139  8613 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:14.206215  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:14.321885  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:14.165875  8371 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.158456  8467 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:14.331498  4185 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:14.209856  8230 raft_consensus.cc:2764] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:14.209193  8654 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.338411  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:14.247397  8614 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.205991  8655 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.179154  8434 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:14.181222  8653 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.169s
I20260709 13:20:14.247690  8399 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.328871  8679 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:20:14.183910  8617 consensus_queue.cc:1059] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
W20260709 13:20:14.349964  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 269641us
I20260709 13:20:14.171994  8213 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.356869  8435 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:20:14.337765  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:14.395294  4925 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:14.396026  4144 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:14.305649  8613 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:14.358479  8442 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:14.401784  4214 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:20:14.416584  4214 pending_rounds.cc:85] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 8
I20260709 13:20:14.416921  4214 pending_rounds.cc:107] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:20:14.417203  4214 raft_consensus.cc:2889] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.373271  8655 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.405313  8434 consensus_queue.cc:1059] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:20:14.425493  8602 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:14.425760  8434 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:14.426437  8434 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:14.399570  8399 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.392369  8622 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:14.431126  8399 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:14.424024  8213 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.434216  8617 raft_consensus.cc:3055] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:14.434742  8617 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:14.391836  8614 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:14.437171  8434 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.416083  8442 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.439759  4143 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:14.424749  8585 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:14.439126  8442 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.456537  8653 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:20:14.446506  8540 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:14.439082  8581 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:14.477528  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:14.485538  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.439059  8434 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:14.498644  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.504140  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:14.505048  4142 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:14.442744  8489 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:20:14.516080  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:14.520752  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 332011us
I20260709 13:20:14.521719  4142 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
W20260709 13:20:14.524675  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 288437us
I20260709 13:20:14.475803  8617 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:14.565689  8472 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:14.571617  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:14.508658  8467 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:14.568869  8663 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:14.591624  4142 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:14.623653  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 79615.8us
I20260709 13:20:14.626787  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:14.641173  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.624971  7898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.003s
I20260709 13:20:14.648736  4290 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:20:14.599336  8663 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:14.651611  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.658252  4291 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:14.654731  4290 pending_rounds.cc:85] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:20:14.658671  4290 pending_rounds.cc:107] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:20:14.596652  8693 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.658967  4290 raft_consensus.cc:2889] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.664659  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:14.660161  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.661197  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:14.666909  4296 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:14.667567  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.635330  8472 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:14.663594  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:14.633869  8580 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.670818  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 164176us
I20260709 13:20:14.669515  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:14.670890  4288 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:14.670297  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:14.654621  7898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.012s	sys 0.004s
I20260709 13:20:14.680585  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:14.681697  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.676539  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.680678  4142 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
W20260709 13:20:14.676007  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.681917  4291 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 6: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:14.676085  4288 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:14.683889  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:14.685087  4142 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:14.686679  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:14.687561  4142 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:14.688872  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:14.691370  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.694872  4142 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:14.699735  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.694962  4288 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:14.710232  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:14.711445  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.713280  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.701062  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.707499  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:14.704222  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.677561  8710 raft_consensus.cc:993] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:14.719725  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.738000  4289 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:14.699770  8230 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.761479  8691 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:20:14.766712  8638 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:14.767922  8638 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:20:14.772523  8688 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 13:20:14.775511  8703 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:20:14.779031  8432 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.613s	user 0.015s	sys 0.001s
I20260709 13:20:14.785625  7898 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:14.786212  7898 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:14.787264  7898 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.794364  8605 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:14.719832  8697 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.799427  4923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 579) took 1038 ms. Trace:
W20260709 13:20:14.799782  8702 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:14.741354  8707 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.799966  4923 rpcz_store.cc:276] 0709 13:20:13.761552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.770969 (+  9417us) service_pool.cc:224] Handling call
0709 13:20:14.799128 (+1028159us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400315bd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:14.799333 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570711424}
I20260709 13:20:14.814488  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:14.815423  4291 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.825867  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:14.673332  8693 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:14.690445  8580 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:14.784159  8686 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.320s	user 0.002s	sys 0.000s
W20260709 13:20:14.860484  8371 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.527s	user 0.016s	sys 0.000s
I20260709 13:20:14.803247  8710 raft_consensus.cc:1081] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:14.876993  8693 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:14.878687  8319 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.805s	user 0.012s	sys 0.000s
I20260709 13:20:14.878847  8655 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.879297  8319 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:14.881531  8655 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:14.755364  8230 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.869369  7898 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.740785  8663 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:14.854830  8707 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:14.926232  8704 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:14.927737  8663 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.954835  8467 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:14.973703  8613 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.524s	user 0.013s	sys 0.000s
I20260709 13:20:14.976964  8613 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:14.980268  8707 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:14.720824  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:15.028810  4140 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:15.029196  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.031098  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2332) took 1030 ms. Trace:
I20260709 13:20:15.039552  4290 raft_consensus.cc:2393] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:15.046257  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.031934  4147 rpcz_store.cc:276] 0709 13:20:14.000199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.004784 (+  4585us) service_pool.cc:224] Handling call
0709 13:20:14.028617 (+ 23833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.029277 (+   660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.029309 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.038237 (+  8928us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.482785 (+444548us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:14.507419 (+ 24634us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.507722 (+   303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.507817 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.914938 (+407121us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b1800314c20. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf5522 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:20:15.029986 (+115048us) raft_consensus.cc:1685] finished
0709 13:20:15.030302 (+   316us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.030779 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26379,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":669,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":8632,"spinlock_wait_cycles":12413184,"thread_start_us":395325,"threads_started":1,"wal-append.queue_time_us":502028}
I20260709 13:20:15.053200  4293 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:15.063376  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:15.066053  4110 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:15.071249  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:15.068935  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:14.960440  8213 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.528s	user 0.016s	sys 0.000s
I20260709 13:20:15.085898  8213 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:15.087028  8213 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.074950  8319 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:15.074887  8230 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.077739  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:15.081228  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:15.093537  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:15.094487  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:15.095618  4142 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:15.097416  8213 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:15.098337  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.099179  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.106258  4923 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:20:15.066715  4921 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
W20260709 13:20:15.115859  8442 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.001s
I20260709 13:20:15.117165  8442 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.121868  4259 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:15.122097  8442 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.123888  8442 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:20:15.124848  8442 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:15.126832  8442 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.127444  4926 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:15.129189  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:15.131690  8467 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.133513  8540 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.134078  8472 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.134886  8592 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:15.095625  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:15.145299  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:15.163743  8540 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.164177  8472 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.167614  8592 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.177078  8697 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:20:15.181183  8640 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.182374  8640 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.186661  8580 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:14.975971  8614 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:15.190124  8693 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:15.190690  4147 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:15.191079  8693 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.191751  8693 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.166987  8540 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:15.194799  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:15.204311  8613 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:15.206243  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:15.208760  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.207742  8640 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:15.234952  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.213822  4291 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:15.238206  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2339) took 1027 ms. Trace:
I20260709 13:20:15.253701  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:15.254027  4144 rpcz_store.cc:276] 0709 13:20:14.210434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.213727 (+  3293us) service_pool.cc:224] Handling call
0709 13:20:14.214217 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.406783 (+192566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.237487 (+830704us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54003d8954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:15.237957 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375086464}
I20260709 13:20:15.255071  4218 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:15.239271  4143 pending_rounds.cc:85] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 3
I20260709 13:20:15.257160  4143 pending_rounds.cc:107] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:20:15.257571  4143 raft_consensus.cc:2889] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:15.242949  4287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2322) took 1381 ms (client timeout 1732 ms). Trace:
W20260709 13:20:15.258551  4287 rpcz_store.cc:269] 0709 13:20:13.861093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.864032 (+  2939us) service_pool.cc:224] Handling call
0709 13:20:15.242398 (+1378366us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000b04d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:15.242663 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236918528}
I20260709 13:20:15.249533  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:15.247784  4928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42922 (request call id 576) took 1510 ms. Trace:
I20260709 13:20:15.281418  4928 rpcz_store.cc:276] 0709 13:20:13.737304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.738422 (+  1118us) service_pool.cc:224] Handling call
0709 13:20:15.247311 (+1508889us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54005f3cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:15.247561 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554099584}
I20260709 13:20:15.241323  8715 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:15.250792  8472 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.226436  8705 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:15.305675  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.249692  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 104540us
W20260709 13:20:15.323155  4111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.021s	sys 0.069s
I20260709 13:20:15.333527  8640 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:15.334762  8640 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.339284  8675 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:15.341403  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:15.341725  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:15.342959  8705 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.343791  8617 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:15.344646  8675 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.378798  8391 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.345618  8640 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:15.381321  4140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2335) took 1299 ms (client timeout 1695 ms). Trace:
W20260709 13:20:15.381888  4140 rpcz_store.cc:269] 0709 13:20:14.081722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.081907 (+   185us) service_pool.cc:224] Handling call
0709 13:20:15.380841 (+1298934us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400395dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:15.381189 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2171613056}
I20260709 13:20:15.385423  8675 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:15.346065  8705 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:15.335994  4110 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:15.387907  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:15.388353  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 52632.8us
I20260709 13:20:15.389182  8717 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:15.320708  8715 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:15.391232  8715 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.351161  4919 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:15.323048  8707 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:20:15.357095  4111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.022s	sys 0.070s
I20260709 13:20:15.363221  8721 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.364683  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2321) took 1588 ms. Trace:
I20260709 13:20:15.365692  8580 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:15.362731  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2342) took 1052 ms. Trace:
I20260709 13:20:15.366451  8607 raft_consensus.cc:993] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:15.397902  4140 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:15.405727  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2325) took 1493 ms. Trace:
I20260709 13:20:15.396909  8675 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:15.419143  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:15.419518  8675 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.408865  4146 rpcz_store.cc:276] 0709 13:20:13.775818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.777751 (+  1933us) service_pool.cc:224] Handling call
0709 13:20:13.778252 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.778730 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.778760 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.234294 (+1455534us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b1800362800. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbc32a6 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a
0709 13:20:15.234867 (+   573us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b2c00000c88. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:15.235793 (+   926us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.298878 (+ 63085us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:15.323162 (+ 24284us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.326981 (+  3819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.340975 (+ 13994us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.355746 (+ 14771us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:15.361806 (+  6060us) raft_consensus.cc:1685] finished
0709 13:20:15.362520 (+   714us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.364407 (+  1887us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4625,"prepare.queue_time_us":15588,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":5477,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":47477,"spinlock_wait_cycles":128374144,"thread_start_us":62452,"threads_started":1,"wal-append.queue_time_us":112482}
W20260709 13:20:15.438993  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.422251  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 712106us
I20260709 13:20:15.427752  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:15.396131  8592 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:15.422930  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:15.419303  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 646255us
I20260709 13:20:15.424755  8708 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:15.409840  4141 rpcz_store.cc:276] 0709 13:20:14.310031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.226119 (+916088us) service_pool.cc:224] Handling call
0709 13:20:15.226752 (+   633us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:15.242235 (+ 15483us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:15.242282 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:15.243247 (+   965us) log.cc:844] Serialized 52 byte log entry
0709 13:20:15.303334 (+ 60087us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:15.303426 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.303599 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.362300 (+ 58701us) raft_consensus.cc:1685] finished
0709 13:20:15.362325 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.362485 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14573,"raft.queue_time_us":15810,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":156,"thread_start_us":59030,"threads_started":1,"wal-append.queue_time_us":115556}
I20260709 13:20:15.464510  8642 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:15.465655  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:15.489257  4928 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:15.424389  8607 raft_consensus.cc:1081] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:15.468887  4138 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:15.452214  8391 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:15.472599  4215 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 4.
I20260709 13:20:15.424638  8640 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:15.473196  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:15.478179  8467 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:15.479043  8707 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.423285  8580 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.484798  4926 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:15.466315  8652 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:15.502293  8640 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.505914  8640 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:15.423640  8721 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.506246  8391 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.508971  8721 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.510241  8467 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.512698  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:15.513046  8652 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.515868  8652 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.516422  8707 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:15.520557  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.505940  4142 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:15.489045  8708 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:15.415468  4145 rpcz_store.cc:276] 0709 13:20:13.907297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.908440 (+  1143us) service_pool.cc:224] Handling call
0709 13:20:13.908804 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.909236 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.909278 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.921798 (+ 12520us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.352946 (+431148us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:14.693181 (+340235us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.783462 (+ 90281us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:15.310780 (+527318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.323846 (+ 13066us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.327274 (+  3428us) raft_consensus.cc:1685] finished
0709 13:20:15.400717 (+ 73443us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.400994 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34114,"prepare.queue_time_us":61738,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":78783,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":3041,"spinlock_wait_cycles":24768768,"thread_start_us":1125927,"threads_started":3,"wal-append.queue_time_us":520195}
W20260709 13:20:15.498309  8605 consensus_meta.cc:287] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.015s
I20260709 13:20:15.536013  8652 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.536572  4110 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:20:15.536872  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 71455.9us
I20260709 13:20:15.532940  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:15.537309  8467 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:15.539247  8663 consensus_meta.cc:287] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.013s
I20260709 13:20:15.540179  8648 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:15.541059  8550 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.541838  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2324) took 1675 ms. Trace:
I20260709 13:20:15.526981  8693 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.535059  8607 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:20:15.552577  8721 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:15.545197  8391 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.559834  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:15.554662  4112 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:15.545274  8707 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:15.571602  4147 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 5. Current term is 6. Ops: []
I20260709 13:20:15.575512  8721 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:15.577919  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 104979us
I20260709 13:20:15.580796  4928 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:15.561998  8717 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.571650  8386 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:20:15.555105  8319 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:20:15.584178  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.561167  4139 rpcz_store.cc:276] 0709 13:20:13.866086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.866307 (+   221us) service_pool.cc:224] Handling call
0709 13:20:13.866697 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.867115 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.867148 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.222005 (+1354857us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b2c00000c88. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:15.223021 (+  1016us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.313449 (+ 90428us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:15.352117 (+ 38668us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:15.539011 (+186894us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.539733 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.541055 (+  1322us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.541130 (+    75us) raft_consensus.cc:1685] finished
0709 13:20:15.541153 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.541389 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16603,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":194,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":28945,"spinlock_wait_cycles":60859648,"thread_start_us":272177,"threads_started":2,"wal-append.queue_time_us":110769}
I20260709 13:20:15.559274  8642 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.574121  8467 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:15.589365  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:20:15.598519  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.599205  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.609781  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:15.610775  4290 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.611123  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.611992  4288 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:15.577947  8640 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:15.622910  4290 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:15.617054  4291 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:15.627348  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 461) took 1029 ms. Trace:
I20260709 13:20:15.586014  8386 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:15.623332  4187 connection.cc:256] RPC call timeout handler was delayed by -1.5278950859999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
I20260709 13:20:15.612989  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.635190  8607 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.640875  8607 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.641297  8663 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.620962  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.643393  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.638231  4921 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:15.631946  4147 rpcz_store.cc:276] 0709 13:20:14.597593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.397466 (+799873us) service_pool.cc:224] Handling call
0709 13:20:15.397846 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.572503 (+174657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.626826 (+ 54323us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54003d9854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:15.627220 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393592704}
I20260709 13:20:15.642026  8663 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.650149  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2352) took 1230 ms. Trace:
I20260709 13:20:15.650611  4143 rpcz_store.cc:276] 0709 13:20:14.412727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.231657 (+818930us) service_pool.cc:224] Handling call
0709 13:20:15.232328 (+   671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.259067 (+ 26739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.259591 (+   524us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.261262 (+  1671us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.447593 (+186331us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:20:15.447655 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.447760 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.642445 (+194685us) raft_consensus.cc:1685] finished
0709 13:20:15.642472 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.642689 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":184428,"threads_started":1,"wal-append.queue_time_us":301601}
I20260709 13:20:15.618733  4292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
W20260709 13:20:15.652642  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.652925  4292 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:20:15.652959  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.612166  4295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:20:15.580430  8648 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.621407  8580 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:15.635141  8675 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:20:15.625618  8642 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.654213  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:15.661542  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 61439.4us
I20260709 13:20:15.639109  8386 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:20:15.673732  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.653481  4292 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:15.693025  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.621603  8550 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:15.652715  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:15.641345  8607 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.700598  4291 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:15.672726  8663 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.703538  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:15.707712  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:15.711692  4926 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:15.712713  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.693470  8693 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:15.687969  8605 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.722488  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.699750  4295 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.720009  4289 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
W20260709 13:20:15.735277  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.731364  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 78771.9us
I20260709 13:20:15.703862  8580 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:15.738788  4295 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:15.741863  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.694447  8640 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.738336  8663 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:15.648679  8717 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.722003  8550 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:15.750075  4290 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:15.723147  8319 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:15.760162  8580 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.713593  8467 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.687565  8721 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:15.770188  8731 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:20:15.772722  8648 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:15.780517  4919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 553) took 1572 ms (client timeout 1577 ms). Trace:
W20260709 13:20:15.781363  4919 rpcz_store.cc:269] 0709 13:20:14.207767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.208760 (+   993us) service_pool.cc:224] Handling call
0709 13:20:15.780092 (+1571332us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54006e0354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:15.780389 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456639360}
I20260709 13:20:15.788507  4186 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:15.790572  8717 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.789987  4042 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:15.790025  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:15.794149  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45519.6us
W20260709 13:20:15.796957  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 169644us
I20260709 13:20:15.762995  8605 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.811784  4144 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:15.817800  4187 connection.cc:256] RPC call timeout handler was delayed by -1.3722595290000754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 13:20:15.807035  8213 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:15.823909  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:15.818279  4187 connection.cc:256] RPC call timeout handler was delayed by -1.3322760250000556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25830000000000003s for a response
I20260709 13:20:15.814268  8652 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:15.827775  4187 connection.cc:256] RPC call timeout handler was delayed by -1.3048300929999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 13:20:15.830399  4290 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
W20260709 13:20:15.837921  4187 connection.cc:256] RPC call timeout handler was delayed by -1.191759139999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:20:15.838428  4187 connection.cc:256] RPC call timeout handler was delayed by -1.0418489779999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 13:20:15.812319  8319 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.839534  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:15.840433  8580 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:15.830278  8123 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:15.824059  8391 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:15.841979  8213 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:15.866062  4926 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:15.843927  8707 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.866987  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:15.868670  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 166647us
I20260709 13:20:15.871624  8707 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.877578  8605 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.878401  8605 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:15.879082  8640 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:15.878996  8605 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:15.880498  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.881121  8467 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:15.884992  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.769s (SENT)
I20260709 13:20:15.885509  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:15.885701  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:15.856138  8730 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:20:15.888901  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.885145  8213 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.874583  8707 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:15.895855  4893 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.866s (SENT)
I20260709 13:20:15.897821  4259 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:15.898844  4259 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:15.899597  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.904214  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.887573  8384 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:15.906363  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:15.906816  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:15.909713  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.913385  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 454) took 1462 ms. Trace:
I20260709 13:20:15.915030  4144 rpcz_store.cc:276] 0709 13:20:14.451476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.255490 (+804014us) service_pool.cc:224] Handling call
0709 13:20:15.385125 (+129635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.816717 (+431592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.912431 (+ 95714us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400395dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:15.913160 (+   729us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400395dd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:15.913317 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267533952}
I20260709 13:20:15.891080  8652 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:15.917948  4290 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:15.891463  8663 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:15.901141  8717 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.887420  8617 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:20:15.846714  8550 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.905777  8640 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:15.904840  8642 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:15.908408  8580 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:15.910764  8384 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:15.892277  8319 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.922943  8712 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.936810  4296 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:15.942535  4295 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.952991  8442 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:15.953576  8442 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.953972  8442 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:15.960585  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 73323us
I20260709 13:20:15.961941  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:15.913502  8123 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.965441  8605 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:15.966773  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.967657  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.967320  8123 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.974514  8648 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.974876  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.976389  4289 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:15.978801  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:15.979274  8705 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.980391  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:15.981698  8123 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:15.982220  8123 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.982824  8123 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.982300  8735 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.983515  8735 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:15.984004  8735 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:15.990584  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.993141  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:15.963979  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:15.996033  8648 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.920135  8391 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.000507  8391 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:15.950672  8580 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:16.009166  8391 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:16.009862  8580 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.004554  8712 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:15.939252  8640 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:16.012845  8640 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:16.014650  8712 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.019748  8607 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.945565  8384 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.021373  4042 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:16.023486  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1867643489999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 13:20:16.025189  8319 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.005039  8386 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:15.993072  8467 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.030041  8467 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.033119  4925 raft_consensus.cc:1240] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:20:16.037858  8386 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:16.024057  4042 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 9 to 12, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 12 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:16.038846  8467 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.039289  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:16.040364  4042 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.049147  4926 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:16.042268  8319 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:16.050223  8708 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.053596  4925 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:20:16.056190  8699 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:16.058137  8652 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:16.009933  8391 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.004989  4186 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.043548  8230 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:16.003692  4292 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:16.024078  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1714643489999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:20:16.102821  4295 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:16.104650  4293 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:16.048574  8648 consensus_queue.cc:1059] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:16.105358  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:16.056756  8708 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:16.103941  4261 connection.cc:256] RPC call timeout handler was delayed by -1.121964349000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 13:20:16.107950  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1075643490000857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:20:16.121789  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.123667  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 118806us
I20260709 13:20:16.126536  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.129536  4186 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.132766  4292 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:16.117530  8693 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:16.135354  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:16.137796  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 221539us
W20260709 13:20:16.140632  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 209536us
I20260709 13:20:16.132697  8712 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.130772  8467 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:16.120978  8652 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.131783  8721 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.135911  8717 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:16.122005  8735 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.143260  7898 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:16.138971  8707 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:16.169070  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:16.144057  8213 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:16.169382  7898 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.176772  4293 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:16.177127  7898 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.178774  8592 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:16.179989  4892 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:16.180799  8319 raft_consensus.cc:3055] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:20:16.181143  8391 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.181222  8319 raft_consensus.cc:740] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:16.182405  8391 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:16.182703  8319 consensus_queue.cc:260] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.184796  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:16.170310  8707 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:16.187602  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 82457.5us
I20260709 13:20:16.187412  8652 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.188812  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:16.153146  8467 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.143800  8123 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.195139  8213 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:16.193794  4042 catalog_manager.cc:5697] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 3 to 7, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 7 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.173259  8640 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.183432  8391 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.200616  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 304957us
I20260709 13:20:16.173592  8693 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.148842  8712 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.184291  8386 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.175143  4296 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:16.143615  8663 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:16.230083  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 113500us
I20260709 13:20:16.175091  8733 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:16.246747  4291 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
W20260709 13:20:16.292359  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.230142  8707 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:16.299455  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.292826  4290 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:16.242862  8319 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:16.247014  8213 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.238256  8467 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:16.260499  8580 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:16.294200  8386 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.285403  8605 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:16.315749  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.245713  8384 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.297511  8607 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:16.233698  8442 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.301556  8735 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.311167  8736 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:20:16.337504  8739 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:16.314441  8386 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.324645  8693 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:16.367542  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 74464.6us
I20260709 13:20:16.305891  8391 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:16.333685  8741 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:20:16.396811  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:16.336225  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:16.396981  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:16.358564  8652 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.339039  8712 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.404130  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:16.340039  8442 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.413529  8123 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.409955  4215 raft_consensus.cc:3060] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:16.418470  8391 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:16.431500  8467 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.346874  8747 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:20:16.413120  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:16.326181  8384 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.433017  8693 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:16.363372  8736 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:16.440275  4928 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:16.339581  8640 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:16.444032  4923 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.448689  4259 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:20:16.451046  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 152731us
I20260709 13:20:16.454394  8749 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:16.458786  8693 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.460023  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:16.463142  4928 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 7.
I20260709 13:20:16.461442  8693 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:16.465263  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:16.339267  8733 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.468603  4923 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:16.469708  4921 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:16.409801  4919 raft_consensus.cc:2376] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9. Re-sending same reply.
I20260709 13:20:16.472245  8467 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.408720  8605 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.476240  4187 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:16.488386  4185 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:16.494249  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.495870  4222 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:16.496923  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:16.497262  8733 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:16.498430  4041 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 174) took 31125 ms (client timeout 15000 ms). Trace:
I20260709 13:20:16.499022  8467 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.500634  8708 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:16.509904  8708 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.510349  8708 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:16.511201  8605 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.501327  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:16.501499  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:16.515965  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.501981  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:16.518478  4220 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:16.518374  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:16.503216  4221 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:16.519842  8648 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:16.521418  8648 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:16.504238  4042 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.523590  7898 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.523734  4042 catalog_manager.cc:5697] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.494504  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.526137  7898 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.526830  7898 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:16.527349  7898 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:16.528887  4921 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:16.463662  8663 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:16.535215  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.535051  8693 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:16.505425  8386 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.507059  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:16.551370  4923 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:16.508934  4213 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.515093  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:16.451373  8442 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:20:16.437479  8580 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.559186  7898 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.565667  8707 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.568698  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:16.570292  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52044.9us
I20260709 13:20:16.572674  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.573537  4214 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
W20260709 13:20:16.579664  8756 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:20:16.584154  4215 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
I20260709 13:20:16.585068  4221 raft_consensus.cc:1240] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 4. Current term is 5. Ops: []
I20260709 13:20:16.585198  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:16.585978  4290 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.534080  8663 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:16.588745  4213 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
W20260709 13:20:16.590955  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.599814  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:16.601603  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.605798  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.612154  4213 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.617216  4893 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:16.618912  8705 raft_consensus.cc:2804] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:16.619468  8705 raft_consensus.cc:697] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:16.620443  8705 consensus_queue.cc:237] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.621989  8708 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.624918  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:16.628497  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.629130  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:16.509258  4041 rpcz_store.cc:269] 0709 13:19:45.372879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.373228 (+   349us) service_pool.cc:224] Handling call
0709 13:19:45.384716 (+ 11488us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:16.498114 (+31113398us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:12.157895 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:12.158635 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:12.158681 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:20:12.158700 (+    19us) tablet.cc:662] Decoding operations
0709 13:20:12.160215 (+  1515us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:12.160315 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:12.194606 (+ 34291us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:20:12.196502 (+  1896us) tablet.cc:701] Row locks acquired
0709 13:20:12.196555 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:20:12.205752 (+  9197us) write_op.cc:270] Start()
0709 13:20:12.266590 (+ 60838us) write_op.cc:276] Timestamp: P: 1783603212196678 usec, L: 0
0709 13:20:12.266627 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:20:12.351941 (+ 85314us) log.cc:844] Serialized 6294 byte log entry
0709 13:20:12.925427 (+573486us) op_driver.cc:464] REPLICATION: finished
0709 13:20:13.135444 (+210017us) write_op.cc:301] APPLY: starting
0709 13:20:13.163255 (+ 27811us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:13.501731 (+338476us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:13.501871 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:13.620767 (+118896us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:13.661912 (+ 41145us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:20:13.661966 (+    54us) write_op.cc:312] APPLY: finished
0709 13:20:13.662489 (+   523us) log.cc:844] Serialized 148 byte log entry
0709 13:20:13.662722 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:13.662930 (+   208us) write_op.cc:454] Released schema lock
0709 13:20:13.663015 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:13.663533 (+   518us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:13.663571 (+    38us) write_op.cc:454] Released schema lock
0709 13:20:13.705036 (+ 41465us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ecdf32a 00007fee3ec64f14 00007fee3ec64ec3 00007fee3ec64e38 00007fee3ec64df3 00007fee3ec640dc 00007fee3ec8de16 00007fee3ec75cbb 00007fee3ec6039d 00007fee3ec63d75
Metrics: {"mutex_wait_us":2518917,"reported_tablets":41,"spinlock_wait_cycles":6266624,"child_traces":[["op",{"apply.queue_time_us":170029,"apply.run_cpu_time_us":27424,"apply.run_wall_time_us":534356,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71039,"num_ops":16,"prepare.queue_time_us":321187,"prepare.run_cpu_time_us":23310,"prepare.run_wall_time_us":446724,"raft.queue_time_us":139030,"raft.run_cpu_time_us":16473,"raft.run_wall_time_us":896214,"replication_time_us":595665,"spinlock_wait_cycles":130564480,"thread_start_us":589036,"threads_started":4,"wal-append.queue_time_us":289921,"wal-append.run_cpu_time_us":6498,"wal-append.run_wall_time_us":2031425}]]}
I20260709 13:20:16.631707  8640 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:16.632436  8640 raft_consensus.cc:697] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:16.602620  8467 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.588234  8592 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.633700  8640 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.634276  8467 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.637238  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:16.638089  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:16.638342  4287 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:16.638903  4293 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.588582  8736 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.640300  8736 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:16.640836  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:16.641544  4292 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.634408  8592 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.654914  4295 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:16.632200  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:16.595501  8707 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.662310  8749 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:16.663370  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.665305  4215 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:16.666523  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:16.640659  8733 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:20:16.652737  4290 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:16.587854  8693 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:20:16.683450  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.684957  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.681738  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:16.688611  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.692214  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.693483  4216 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:16.693107  8384 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:16.694903  8751 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:16.695529  8751 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:16.696722  8712 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:16.697351  8712 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.697813  8712 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.698279  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:16.699036  4296 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.700789  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:16.701637  4295 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:16.702824  8467 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.703343  4290 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:16.696059  8751 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.705788  8749 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.708768  4296 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
W20260709 13:20:16.712590  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 103727us
I20260709 13:20:16.672161  8717 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:16.726639  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:16.728679  4287 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:16.732913  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.733853  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 101835us
I20260709 13:20:16.710004  8707 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:16.734855  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.738473  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:16.738703  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 92510.4us
I20260709 13:20:16.739459  4215 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:16.643603  8752 consensus_queue.cc:1175] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" responder_term: 9 status { last_received { term: 9 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 9 index: 5 } }
I20260709 13:20:16.737845  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.741891  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.742585  4216 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:16.737609  8750 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.746421  8750 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.746539  8384 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:16.748436  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.734087  8708 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:16.754910  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:16.755873  4928 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:16.746421  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.747159  8384 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.757364  8384 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:16.757910  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.752337  8742 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:16.759446  8742 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:16.759917  8742 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.760528  8707 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:16.761690  8707 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.764151  8123 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:16.764848  8123 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:16.765059  8386 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.766019  8123 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.682590  8663 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.769088  7898 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.769719  8663 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.769980  7898 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.770594  8384 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.773747  4221 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:16.766487  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.780730  4215 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
W20260709 13:20:16.783695  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 73769.4us
I20260709 13:20:16.784960  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:16.786419  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.788933  4293 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:16.746934  8750 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.789811  4893 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:16.789422  4292 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:16.803066  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:16.792527  8607 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:16.793633  8746 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:16.794103  8384 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.792690  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.811954  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:16.797559  8592 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.797638  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:16.799516  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:16.803160  4928 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:16.810837  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:16.814029  4294 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:16.809398  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:16.812626  4293 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.814906  4215 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.817754  4185 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:16.818252  4287 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
W20260709 13:20:16.821615  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.817513  8733 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:20:16.823725  8762 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:16.824018  4213 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:16.808470  8386 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.809469  8746 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:16.837493  4290 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:16.845724  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.829553  8708 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:20:16.861781  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.836313  8755 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.341s	user 0.002s	sys 0.000s
W20260709 13:20:16.856109  4893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.601s (SENT) [suppressed 13 similar messages]
W20260709 13:20:16.861663  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 72453.1us
I20260709 13:20:16.829301  8580 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:16.864837  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:16.845770  8761 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:20:16.875182  4219 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:16.868393  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.834164  8386 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.871608  4215 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:16.856796  8746 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:16.877734  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 132849us
I20260709 13:20:16.860970  7898 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:16.878551  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.879954  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:16.880297  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 149241us
I20260709 13:20:16.883042  4216 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:16.878192  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.888875  4222 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:20:16.873839  8708 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:16.890499  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.874873  8717 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:16.892130  4215 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:16.878679  8386 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.882858  8607 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:16.898133  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.899075  4221 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:16.900874  4186 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.901373  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:16.902259  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.892870  7898 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:16.908397  8230 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.909811  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.916819  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.918207  8735 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:16.917243  8766 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:20:16.917091  8708 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.919972  8467 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:16.925136  4293 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:16.900713  8580 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:16.901588  8384 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:16.933019  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.933096  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:16.938784  4221 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:16.941470  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 61876.7us
I20260709 13:20:16.943763  8764 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:16.945230  4215 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:16.944654  8764 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.955158  8764 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:16.959417  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.959904  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.933627  8467 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:16.900520  8717 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:16.973157  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:16.963465  8467 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:16.986883  4187 connection.cc:256] RPC call timeout handler was delayed by -1.4676980790000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 13:20:16.987447  4187 connection.cc:256] RPC call timeout handler was delayed by -1.4106338320000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:20:16.974073  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:16.933676  8230 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.982517  8735 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:16.983490  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45421.4us
I20260709 13:20:16.938465  7898 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:16.907336  8751 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.009220  8384 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:17.012416  8712 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.013983  8757 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:17.014130  7898 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:16.972685  8580 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:17.030259  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 84996.2us
I20260709 13:20:17.005307  8230 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.028610  8607 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:17.038089  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:17.037887  8735 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.039309  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:17.040951  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:17.041776  8762 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:17.042330  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:17.042663  8762 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:17.043159  8762 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:17.043360  8640 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:17.043630  8762 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:17.044463  8773 log.cc:927] Time spent T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:20:17.023561  8467 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:17.023902  8757 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:17.062218  8717 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:17.063565  8712 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:17.064594  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:17.065428  8640 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:17.037954  8652 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:20:17.058979  8384 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.052857  8580 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:17.091149  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.095885  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 57914.7us
I20260709 13:20:17.103758  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:17.106560  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:17.115213  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 105332us
W20260709 13:20:17.115233  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 51493.6us
I20260709 13:20:17.101976  8764 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:17.141310  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 240507us
W20260709 13:20:17.147876  8736 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.000s
I20260709 13:20:17.155838  4147 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:17.158257  4213 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:17.148826  8607 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.152594  8774 raft_consensus.cc:2764] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:20:17.166221  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.153210  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.153911  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:17.167814  4144 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.164183  4222 raft_consensus.cc:2410] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:17.151935  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:17.168684  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:17.177493  4294 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:17.163049  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59392us
I20260709 13:20:17.179749  4143 raft_consensus.cc:2368] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:20:17.171139  8442 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:17.201889  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.205066  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.197391  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:17.186403  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.160248  8640 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.181142  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:17.240913  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 60057.6us
I20260709 13:20:17.243012  8648 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:17.244853  4292 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:17.218474  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.242215  8764 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:17.179152  8213 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.862s	user 0.013s	sys 0.009s
I20260709 13:20:17.257813  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:17.259656  4291 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.264747  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.258955  4145 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:20:17.278208  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.281693  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 237833us
I20260709 13:20:17.290580  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:17.297137  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 287456us
I20260709 13:20:17.283174  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:17.315320  4144 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:17.316313  8712 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:17.316951  8712 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.317322  8712 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.317907  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.318851  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.320845  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.321785  4140 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:17.327673  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:17.330349  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.330631  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.331426  4146 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
W20260709 13:20:17.332399  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 476302us
I20260709 13:20:17.332604  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.333426  4141 raft_consensus.cc:2368] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
W20260709 13:20:17.334295  8782 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:20:17.173928  8757 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.269234  8652 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:20:17.353255  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48649.9us
I20260709 13:20:17.271520  8213 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:17.380717  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 122045us
I20260709 13:20:17.258821  8750 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:17.351666  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.319911  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:17.529348  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.408311  8652 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:17.402078  4287 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:17.464125  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.451822  8693 raft_consensus.cc:2764] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:20:17.477437  8712 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.403007  8386 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:17.407778  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.401865  4218 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:17.451751  8764 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:17.397776  8742 consensus_meta.cc:287] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.004s
I20260709 13:20:17.429368  8391 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.437980  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:17.495162  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.417474  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 116874us
I20260709 13:20:17.382118  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.522449  4214 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:20:17.485010  4291 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:17.515763  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:17.508031  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:17.541712  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:17.544914  4893 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:17.544945  4138 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:17.553151  4144 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:17.557580  4146 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:17.552187  8652 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:17.586190  4139 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:17.588274  8391 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.591645  8213 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:17.587795  8742 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.594180  8742 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:17.594195  8391 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:17.592229  8386 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:17.595534  8764 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.602365  4294 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:17.605935  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:17.611254  4291 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:17.612936  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:17.614351  4288 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:17.600741  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59083.2us
I20260709 13:20:17.668862  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:17.689922  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.690955  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.691604  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.695432  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 108840us
I20260709 13:20:17.602928  8794 raft_consensus.cc:2764] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:17.601699  8617 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:17.707849  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 148406us
I20260709 13:20:17.709081  8652 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.710371  8652 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:17.712301  4921 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:17.694783  8715 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:20:17.713415  8592 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.713912  8592 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:17.716813  8796 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:20:17.720709  8712 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:17.694861  8580 raft_consensus.cc:2764] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 13:20:17.725845  8467 consensus_meta.cc:287] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.679s	user 0.015s	sys 0.001s
W20260709 13:20:17.727233  8793 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
W20260709 13:20:17.739320  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.742947  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:17.743041  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.743870  4296 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.748070  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:17.753523  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:17.754928  4294 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:17.759581  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:17.760673  4291 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:20:17.787686  4295 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:17.716243  8592 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:17.807207  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 65677.4us
I20260709 13:20:17.809464  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:17.810322  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 139079us
I20260709 13:20:17.740260  8617 raft_consensus.cc:697] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:17.811466  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:17.815464  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88494.7us
I20260709 13:20:17.816386  4295 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:17.820935  4112 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:17.698550  8795 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 13:20:17.811928  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:17.826793  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:17.827865  4295 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:17.809345  8794 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:17.827057  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 221253us
I20260709 13:20:17.840637  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:17.841883  4295 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:17.850878  4294 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:17.822223  8550 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:17.836441  8762 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.004s
I20260709 13:20:17.870123  8550 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:17.870642  8797 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:20:17.871086  8803 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:20:17.889844  8803 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:17.890321  8803 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:17.890734  8803 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:17.884756  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:17.903187  4296 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
W20260709 13:20:17.904624  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 73701.9us
I20260709 13:20:17.926235  4295 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:17.926402  4294 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:20:17.930807  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 110000us
W20260709 13:20:17.931890  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 64297.7us
I20260709 13:20:17.872170  8750 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:17.928448  8230 consensus_meta.cc:287] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.874s	user 0.016s	sys 0.009s
W20260709 13:20:17.936750  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 106102us
I20260709 13:20:17.852895  8794 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.914309  8804 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:17.943501  4213 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:17.942646  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:17.944031  8592 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:17.948614  8810 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:17.951640  8764 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:17.961421  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 94781.2us
I20260709 13:20:17.970773  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:17.975047  4294 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:17.871263  8762 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:17.976357  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:17.952989  8617 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:17.959052  8804 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.047936  4296 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:18.042752  4294 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:18.043751  4290 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:17.978976  8740 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:18.043918  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:18.045111  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 56306.3us
I20260709 13:20:17.955379  8230 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:18.059286  8746 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.168s	user 0.013s	sys 0.010s
I20260709 13:20:18.041548  8804 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.078861  4294 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:18.043634  8764 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.097827  8717 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:18.098374  8764 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.067704  8740 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:18.109421  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:18.094998  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57074.2us
W20260709 13:20:18.095666  8802 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
I20260709 13:20:18.114486  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:18.114658  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:18.119361  8803 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.130133  8803 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.098387  8717 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:18.134328  8717 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.135586  8717 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.135802  8550 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.141269  8794 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.141712  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.142925  8230 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.123136  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2665) took 1629 ms. Trace:
I20260709 13:20:18.124752  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.125490  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.145668  4141 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.146503  8795 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.147083  8795 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:18.032956  8810 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:18.126157  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.120667  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.149094  4140 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.149415  4138 raft_consensus.cc:2410] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:18.150167  8810 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:18.150738  8810 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.151177  8810 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.153136  8762 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:18.143961  4218 rpcz_store.cc:276] 0709 13:20:16.493202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.493568 (+   366us) service_pool.cc:224] Handling call
0709 13:20:16.494000 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.557512 (+1063512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.122648 (+565136us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54003c28d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:18.122992 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087271296}
I20260709 13:20:18.155498  8740 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:18.157497  8757 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.157727  8817 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:18.158345  8817 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.159099  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:18.161003  8817 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.077067  8746 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.169948  8746 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.170550  8746 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.170995  8746 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.172458  8814 raft_consensus.cc:2764] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:20:18.174566  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.175807  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:18.176424  4222 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.180507  8550 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.181102  8550 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.172049  8708 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:20:18.183127  8550 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.183619  8550 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:18.185418  4928 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:20:18.186375  8764 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.186620  4261 leader_election.cc:400] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:20:18.186960  8764 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:18.187402  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.187884  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:18.188438  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.188882  8693 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:18.189477  8764 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.190145  8592 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:18.201713  4141 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:18.210953  4222 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:18.212054  4140 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:18.215338  8640 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:20:18.227078  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.184105  8550 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.240563  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.242767  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.243219  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.245822  4144 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:18.244997  4146 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:18.249308  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.252005  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.252605  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.250211  4143 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:18.254820  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.255134  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.227056  8814 raft_consensus.cc:2764] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:20:18.255939  4141 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:18.273972  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.274199  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.329636  4919 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:18.330026  4147 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:18.330003  4139 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:18.330324  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:18.331157  8810 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.331205  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.276649  4140 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:18.281841  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.331974  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.313982  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:18.330005  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.332897  4141 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:18.333196  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.333581  4215 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:18.292788  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.289386  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.293493  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:18.298071  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.303278  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:18.304744  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:18.276396  8751 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.337635  4138 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.339538  4142 raft_consensus.cc:2410] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:18.334498  8814 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:18.340917  8814 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:18.312690  8757 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:18.343291  4146 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:18.343127  8757 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.305934  4294 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:18.313674  8746 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.313943  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:18.346789  4287 raft_consensus.cc:3055] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:18.311395  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:18.314880  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:18.347092  4287 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:18.314246  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.348728  4288 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:18.237110  8712 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:20:18.319075  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:18.353513  4292 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.353590  4288 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:18.323028  8715 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:18.355634  8715 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.357035  8442 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:18.357534  8442 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:18.327674  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.358019  8715 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.358722  4220 raft_consensus.cc:2410] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:18.358484  8442 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.328649  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.333847  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.328836  4218 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:18.359794  4141 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.275446  8795 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:18.331193  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.364436  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.364867  8442 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.365144  4142 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.365635  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:18.342046  8814 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.367581  8693 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.367733  8640 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:18.329636  4221 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:18.368310  8640 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:18.368160  8693 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.365082  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2670) took 1144 ms. Trace:
I20260709 13:20:18.369275  4290 rpcz_store.cc:276] 0709 13:20:17.220969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.221122 (+   153us) service_pool.cc:224] Handling call
0709 13:20:17.221607 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.050682 (+829075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.364811 (+314129us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54000ec254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:18.364984 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890163456}
I20260709 13:20:18.345376  8757 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:18.368861  8640 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:18.370275  8693 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:18.365774  8810 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:18.371675  4261 leader_election.cc:400] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8.
I20260709 13:20:18.318110  8550 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.348030  4287 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:18.373778  4287 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:18.375200  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.284394  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.376834  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.377562  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:18.313719  4923 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:18.335594  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:18.381201  4215 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.381402  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:18.382386  4147 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.324041  8804 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:18.385025  8783 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:18.385807  4139 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:18.386178  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.386364  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.393054  4140 raft_consensus.cc:2376] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15. Re-sending same reply.
I20260709 13:20:18.387513  4287 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:20:18.395925  4287 pending_rounds.cc:85] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:18.397022  4287 pending_rounds.cc:107] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:20:18.398046  4287 raft_consensus.cc:2889] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.399385  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:18.400892  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.401670  4213 raft_consensus.cc:2368] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:18.402604  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.403965  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.404793  4139 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:18.405681  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.406179  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.406519  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.387869  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.377673  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.390343  4293 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:18.409408  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.412279  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:18.413244  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.413498  4287 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:18.414491  4289 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:18.414696  4928 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:20:18.415695  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 48916.2us
I20260709 13:20:18.421396  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:18.422199  4290 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:18.423772  4296 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:18.428471  4141 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:18.432492  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.433205  4140 raft_consensus.cc:2376] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12. Re-sending same reply.
I20260709 13:20:18.436596  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.447830  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.448758  4143 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.449018  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:18.450913  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.452860  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.458490  4287 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:18.459306  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.460026  4140 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.458513  4292 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:18.463889  4186 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:18.466377  8757 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.466943  8757 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.467470  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.468294  4141 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:18.469384  8757 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:18.469524  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.472543  8750 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.473402  8750 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:18.474998  4219 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:18.434608  8715 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:20:18.473409  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.477669  4146 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.480726  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.481657  4214 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:18.483515  8715 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:18.483991  8715 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:18.484668  4218 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:18.485076  8712 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:18.484916  8715 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.485632  8803 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:18.486461  8715 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.486588  8803 consensus_queue.cc:1243] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:18.487512  8810 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:18.487903  8810 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:18.488862  8810 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.489822  8746 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:18.490312  8746 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:18.491189  8746 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:18.492928  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.484589  4215 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:18.496973  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:18.499101  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.497128  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.515626  4138 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:18.515228  4142 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:18.506974  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:18.517830  4143 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:18.518031  4140 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:18.518926  4147 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:18.524854  4145 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:18.505842  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:18.528108  4142 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:18.529122  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.526767  4294 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:18.531668  4139 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:18.536791  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.537879  4213 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:18.538502  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:18.539948  4140 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:20:18.542156  4042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 87) took 27747 ms (client timeout 15000 ms). Trace:
I20260709 13:20:18.550052  8391 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:18.543234  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2689) took 1621 ms. Trace:
I20260709 13:20:18.550781  4216 rpcz_store.cc:276] 0709 13:20:16.905148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.905274 (+   126us) service_pool.cc:224] Handling call
0709 13:20:18.519739 (+1614465us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54002ee854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:18.526285 (+  6546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3514352896}
I20260709 13:20:18.551535  4219 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:18.553143  4219 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:18.554448  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47534.4us
I20260709 13:20:18.550244  4138 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:18.476004  8640 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.566068  4221 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:18.556242  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:18.575245  4112 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:18.567663  4213 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:18.570660  4138 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:18.524646  8746 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.579454  4215 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:18.531240  8607 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:18.585256  4138 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:20:18.589555  4138 pending_rounds.cc:85] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 6
I20260709 13:20:18.589855  4138 pending_rounds.cc:107] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:20:18.590138  4138 raft_consensus.cc:2889] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.578578  4216 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:20:18.592514  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.486585  8712 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:20:18.600940  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 84245.7us
I20260709 13:20:18.554494  8319 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:18.616161  4218 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:18.619258  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.587687  8818 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:18.586687  8795 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:18.571225  8391 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:18.624183  4146 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
W20260709 13:20:18.542802  4042 rpcz_store.cc:269] 0709 13:19:50.795223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.797429 (+  2206us) service_pool.cc:224] Handling call
0709 13:19:52.012435 (+1215006us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:18.542041 (+26529606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:17.244759 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:17.245711 (+   952us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:17.245776 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:20:17.245797 (+    21us) tablet.cc:662] Decoding operations
0709 13:20:17.250299 (+  4502us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:17.250423 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:17.250455 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:20:17.251346 (+   891us) tablet.cc:701] Row locks acquired
0709 13:20:17.251404 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:20:17.251622 (+   218us) write_op.cc:270] Start()
0709 13:20:17.251818 (+   196us) write_op.cc:276] Timestamp: P: 1783603217251543 usec, L: 0
0709 13:20:17.251866 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:20:17.313112 (+ 61246us) log.cc:844] Serialized 2876 byte log entry
0709 13:20:17.943082 (+629970us) op_driver.cc:464] REPLICATION: finished
0709 13:20:18.093414 (+150332us) write_op.cc:301] APPLY: starting
0709 13:20:18.093539 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:18.099448 (+  5909us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:18.099574 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:18.261017 (+161443us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:18.261367 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:20:18.261432 (+    65us) write_op.cc:312] APPLY: finished
0709 13:20:18.261793 (+   361us) log.cc:844] Serialized 73 byte log entry
0709 13:20:18.267425 (+  5632us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:18.267610 (+   185us) write_op.cc:454] Released schema lock
0709 13:20:18.267698 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:18.268626 (+   928us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:18.268669 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":625430,"reported_tablets":18,"spinlock_wait_cycles":342930304,"child_traces":[["op",{"apply.queue_time_us":149927,"apply.run_cpu_time_us":13209,"apply.run_wall_time_us":175211,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33401,"num_ops":7,"prepare.queue_time_us":419635,"prepare.run_cpu_time_us":44245,"prepare.run_wall_time_us":272519,"raft.queue_time_us":205448,"raft.run_cpu_time_us":25765,"raft.run_wall_time_us":139628,"replication_time_us":691011,"thread_start_us":587701,"threads_started":4,"wal-append.queue_time_us":216867}]]}
W20260709 13:20:18.638375  4261 connection.cc:256] RPC call timeout handler was delayed by -2.1775714039999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23090000000000002s for a response
W20260709 13:20:18.641841  4261 connection.cc:256] RPC call timeout handler was delayed by -2.0032460959998843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:20:18.642475  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8799460959999124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:20:18.642856  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8754460959999051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:20:18.643234  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8754460959999051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:20:18.643602  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7069275460000881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:20:18.612279  8777 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.657071  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2688460959998338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28550000000000003s for a response
I20260709 13:20:18.657317  8762 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.658246  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2688460959998338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28550000000000003s for a response
W20260709 13:20:18.658631  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2580161220000718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:20:18.658969  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2211161220000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 13:20:18.659387  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2211161220000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:20:18.658584  8762 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.662683  8762 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:18.659636  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1230161220000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:20:18.663497  8391 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:18.664403  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0861161220000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:20:18.665103  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0267161219999252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:20:18.665627  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0267161219999252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 13:20:18.666890  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:18.670480  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.629521  8550 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:18.678752  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.618247  8708 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:20:18.704594  4146 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:18.649183  8607 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:18.650384  8818 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:18.673336  8795 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:18.727505  8824 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:20:18.728771  8795 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.729326  8818 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.682567  8550 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:18.733036  8550 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.734164  8550 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.735643  4218 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:18.743947  8607 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.639298  8742 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:20:18.635705  8764 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:20:18.717902  4144 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:18.681444  8762 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.726354  8640 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:18.727118  8750 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:18.801539  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 53444.8us
I20260709 13:20:18.802729  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:18.804896  8640 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.805286  8804 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.673867  8777 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.750530  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:18.809468  4218 raft_consensus.cc:2410] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:20:18.752257  4296 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:18.812494  8777 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:18.812733  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.813203  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:18.771917  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.784581  4220 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
W20260709 13:20:18.814827  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.785985  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:18.791174  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.813959  8762 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.761936  4294 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:18.687834  8735 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:20:18.814054  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.820266  4146 raft_consensus.cc:2376] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12. Re-sending same reply.
I20260709 13:20:18.821694  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.812184  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.822296  4146 raft_consensus.cc:2376] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12. Re-sending same reply.
I20260709 13:20:18.770764  4216 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:18.823102  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.823866  4146 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:18.828032  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:18.829274  4290 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.843461  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.845827  4146 raft_consensus.cc:2376] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12. Re-sending same reply.
I20260709 13:20:18.848816  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.853133  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:18.822578  8829 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.272s	user 0.004s	sys 0.000s
I20260709 13:20:18.866758  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:18.876111  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:18.876084  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 237105us
I20260709 13:20:18.880666  4146 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:18.885506  8757 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.885962  8813 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:20:18.887197  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.884987  4290 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:18.889367  4146 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:18.891110  4146 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:20:18.890980  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.891537  8814 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.891862  4145 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:18.816689  8740 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:20:18.884953  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:18.899667  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:18.898454  4138 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:18.902104  8813 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:18.903700  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.904633  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.905447  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:18.881974  8693 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:18.892095  8814 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:18.897395  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:18.919601  8810 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.904858  8804 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:20:18.929347  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.916358  8749 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.932183  4146 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:18.932508  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.893347  8708 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:20:18.914371  8712 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:20:18.923533  8663 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:20:18.937795  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:18.967691  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.968781  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:18.939039  8391 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:18.894770  8705 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:20:18.940111  8839 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:18.955135  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.953358  4138 raft_consensus.cc:2376] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13. Re-sending same reply.
I20260709 13:20:18.994661  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:18.995604  4138 raft_consensus.cc:2376] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13. Re-sending same reply.
I20260709 13:20:18.967275  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:18.971654  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:18.974509  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.978668  8751 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:18.985386  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 57246.9us
I20260709 13:20:18.996991  4146 raft_consensus.cc:2376] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10. Re-sending same reply.
I20260709 13:20:18.997071  4139 raft_consensus.cc:2376] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14. Re-sending same reply.
I20260709 13:20:19.004287  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.005338  4293 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:18.962288  8813 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:20:18.999691  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 58794us
I20260709 13:20:18.999442  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.016148  4261 leader_election.cc:400] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:19.016501  4261 leader_election.cc:403] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:19.012750  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.017302  4138 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:18.971547  8391 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.979655  8777 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:18.991360  8705 consensus_queue.cc:1243] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:19.029479  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:19.030874  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:19.031857  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.035840  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:19.054749  4138 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:19.057168  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.033933  8391 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.034852  8751 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:19.057958  4138 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
W20260709 13:20:19.159760  4187 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.656s (SENT)
I20260709 13:20:19.167759  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.167976  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:19.169605  4141 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:19.162243  8777 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:19.164148  8607 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:19.219041  4138 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 5.
W20260709 13:20:19.216548  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 187178us
I20260709 13:20:19.220562  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:19.221338  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:19.222204  4139 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:19.226677  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 165387us
I20260709 13:20:19.227603  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:19.229274  8735 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:19.233597  8844 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:20:19.238015  8851 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:20:19.245569  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.248492  4141 raft_consensus.cc:1275] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:20:19.255565  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 137416us
I20260709 13:20:19.262827  4216 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:19.263240  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.264525  4213 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:19.217190  8607 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:19.269379  8845 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:20:19.275843  4187 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.695s (SENT)
I20260709 13:20:19.276533  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:19.289919  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.291198  4141 raft_consensus.cc:2376] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 5. Re-sending same reply.
W20260709 13:20:19.299247  4893 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.601s (SENT)
I20260709 13:20:19.275373  8607 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:19.313609  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:19.320205  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47780.4us
W20260709 13:20:19.321633  4187 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.726s (SENT)
I20260709 13:20:19.200300  8813 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:19.287864  8747 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.311120  8640 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.505s	user 0.014s	sys 0.000s
I20260709 13:20:19.302677  8814 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:19.316956  8862 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:19.307227  8735 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:19.282109  8751 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:19.348977  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.339653  8640 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.356540  8852 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:19.358731  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2371) took 1113 ms. Trace:
I20260709 13:20:19.359050  4140 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:19.359449  4147 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:19.360546  8857 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
W20260709 13:20:19.361671  8849 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:20:19.361801  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2406) took 1010 ms. Trace:
I20260709 13:20:19.362140  4140 rpcz_store.cc:276] 0709 13:20:18.351600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.541377 (+189777us) service_pool.cc:224] Handling call
0709 13:20:18.585526 (+ 44149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.359516 (+773990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.361557 (+  2041us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54003dac54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:19.361746 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778141952}
I20260709 13:20:19.322623  8777 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:19.368767  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:19.369371  4146 raft_consensus.cc:2376] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 5. Re-sending same reply.
I20260709 13:20:19.369686  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:19.335014  8747 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:19.371387  4218 pending_rounds.cc:85] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 5
I20260709 13:20:19.371775  4218 pending_rounds.cc:107] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:19.372051  4218 raft_consensus.cc:2889] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.372128  8747 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:19.373564  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 51973.1us
I20260709 13:20:19.359125  4144 rpcz_store.cc:276] 0709 13:20:18.245579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.252626 (+  7047us) service_pool.cc:224] Handling call
0709 13:20:19.358490 (+1105864us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400068954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:19.358650 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636102912}
I20260709 13:20:19.423102  4139 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:19.424284  4138 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:19.374294  8783 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:19.438055  8783 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:19.469373  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.477816  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:19.472009  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 251446us
I20260709 13:20:19.495150  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.498380  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:19.499686  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.500607  4292 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:19.500488  8854 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:19.500939  8640 consensus_queue.cc:1059] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:19.501823  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:19.502842  4292 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:19.504076  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.505858  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:19.506292  8715 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.019s	user 0.005s	sys 0.010s
I20260709 13:20:19.507033  4145 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:19.506834  4292 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:19.514528  4292 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:19.519836  4288 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:19.520427  4292 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:19.522006  4290 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:19.527228  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2407) took 1175 ms. Trace:
I20260709 13:20:19.523145  4292 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:19.530265  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.542192  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 294156us
I20260709 13:20:19.542946  8809 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:19.543358  8809 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:19.543653  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.544571  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.548700  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:19.480492  8747 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:19.527691  4142 rpcz_store.cc:276] 0709 13:20:18.351842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.552962 (+201120us) service_pool.cc:224] Handling call
0709 13:20:18.553212 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.553394 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:18.831746 (+278352us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.019342 (+187596us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.526239 (+506897us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b180017c980. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee3bbf7a40 00007fee3bbf24e4 00007fee3bbf2455 00007fee3ecda060 00007fee3ecec716 00007fee3ecfd287 00007fee3ecfd208
0709 13:20:19.526655 (+   416us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.526812 (+   157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.526856 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:19.526906 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.526972 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.527168 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44571,"prepare.queue_time_us":357498,"prepare.run_cpu_time_us":150,"prepare.run_wall_time_us":159,"raft.queue_time_us":533266,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":8917120,"thread_start_us":405873,"threads_started":2,"wal-append.queue_time_us":441430}
W20260709 13:20:19.583536  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.488809  8812 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.596662  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:19.597424  4288 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.589147  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:19.598147  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48511.2us
I20260709 13:20:19.598874  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:19.597321  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 119522us
I20260709 13:20:19.603024  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.600019  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.605913  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.607553  8839 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:19.612610  4290 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:19.625908  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.624238  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.632476  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:19.633522  4139 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:19.634871  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.613195  8663 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:19.625274  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.495662  8863 consensus_queue.cc:1048] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:20:19.622860  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:19.630486  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 85283.3us
I20260709 13:20:19.585644  8794 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:20:19.678710  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:19.679392  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.679008  4290 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:19.686151  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.634282  8810 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:19.688298  8810 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:19.689146  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.689404  4140 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:19.690661  8810 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:19.690864  4290 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:19.695674  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:19.544472  8809 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:19.700011  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:19.706275  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.643383  8663 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.696328  4292 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:19.707587  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:19.709774  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 164438us
I20260709 13:20:19.712011  4216 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:19.633426  8467 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:20:19.714078  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:19.609560  8873 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.202s
I20260709 13:20:19.718806  4221 raft_consensus.cc:2393] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:19.715113  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.721958  4143 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:19.722273  4143 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:19.709542  8663 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:19.617980  8783 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:19.719576  8809 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:19.733909  8794 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:19.722941  4143 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:19.746022  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:19.726205  8391 consensus_meta.cc:287] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.562s	user 0.016s	sys 0.001s
I20260709 13:20:19.720713  8803 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:19.747258  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 131100us
I20260709 13:20:19.750236  8391 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:19.753000  8391 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:19.758970  8230 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:20:19.762025  8872 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:19.761531  4140 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:19.763402  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:19.764511  8869 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:20:19.766139  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.766431  8717 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:19.768059  8230 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:19.768329  8795 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:19.768514  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2396) took 1422 ms. Trace:
I20260709 13:20:19.769181  4147 rpcz_store.cc:276] 0709 13:20:18.345975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.535018 (+189043us) service_pool.cc:224] Handling call
0709 13:20:19.359132 (+824114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.359862 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.768237 (+408375us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b5400068950. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:19.768435 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790534912}
I20260709 13:20:19.775813  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:19.778602  8875 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:19.783224  4142 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:19.718294  8879 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:20:19.746414  8794 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:19.789109  8794 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:19.790014  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:19.790535  8794 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:19.790709  8607 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:19.799137  4288 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:19.801630  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.799292  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:19.808825  8886 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:19.812919  8607 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:19.829329  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.830389  8795 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:19.831180  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 209689us
I20260709 13:20:19.806418  8810 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.832325  8879 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:19.838058  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:19.843312  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:19.845842  4144 raft_consensus.cc:2368] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:19.863466  4111 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:19.847784  8886 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:20:19.867142  8607 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:19.870656  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.868309  8230 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:19.872910  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:19.869446  8818 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:19.885515  8750 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:20:19.897750  8795 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.880292  4040 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 15, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 15 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:19.899507  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:20.005314  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 105897us
I20260709 13:20:19.901873  8879 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.898805  8888 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:20:19.984216  4893 leader_election.cc:336] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.760s (SENT)
I20260709 13:20:19.923141  8712 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:20.006433  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 138116us
I20260709 13:20:20.015859  4187 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.016158  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:20.017760  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.021867  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.012560  8230 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:20:20.032526  8891 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:20:20.026131  8717 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:20.041049  4040 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 9, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 9 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:20.045997  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:20.046823  8898 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:20.027237  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.050932  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:20.049203  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 229169us
I20260709 13:20:20.055325  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.057189  8795 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:20.057834  8717 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:20.097121  8879 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:20.095536  8747 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:20.100306  8879 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.090348  8895 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:20:20.091394  8899 consensus_queue.cc:1059] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:20:20.106455  8899 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:20.106822  8899 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:20.026757  8886 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:20.108970  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:20.109411  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 63487.6us
I20260709 13:20:20.103086  8879 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:20.112738  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.096161  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:20.107630  8899 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.084169  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:20.117460  4139 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 8: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:20.095150  8663 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.118441  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:20.119048  4139 raft_consensus.cc:2376] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13. Re-sending same reply.
I20260709 13:20:20.119874  8663 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:20.066735  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:20.115690  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:20.142688  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:20.142542  4142 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:20.116230  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.144086  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:20.147509  8663 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:20.120317  8899 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:20.058303  8230 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:20.157099  8230 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.161828  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:20.162454  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:20.163667  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:20.165359  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:20.166127  4140 raft_consensus.cc:2376] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13. Re-sending same reply.
I20260709 13:20:20.167073  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:20.168220  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:20.164252  4146 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:20.175172  8717 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:20.175519  8712 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:20.178328  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.182217  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:20.184003  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:20.186069  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 687770us
I20260709 13:20:20.176119  8712 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.113668  4144 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:20.109920  4145 raft_consensus.cc:2376] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10. Re-sending same reply.
I20260709 13:20:20.188247  4146 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:20.189656  4140 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:20.120841  8213 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:20.201457  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.202643  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 46589.9us
I20260709 13:20:20.218957  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.024012  8818 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:20.221601  4218 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:20:20.222174  4218 pending_rounds.cc:85] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 9
I20260709 13:20:20.222398  4218 pending_rounds.cc:107] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:20:20.222616  4218 raft_consensus.cc:2889] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.211527  4139 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
W20260709 13:20:20.225026  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 525316us
I20260709 13:20:20.228327  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:20.229925  4287 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:20.049376  8898 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:20.228518  4296 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:20.248951  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:20.221591  8749 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:20.221664  8757 raft_consensus.cc:3055] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:20.241497  8888 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:20.266626  8806 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:20.221875  8742 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:20:20.276260  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:20.278755  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:20.250204  8213 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:20.290362  4142 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:20.256027  8855 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:20.291255  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75959.9us
I20260709 13:20:20.258342  8230 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:20.294409  8818 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:20.288229  8803 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:20:20.263736  8757 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:20.274844  8735 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:20:20.283345  8750 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:20:20.305533  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 82510.7us
I20260709 13:20:20.300511  8898 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:20.321398  4261 leader_election.cc:336] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.811s (SENT)
I20260709 13:20:20.291011  8749 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:20.317106  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53315.7us
I20260709 13:20:20.049587  4040 catalog_manager.cc:5697] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 10, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:20.309634  8818 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:20.396854  4187 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.405150  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.419651  4292 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:20.401423  8818 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.397691  8717 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:20.436177  8907 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:20.435902  8749 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.391961  8888 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:20:20.412310  8391 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:20:20.423465  8777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.018s	sys 0.003s
W20260709 13:20:20.445611  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 151227us
I20260709 13:20:20.424525  8905 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:20:20.398090  8213 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.500131  4040 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 10, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 10 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.505172  8800 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:20.509011  8783 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:20.414896  8757 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.513911  8757 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:20.439636  8717 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:20.302022  8855 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.522631  8855 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:20.503168  4040 catalog_manager.cc:5697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 9, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 9 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:20.573396  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 168285us
I20260709 13:20:20.576699  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:20.583405  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:20.584046  4292 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.519821  8712 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:20.542704  8777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.018s	sys 0.003s
I20260709 13:20:20.599828  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:20.601240  4294 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:20.592078  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 268194us
W20260709 13:20:20.587080  8865 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:20:20.582589  8794 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:20.581872  8648 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.591782  8752 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.616910  4220 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:20.629451  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:20.629702  8712 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:20.642524  8823 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.664215  8823 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:20.666049  8868 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.199s	user 0.012s	sys 0.007s
I20260709 13:20:20.667138  8823 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:20.645087  4292 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
W20260709 13:20:20.657622  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.667735  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2699) took 1692 ms. Trace:
I20260709 13:20:20.656735  8818 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.668140  4289 rpcz_store.cc:276] 0709 13:20:18.975381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.977326 (+  1945us) service_pool.cc:224] Handling call
0709 13:20:18.977629 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.119247 (+141618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.119288 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.163870 (+ 44582us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.441486 (+277616us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:19.441559 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.441662 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.665262 (+1223600us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:20.667356 (+  2094us) raft_consensus.cc:1685] finished
0709 13:20:20.667381 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.667649 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":218549,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":35224,"spinlock_wait_cycles":4714368,"thread_start_us":397336,"threads_started":2,"wal-append.queue_time_us":281868}
I20260709 13:20:20.670733  8818 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:20.672088  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:20.675006  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:20.675868  4218 raft_consensus.cc:2368] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:20.677591  4112 leader_election.cc:400] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:20.677948  4112 leader_election.cc:403] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:20:20.678684  8818 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.680816  8873 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.681663  8873 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.615342  8717 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:20.652663  8889 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:20:20.620651  8855 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:20.605100  8391 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:20:20.726451  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:20.747876  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 144999us
I20260709 13:20:20.750834  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.753789  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:20.757205  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2107) took 1069 ms. Trace:
I20260709 13:20:20.798750  4294 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:20.704202  8712 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:20.817975  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 67216us
I20260709 13:20:20.711835  8640 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:20.828665  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.736478  8818 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:20.706387  8752 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.691798  8648 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.849769  8871 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.756114  8855 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.850410  8858 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:20.848233  4111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.027s	sys 0.043s
I20260709 13:20:20.830688  8749 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:20.836704  8717 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.833114  8852 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:20.830153  8751 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:20.865880  4111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.028s	sys 0.043s
I20260709 13:20:20.838315  8854 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:20.810802  8750 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:20:20.874419  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 595684us
I20260709 13:20:20.834138  8712 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:20.866616  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.861073  8607 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.840894  8640 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.907016  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:20.868283  8764 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:20.871869  8751 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.867592  8391 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:20.868677  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 475) took 1525 ms. Trace:
W20260709 13:20:20.922401  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55883.8us
I20260709 13:20:20.929303  4141 rpcz_store.cc:276] 0709 13:20:19.343168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.343351 (+   183us) service_pool.cc:224] Handling call
0709 13:20:19.343802 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.583762 (+239960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.583807 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.890422 (+306615us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b2c00000c88. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:19.891002 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.014100 (+123098us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:20.038593 (+ 24493us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:20.864999 (+826406us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.868102 (+  3103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.868231 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.868292 (+    61us) raft_consensus.cc:1685] finished
0709 13:20:20.868312 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.868590 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":891895,"prepare.queue_time_us":620137,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":274237,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":20700,"spinlock_wait_cycles":17439360,"thread_start_us":377267,"threads_started":2,"wal-append.queue_time_us":141831}
I20260709 13:20:20.871623  8717 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.965400  8855 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:20.916038  8795 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:20.941425  4321 heartbeater.cc:646] Failed to heartbeat to 127.2.243.126:38007 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.243.126:38007 timed out after 15.000s (SENT)
W20260709 13:20:20.945039  8915 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:20:20.870086  8858 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.925387  8746 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:20.953150  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.927862  8751 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.905040  8818 consensus_queue.cc:1059] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:20:20.900439  8777 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:20.972668  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:20.870030  8871 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.916432  8607 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:20.840415  4040 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:20.910858  8823 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:20:20.985662  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:21.001560  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65448.9us
I20260709 13:20:21.009053  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:20.900214  8854 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:21.080729  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.938226  8764 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.160379  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:21.161790  4291 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.169070  8747 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:21.170033  8747 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.173331  4040 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 12, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 12 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:21.177112  8920 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:20:21.013705  8708 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:21.060189  8749 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:21.221407  8871 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:21.221728  8749 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.004819  8777 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.226927  8777 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:21.214329  8648 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.214600  8712 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:21.014263  8467 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.173s
I20260709 13:20:21.130741  8917 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.231875  8917 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.234460  8917 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:21.013464  8900 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.202s
I20260709 13:20:21.217420  8747 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:21.217536  8854 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:21.187248  8717 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.219165  8607 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.218214  4040 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 11, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 11 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:21.220948  8757 consensus_meta.cc:287] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.002s
I20260709 13:20:21.243520  4291 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
W20260709 13:20:21.065649  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 311943us
W20260709 13:20:21.254508  8899 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.057s	user 0.011s	sys 0.005s
W20260709 13:20:21.297873  8783 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.003s
I20260709 13:20:21.300686  8752 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.301939  8858 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:21.302568  8640 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:21.312209  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:21.248175  8812 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:20:21.376660  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 367699us
W20260709 13:20:21.384583  4893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.009s	sys 0.041s
W20260709 13:20:21.385246  4893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.009s	sys 0.041s
W20260709 13:20:21.402212  4288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.006s	sys 0.050s
W20260709 13:20:21.402611  4288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.006s	sys 0.050s
I20260709 13:20:21.320714  8764 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:21.316612  8708 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:21.317487  8823 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:20:21.385638  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 780288us
I20260709 13:20:21.410679  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:21.408113  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:21.415953  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 103804us
I20260709 13:20:21.417137  8854 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:21.426090  4928 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:20:21.421608  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 493204us
I20260709 13:20:21.426762  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:21.366520  8795 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.435485  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:21.437601  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:21.397970  8917 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:21.438783  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:21.400166  8777 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:21.462227  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.462710  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:21.465773  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.467736  4288 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:20:21.427341  8809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.022s	sys 0.052s
I20260709 13:20:21.441025  8899 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:21.441359  8640 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:21.396908  8812 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.480170  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:21.444677  8858 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:21.484957  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.489054  4294 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:21.454151  8757 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:20:21.475411  8809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.023s	sys 0.053s
I20260709 13:20:21.494897  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:21.490852  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:21.493723  4187 leader_election.cc:336] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.544s (SENT)
I20260709 13:20:21.501500  4187 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:21.494416  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.505322  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:21.431658  8823 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.473435  8917 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:21.521602  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:21.523177  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:21.517617  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:21.527405  4216 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:21.527609  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.528612  4288 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:21.506186  4214 raft_consensus.cc:2376] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9. Re-sending same reply.
I20260709 13:20:21.456568  8795 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.488104  8854 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:21.490870  8899 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:21.477099  8777 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.554422  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:21.510376  8818 consensus_queue.cc:1243] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:21.520706  8900 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.557591  4262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.021s	sys 0.037s
W20260709 13:20:21.648730  4262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.022s	sys 0.037s
I20260709 13:20:21.653028  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:21.622934  8873 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:21.529703  8735 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.497099  8749 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:21.569504  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 106886us
I20260709 13:20:21.569751  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:21.590716  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:21.660588  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:21.597401  8907 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:21.602417  8942 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:21.613040  8917 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.616101  8795 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.618211  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2722) took 1907 ms. Trace:
I20260709 13:20:21.617825  8899 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.683975  4217 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
W20260709 13:20:21.594319  8868 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:21.637527  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:21.593103  8818 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:21.562844  8467 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:20:21.518697  8708 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:21.690624  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.553342  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:21.691879  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 142281us
W20260709 13:20:21.645439  8810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.046s	sys 0.047s
I20260709 13:20:21.678881  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:21.419601  4040 catalog_manager.cc:5697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 6, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 6 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:21.694007  8810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.047s	sys 0.047s
I20260709 13:20:21.701401  4261 leader_election.cc:400] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:21.701782  8467 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.702571  8467 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:21.705054  8934 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:20:21.701820  4261 leader_election.cc:403] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:20:21.568158  4216 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:21.676957  8873 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.708729  8873 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.711205  8873 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:21.696287  8500 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:21.712116  8500 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.714726  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2725) took 1139 ms. Trace:
I20260709 13:20:21.715394  8500 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:21.697309  8777 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:21.716890  8854 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:21.715360  4289 rpcz_store.cc:276] 0709 13:20:20.575644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.670196 (+ 94552us) service_pool.cc:224] Handling call
0709 13:20:20.670570 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.978535 (+307965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.978585 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.010795 (+ 32210us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.591324 (+580529us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:21.591376 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.591459 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.714376 (+122917us) raft_consensus.cc:1685] finished
0709 13:20:21.714410 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.714638 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48962,"raft.queue_time_us":144197,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":12432,"thread_start_us":664011,"threads_started":2,"wal-append.queue_time_us":554899}
I20260709 13:20:21.719257  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:21.705619  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:21.681600  4220 rpcz_store.cc:276] 0709 13:20:19.710855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.710967 (+   112us) service_pool.cc:224] Handling call
0709 13:20:19.711251 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.655467 (+944216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.617763 (+962296us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54000271d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:21.618113 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082076544}
I20260709 13:20:21.682590  8749 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:21.706439  8467 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.726415  8854 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:21.699375  4040 catalog_manager.cc:5697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 8, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:21.726135  8777 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:21.722379  8864 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:21.682205  8907 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:21.743619  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 344902us
I20260709 13:20:21.742424  4216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:21.745757  8944 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:21.661787  4259 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:21.741868  8777 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:21.761112  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 186366us
I20260709 13:20:21.647789  8900 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.751494  8823 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.777042  4290 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:21.777573  4290 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:21.766570  8749 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:21.780985  8749 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:21.781383  8749 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:21.766780  8777 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:21.788110  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 308048us
I20260709 13:20:21.778560  4290 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.790303  4290 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.791718  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.767107  8944 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.792606  4141 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:21.794287  8944 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.785326  8818 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.794399  8950 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.794596  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.796145  4141 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:21.795975  8950 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.797761  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:21.798405  4141 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:21.773928  8795 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.799618  8795 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.801800  8795 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.808688  4141 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:21.809688  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.818482  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.819236  4142 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:21.819501  4146 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:21.816912  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.821317  4139 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:21.817320  4147 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:21.826005  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.827170  4147 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:21.828585  4141 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:21.831494  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.832868  4146 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:21.833164  4147 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:21.838775  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:21.842674  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.848183  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.849148  4139 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:21.849790  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.853217  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.854125  4139 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:21.854341  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.854933  4140 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:21.851009  4296 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:21.859391  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.860118  4145 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:21.858764  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:21.839110  8947 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:20:21.861792  4139 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:21.805546  8818 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.864614  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:21.815477  8950 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.875504  4140 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:21.878197  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.879029  4145 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:21.855165  8914 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:21.891076  4290 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:20:21.892042  4290 pending_rounds.cc:85] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:21.878003  8873 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:21.892490  4290 pending_rounds.cc:107] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:20:21.791015  4040 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.896150  4290 raft_consensus.cc:2889] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.877915  8752 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:21.902467  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.903659  4145 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:21.888511  8712 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:21.913359  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.917888  4296 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:21.919631  4292 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:21.921557  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.923380  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.924266  4292 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:21.914064  4140 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:21.926476  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.926847  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:21.927695  4296 raft_consensus.cc:2368] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:21.902362  8752 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.941095  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:21.942414  4145 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:21.955701  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.958371  8951 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:21.913098  8712 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.959069  8951 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.958877  4040 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:21.959805  8751 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.960s	user 0.014s	sys 0.001s
I20260709 13:20:21.960455  8751 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:21.961822  4217 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:21.963230  8751 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.964285  8900 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:21.968221  4216 raft_consensus.cc:606] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:21.968757  4216 raft_consensus.cc:614] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:21.977304  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.982380  4292 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:21.980582  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.985569  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.992440  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.994294  4292 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:21.894425  8914 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.997453  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:21.905145  8873 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:21.929940  8950 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.974468  8945 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:20:21.938862  8752 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.955315  8953 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.016456  4143 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:22.017066  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.026731  8812 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.006997  8950 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.029397  8950 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.030349  8951 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:22.012651  8956 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:20:22.012835  8953 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.040784  8907 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:22.042131  8941 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.422s	user 0.000s	sys 0.002s
I20260709 13:20:22.045989  8712 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.048494  8953 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:22.049687  8960 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:20:22.007441  8873 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.051594  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2731) took 1461 ms. Trace:
I20260709 13:20:22.051738  8752 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.054718  8752 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.055482  8914 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.056175  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.057207  8914 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:20:22.062223  8749 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.064064  4040 catalog_manager.cc:5697] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:22.066227  4040 catalog_manager.cc:5697] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.067834  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.084563  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:22.068221  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:22.071116  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.052112  4293 rpcz_store.cc:276] 0709 13:20:20.590154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.960656 (+370502us) service_pool.cc:224] Handling call
0709 13:20:22.050700 (+1090044us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800082598. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:20:22.050978 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.051219 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.051245 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.051288 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:22.051319 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.051375 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.051521 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39711488}
I20260709 13:20:22.088196  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.088948  4293 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:22.091377  4288 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:22.095095  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.097319  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:22.097996  4295 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:22.098300  4293 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.095474  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.094743  4143 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:20:22.101236  4143 pending_rounds.cc:85] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 8
I20260709 13:20:22.100114  8717 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:22.103035  8717 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.105950  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.094928  8942 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:22.107928  8777 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.096812  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:22.101616  4143 pending_rounds.cc:107] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:20:22.112303  8885 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:22.116044  4143 raft_consensus.cc:2889] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.116869  8942 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.135524  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.138727  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2101) took 2498 ms. Trace:
I20260709 13:20:22.139389  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.114001  8712 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.139394  4143 rpcz_store.cc:276] 0709 13:20:19.631549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.721558 (+ 90009us) service_pool.cc:224] Handling call
0709 13:20:19.721842 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.015955 (+2294113us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b58006cc5d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec3e0aa 00007fee3ecc0447 00007fee3ecd8fe7 00007fee3ecda7de 00007fee3ece4b49 00007fee3ece5416 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4
0709 13:20:22.129173 (+113218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.129840 (+   667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4388558208}
I20260709 13:20:22.145720  4293 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:22.136515  8230 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.133802  8749 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.117538  8752 consensus_queue.cc:1059] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:20:22.135727  8942 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.118268  8885 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.147408  8712 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:22.148584  8747 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:20.758143  4138 rpcz_store.cc:276] 0709 13:20:19.687709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.785426 (+ 97717us) service_pool.cc:224] Handling call
0709 13:20:19.785722 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:19.805261 (+ 19539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.805294 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:19.806033 (+   739us) log.cc:844] Serialized 52 byte log entry
0709 13:20:19.880545 (+ 74512us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:20.746985 (+866440us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.751337 (+  4352us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.756856 (+  5519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.756938 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.756984 (+    46us) raft_consensus.cc:1685] finished
0709 13:20:20.756996 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.757147 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":687147,"prepare.queue_time_us":753707,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":22944,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":193337,"threads_started":2,"wal-append.queue_time_us":46329}
I20260709 13:20:22.170954  8712 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.186959  4926 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:22.216662  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.161887  8230 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.208612  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:22.224490  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:22.182857  8777 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.171243  8907 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:22.175875  8818 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.181788  8942 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.184508  8717 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:22.241745  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.611s (SENT) [suppressed 55 similar messages]
I20260709 13:20:22.238571  4186 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:22.220662  8751 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:22.229413  8917 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:22.191414  8747 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.260254  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.284578  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.288955  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:22.238709  8749 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:22.237866  8746 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:22.308682  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.309549  4221 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:22.245293  8931 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:22.327512  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 89040.5us
I20260709 13:20:22.332422  4222 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:22.333822  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.360735  4219 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:22.361164  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:22.337005  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52861us
I20260709 13:20:22.309162  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.336477  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.362829  4220 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:22.278192  8917 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.364164  4220 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:22.239388  8907 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.327195  8929 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:22.374496  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.376744  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.161685  4040 catalog_manager.cc:5697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 6, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 6 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.306999  8742 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:22.381582  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.335285  8746 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.382437  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.360639  8736 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:22.357465  8467 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:22.326722  8751 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.390879  8747 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.334404  8749 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.399271  8907 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.399843  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.421010  4214 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:22.388561  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.370754  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.404621  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.405860  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.413779  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.417050  4220 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:22.424522  4222 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:22.369463  8917 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.408100  8735 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:22.429512  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.364830  8931 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.439505  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.432478  4215 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:22.437800  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.359679  4919 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.414028  8818 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:22.446913  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.450312  8749 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:22.451681  8969 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:20:22.455642  8967 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:20:22.458801  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:22.460465  8953 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:20:22.461283  8968 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:20:22.461732  8953 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:22.461897  8899 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:22.462212  8953 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:22.462811  8899 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:22.435734  8965 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:20:22.501237  8818 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.503649  8230 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.510147  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.511454  8899 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.512199  8818 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.514304  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.466248  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:22.467994  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:22.517023  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50894.1us
I20260709 13:20:22.470482  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.431546  8736 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:22.528940  8736 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.530929  8950 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:22.531548  8950 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.471633  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.532644  4289 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:22.476096  8717 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:22.533959  8950 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.534034  8717 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.419323  8742 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.534789  8319 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.535094  8810 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.535374  8319 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.535682  8810 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.537842  8319 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.463416  8953 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.534616  8717 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:22.538694  8319 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:22.539718  8916 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:22.486677  4040 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 8, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 8 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:22.489313  8972 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:22.540387  8916 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.539934  8319 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.491185  8751 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.493912  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 695) took 1018 ms. Trace:
I20260709 13:20:22.542625  4218 rpcz_store.cc:276] 0709 13:20:21.475845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.476000 (+   155us) service_pool.cc:224] Handling call
0709 13:20:21.476428 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.476908 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.476944 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.477477 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.610371 (+132894us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b48000fe358. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:20:22.244329 (+633958us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b18002ec5a0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e8820d1 00007fee3ec9da0f
0709 13:20:22.400571 (+156242us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:22.400611 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.400701 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.493614 (+ 92913us) raft_consensus.cc:1685] finished
0709 13:20:22.493635 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.493838 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11815,"raft.queue_time_us":117,"raft.run_cpu_time_us":3351,"raft.run_wall_time_us":131972,"spinlock_wait_cycles":10028800,"thread_start_us":155968,"threads_started":1,"wal-append.queue_time_us":1014162}
I20260709 13:20:22.545426  8951 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:22.546183  8951 consensus_queue.cc:1243] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:22.546698  8951 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:22.547032  8951 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:22.547477  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.549202  8742 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.549835  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.547936  8951 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.494058  8885 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:22.552742  4292 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:22.552811  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.496445  8746 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.436017  8467 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.541512  4040 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 10, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 10 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.556870  8914 raft_consensus.cc:3055] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:22.557411  8914 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:22.558452  8467 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.468967  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.472652  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.560041  8916 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.526078  8818 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:22.380707  8929 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.534571  8950 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.561905  8950 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.562809  8929 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:22.486272  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:22.487495  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:22.565023  8950 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.489607  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.558239  8914 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.606737  8914 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:22.607203  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.610611  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.611305  4294 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:22.560829  8953 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:22.565848  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 78479.5us
I20260709 13:20:22.613670  4185 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:22.614506  8746 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:22.615337  4185 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:22.541672  8735 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:22.552177  8951 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.617689  8735 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:22.569134  8916 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:20:22.569916  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.620661  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 378929us
I20260709 13:20:22.537937  8810 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.571017  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.571115  8467 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.573149  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.573540  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.574030  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.576982  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:22.580039  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.582396  8319 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.645834  4216 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:22.558284  4040 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 8, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 8 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:22.587214  8712 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:22.590318  8917 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.570284  8230 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.663174  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.623461  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.625590  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:22.626199  4261 leader_election.cc:336] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.657s (SENT)
I20260709 13:20:22.668067  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:22.632179  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.436180  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.643347  4293 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:22.654049  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.671401  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.672027  4139 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:22.672849  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:22.656922  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.673326  4139 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:22.659153  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.659838  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.661194  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.674032  4146 raft_consensus.cc:2376] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10. Re-sending same reply.
I20260709 13:20:22.673911  4142 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:22.674086  4141 raft_consensus.cc:2376] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12. Re-sending same reply.
I20260709 13:20:22.645022  4110 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:22.675388  4222 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
W20260709 13:20:22.631274  4187 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.502s (SENT)
I20260709 13:20:22.660997  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.676023  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:22.679858  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.621827  8916 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.684442  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.684514  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.666235  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:22.686491  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:22.691073  4142 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.691640  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:22.687892  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.623037  8746 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.688094  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.689563  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:22.700253  4143 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:22.695341  4215 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:22.694715  4144 raft_consensus.cc:2376] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13. Re-sending same reply.
I20260709 13:20:22.705919  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:22.705489  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 79350.7us
I20260709 13:20:22.684594  8950 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.710816  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:22.703524  8929 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.687460  8899 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:20:22.715813  8916 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.703819  8319 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.687652  8617 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:20:22.696993  8747 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:20:22.719314  8712 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:22.687868  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:22.719830  4139 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:22.685602  8230 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.697119  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:22.757568  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 60232us
I20260709 13:20:22.759665  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:22.709667  4186 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:22.730031  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:20:22.761636  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52088.9us
I20260709 13:20:22.731717  4144 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:22.763032  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:22.709734  4261 leader_election.cc:336] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.699s (SENT)
I20260709 13:20:22.739627  4142 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:22.676885  8717 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:22.742194  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 110974us
I20260709 13:20:22.763486  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.764575  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.768138  4142 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:22.774070  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:22.776552  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 66843.3us
W20260709 13:20:22.777488  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.778379  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:22.786840  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.791517  4291 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:22.793396  4139 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:22.758139  8899 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.795508  4294 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:22.756141  4214 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:22.797719  4288 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:22.771513  8746 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:22.800505  4145 raft_consensus.cc:2368] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15.
I20260709 13:20:22.771164  8319 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:22.814627  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.816030  4217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:22.821535  4217 raft_consensus.cc:606] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:22.742117  8885 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:20:22.823200  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:22.838701  8749 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:22.791345  8888 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.847402  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:22.796502  8712 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.800328  8873 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:22.819994  8746 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:22.883132  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.879570  4146 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:22.879577  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:22.819725  8319 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:22.885587  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51184.1us
W20260709 13:20:22.891299  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 124333us
W20260709 13:20:22.892822  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.850988  8885 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:22.898036  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.898784  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.899111  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.904866  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.905545  4140 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:22.905675  4293 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:22.900127  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.906481  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.901333  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.907552  4295 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:22.907413  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.881270  8749 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:22.908689  4290 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:22.913260  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:22.882685  8941 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:22.865391  8663 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.915001  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.874019  8951 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.916908  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.916461  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.942122  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.916944  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:22.864833  8917 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:22.896968  8319 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.921196  4141 raft_consensus.cc:2410] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:20:22.929646  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:22.959383  4140 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.959877  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:22.916316  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:22.965338  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49159us
I20260709 13:20:22.966218  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:22.932294  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:22.766273  4040 catalog_manager.cc:5697] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:22.891126  8746 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:22.934747  4187 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:22.935169  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.948082  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:22.923107  8916 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.933985  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:22.968066  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 73966.8us
I20260709 13:20:22.902601  8885 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:22.876528  8712 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:22.920573  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.976243  4893 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:22.977999  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 43654.4us
I20260709 13:20:22.989722  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:22.982331  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.979823  4140 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:22.983906  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:22.993211  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:23.009928  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:23.010865  4144 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.987536  8916 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.015900  8916 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.016736  8873 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.001572  8855 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:20:23.007915  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:23.009199  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:22.876005  8929 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:20:22.965034  8990 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:20:22.982236  8940 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:22.988160  8663 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:22.989019  8705 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.990799  8810 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.957346  8951 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.005088  8652 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:23.047129  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.000084  8931 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:23.051841  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.020434  8888 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:23.023470  8386 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:23.065640  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 84188.1us
I20260709 13:20:23.046979  8663 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.102092  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:23.107400  4144 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:23.109401  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:23.111052  4217 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:23.050385  8652 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.047753  8705 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.039265  8812 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.116242  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:23.144944  4214 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.050545  8747 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.067440  8717 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:23.128587  8977 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.333s	user 0.000s	sys 0.002s
W20260709 13:20:23.143265  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 91537.8us
I20260709 13:20:23.064167  8386 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:23.153084  8929 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:23.133167  8916 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:23.141569  4141 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:23.161568  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.112461  8663 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:23.049328  8749 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.158011  8617 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.143982  8705 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.138569  8931 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:23.138392  8652 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.204608  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:23.205214  4141 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:20:23.206945  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 247152us
I20260709 13:20:23.337437  4111 leader_election.cc:400] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:23.338636  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:23.207083  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.164299  4214 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:23.217747  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:23.339934  4289 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:23.285794  4293 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:20:23.201558  8988 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:20:23.206301  8386 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:23.166898  8994 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:20:23.347503  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 156426us
I20260709 13:20:23.354058  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:23.350582  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:23.202749  8929 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.293699  8855 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:23.295312  8818 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.155841  8812 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:23.115311  8885 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:23.340874  8931 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:23.377231  4288 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.009s
W20260709 13:20:23.378749  4288 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.009s
I20260709 13:20:23.355859  8747 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:23.386576  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2728) took 2801 ms. Trace:
I20260709 13:20:23.391849  4287 rpcz_store.cc:276] 0709 13:20:20.579868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.896443 (+316575us) service_pool.cc:224] Handling call
0709 13:20:20.896789 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.156919 (+260130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.156965 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.180780 (+1023815us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b1800317200. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbc32a6 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a
0709 13:20:22.206514 (+ 25734us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b2c00138c78. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:22.228946 (+ 22432us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.698595 (+469649us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:22.698641 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.710538 (+ 11897us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540042aed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:22.732117 (+ 21579us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.380666 (+648549us) raft_consensus.cc:1685] finished
0709 13:20:23.380688 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.380839 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1068,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":18873,"spinlock_wait_cycles":447626112,"thread_start_us":407959,"threads_started":1,"wal-append.queue_time_us":478523}
I20260709 13:20:23.352247  8994 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:23.291922  8916 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.331986  8617 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:23.374539  8855 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.346896  8991 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:20:23.187011  4040 catalog_manager.cc:5697] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:23.395896  8747 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.433116  8747 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.382517  8888 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:20:23.398808  8712 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.399168  8736 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 13:20:23.409162  8986 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:20:23.334038  8989 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:20:23.373025  8929 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.438465  8989 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:23.439008  8989 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:23.439460  8989 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:23.380446  8931 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.426476  8855 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:23.381474  8818 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.460587  8991 consensus_queue.cc:1243] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:20:23.470270  8982 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.450s	user 0.000s	sys 0.002s
I20260709 13:20:23.459565  8989 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:23.471514  8972 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:20:23.464620  8885 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:23.504021  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.546825  4292 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:23.506522  8735 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.888s	user 0.013s	sys 0.000s
I20260709 13:20:23.510943  8989 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:23.511919  8916 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.521548  8994 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.530320  8818 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.480834  8951 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.554646  8810 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.567673  8917 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.560688  8980 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:23.571408  8917 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:23.564545  8746 consensus_meta.cc:287] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.000s
I20260709 13:20:23.558949  8999 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:23.535987  8663 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:23.487972  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 283436us
I20260709 13:20:23.567812  8994 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:23.589730  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.597731  4289 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:23.573647  8917 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.585813  8999 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:23.614109  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.579938  8746 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.615505  8617 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:23.576356  8735 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:23.603009  9014 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.638468  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.601682  8992 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:20:23.645938  4222 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:23.653049  4215 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:23.657595  9005 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:23.705710  9005 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:23.706624  8735 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:23.667640  8873 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:23.708575  8873 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:23.709903  8873 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.711125  8873 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.632025  9004 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:23.651885  8705 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:23.713168  9005 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:23.674552  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 484) took 1024 ms. Trace:
I20260709 13:20:23.674862  4147 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:23.714030  4138 rpcz_store.cc:276] 0709 13:20:22.650074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.650186 (+   112us) service_pool.cc:224] Handling call
0709 13:20:22.650515 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:22.650888 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.650917 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:22.677317 (+ 26400us) log.cc:844] Serialized 52 byte log entry
0709 13:20:22.871337 (+194020us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:23.377653 (+506316us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.554432 (+176779us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.648459 (+ 94027us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b54004c0520. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec5d733 00007fee3ece2dbf 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c
0709 13:20:23.648550 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.648664 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.674133 (+ 25469us) raft_consensus.cc:1685] finished
0709 13:20:23.674185 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.674472 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219537,"prepare.queue_time_us":271875,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":5507,"raft.queue_time_us":217188,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6946,"spinlock_wait_cycles":15747200,"thread_start_us":600805,"threads_started":2,"wal-append.queue_time_us":262386}
I20260709 13:20:23.716022  4919 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:23.603235  8918 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index 3 to 8, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:23.719028  9004 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:23.719338  8812 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.719453  9004 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:23.719906  9004 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.687039  8929 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.688657  8999 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.715255  8705 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:23.631114  4040 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 9, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 9 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.700742  8230 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:23.722432  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84086.3us
W20260709 13:20:23.776018  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 404929us
I20260709 13:20:23.776993  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.723052  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2486) took 1029 ms. Trace:
I20260709 13:20:23.726892  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2471) took 1060 ms. Trace:
I20260709 13:20:23.778234  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:23.777925  4138 rpcz_store.cc:276] 0709 13:20:22.693878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.716198 (+1022320us) service_pool.cc:224] Handling call
0709 13:20:23.722432 (+  6234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.722649 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.722677 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.722724 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:23.722766 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.722825 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.722965 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.778565  4145 rpcz_store.cc:276] 0709 13:20:22.666863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.068482 (+401619us) service_pool.cc:224] Handling call
0709 13:20:23.128911 (+ 60429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:23.357572 (+228661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.357608 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:23.376236 (+ 18628us) log.cc:844] Serialized 52 byte log entry
0709 13:20:23.559581 (+183345us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:23.574064 (+ 14483us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.575949 (+  1885us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.584849 (+  8900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.584970 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.726586 (+141616us) raft_consensus.cc:1685] finished
0709 13:20:23.726614 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.726820 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9881,"prepare.queue_time_us":13511,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":23416,"raft.run_cpu_time_us":551,"raft.run_wall_time_us":41106,"thread_start_us":389357,"threads_started":2,"wal-append.queue_time_us":253932}
I20260709 13:20:23.782603  4145 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:20:23.750464  8319 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.005s
I20260709 13:20:23.785104  8319 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.752583  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:23.690126  8663 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.767225  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:23.774020  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:23.791447  4214 raft_consensus.cc:2393] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:23.792289  4145 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:23.795169  8319 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:23.799631  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2464) took 1135 ms. Trace:
I20260709 13:20:23.804996  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 705) took 1069 ms. Trace:
I20260709 13:20:23.806037  4215 rpcz_store.cc:276] 0709 13:20:22.735609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.735775 (+   166us) service_pool.cc:224] Handling call
0709 13:20:22.736051 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.704689 (+968638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.804715 (+100026us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54002ef754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:23.804928 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108195200}
W20260709 13:20:23.800155  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 449628us
I20260709 13:20:23.809574  4295 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:23.807662  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2468) took 1141 ms. Trace:
W20260709 13:20:23.817553  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 258341us
I20260709 13:20:23.817443  4140 rpcz_store.cc:276] 0709 13:20:22.666175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.013421 (+347246us) service_pool.cc:224] Handling call
0709 13:20:23.013799 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.128910 (+115111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.128946 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.129681 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.427576 (+297895us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:23.427948 (+   372us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.717181 (+289233us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b48002a0558. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:20:23.806974 (+ 89793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.807118 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.807196 (+    78us) raft_consensus.cc:1685] finished
0709 13:20:23.807328 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.807563 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147583,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":183591,"raft.run_cpu_time_us":5879,"raft.run_wall_time_us":658194,"spinlock_wait_cycles":11069696,"thread_start_us":642768,"threads_started":3,"wal-append.queue_time_us":396824}
I20260709 13:20:23.809330  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.813024  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:23.823038  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 469047us
I20260709 13:20:23.827316  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:23.813534  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2790) took 1014 ms. Trace:
I20260709 13:20:23.829357  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.831132  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:23.835711  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:23.835858  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:23.837836  4222 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:23.836943  4221 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.838291  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:23.835650  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:23.838326  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 493) took 1180 ms. Trace:
I20260709 13:20:23.805076  4146 rpcz_store.cc:276] 0709 13:20:22.665200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.999007 (+333807us) service_pool.cc:224] Handling call
0709 13:20:22.999347 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.999711 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.999738 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.009498 (+  9760us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.212916 (+203418us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:23.349423 (+136507us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.533838 (+184415us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b180042e8c0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee3bbf7a40 00007fee3bbf24e4 00007fee3bbf2455 00007fee3ecda060 00007fee3ecec716 00007fee3ecfd287 00007fee3ecfd208
0709 13:20:23.799216 (+265378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.799297 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.799345 (+    48us) raft_consensus.cc:1685] finished
0709 13:20:23.799446 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.799572 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37064,"prepare.queue_time_us":136602,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":3661,"raft.queue_time_us":262418,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":8246,"spinlock_wait_cycles":10744064,"thread_start_us":415830,"threads_started":2,"wal-append.queue_time_us":432689}
I20260709 13:20:23.839794  4147 rpcz_store.cc:276] 0709 13:20:22.658173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.658382 (+   209us) service_pool.cc:224] Handling call
0709 13:20:23.674437 (+1016055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.714096 (+ 39659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.838062 (+123966us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400069850. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:23.838272 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335617408}
I20260709 13:20:23.842119  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:23.811676  9016 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
I20260709 13:20:23.832974  4296 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 3 to 8, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:23.840170  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:23.721994  8931 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.850734  4219 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:23.830464  4294 rpcz_store.cc:276] 0709 13:20:22.798686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.798879 (+   193us) service_pool.cc:224] Handling call
0709 13:20:22.799196 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:22.817992 (+ 18796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.818041 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:22.835781 (+ 17740us) log.cc:844] Serialized 52 byte log entry
0709 13:20:23.351229 (+515448us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:23.802178 (+450949us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.812989 (+ 10811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.813126 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.813190 (+    64us) raft_consensus.cc:1685] finished
0709 13:20:23.813210 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.813443 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11143,"prepare.queue_time_us":205052,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":26744,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":13720,"thread_start_us":860418,"threads_started":2,"wal-append.queue_time_us":659042}
I20260709 13:20:23.849581  8213 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.864864  9022 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:23.865670  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:23.866086  9022 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:23.866851  9022 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:23.867233  9022 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:23.867758  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:23.868562  8319 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:23.871965  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:23.873494  4112 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:23.850361  9024 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:23.874938  8997 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:23.875334  9024 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:23.875445  8997 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:23.875978  9024 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.876291  8997 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.876593  9024 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:23.877206  4040 catalog_manager.cc:5697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:23.879123  4040 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:23.827524  8749 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:23.882619  8749 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.827347  8500 consensus_queue.cc:1059] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:20:23.887022  8746 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:23.890146  8386 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.002s
I20260709 13:20:23.890703  8386 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:23.893193  8652 consensus_meta.cc:287] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.543s	user 0.014s	sys 0.000s
W20260709 13:20:23.893394  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 64130.4us
I20260709 13:20:23.883078  8749 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.894358  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.893213  4923 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:23.899173  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:23.905057  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 66436.9us
W20260709 13:20:23.905180  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46600.6us
I20260709 13:20:23.907049  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:23.893801  8997 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.841694  9014 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:23.920393  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2485) took 1250 ms. Trace:
I20260709 13:20:23.917387  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:23.923120  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2484) took 1253 ms. Trace:
I20260709 13:20:23.920830  4139 rpcz_store.cc:276] 0709 13:20:22.670348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.531548 (+861200us) service_pool.cc:224] Handling call
0709 13:20:23.532028 (+   480us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:23.566935 (+ 34907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.566996 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:23.578888 (+ 11892us) log.cc:844] Serialized 52 byte log entry
0709 13:20:23.803370 (+224482us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:23.861224 (+ 57854us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.870675 (+  9451us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.920070 (+ 49395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.920147 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.920185 (+    38us) raft_consensus.cc:1685] finished
0709 13:20:23.920195 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.920321 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131941,"prepare.queue_time_us":66479,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":49613,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":375,"thread_start_us":198215,"threads_started":1,"wal-append.queue_time_us":205159}
I20260709 13:20:23.895048  8992 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:23.932415  4142 rpcz_store.cc:276] 0709 13:20:22.670111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.477987 (+807876us) service_pool.cc:224] Handling call
0709 13:20:23.478405 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:23.561108 (+ 82703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.561140 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:23.567194 (+  6054us) log.cc:844] Serialized 52 byte log entry
0709 13:20:23.804674 (+237480us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:23.912721 (+108047us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.922809 (+ 10088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.922886 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.922928 (+    42us) raft_consensus.cc:1685] finished
0709 13:20:23.922939 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.923065 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141440,"prepare.queue_time_us":65214,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":31,"raft.queue_time_us":108966,"spinlock_wait_cycles":5744512,"thread_start_us":260279,"threads_started":2,"wal-append.queue_time_us":226877}
I20260709 13:20:23.927762  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2483) took 1257 ms. Trace:
W20260709 13:20:23.944830  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.945204  4143 rpcz_store.cc:276] 0709 13:20:22.669878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.443011 (+773133us) service_pool.cc:224] Handling call
0709 13:20:23.443334 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.800913 (+357579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.800954 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.801553 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.843313 (+ 41760us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b48002a0558. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:20:23.925806 (+ 82493us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:23.925854 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.925931 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.927497 (+  1566us) raft_consensus.cc:1685] finished
0709 13:20:23.927519 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.927705 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129026,"raft.queue_time_us":128825,"raft.run_cpu_time_us":2832,"raft.run_wall_time_us":277397,"spinlock_wait_cycles":2916224,"thread_start_us":369562,"threads_started":2,"wal-append.queue_time_us":124074}
I20260709 13:20:23.914929  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.948791  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2477) took 1280 ms. Trace:
I20260709 13:20:23.949301  4141 rpcz_store.cc:276] 0709 13:20:22.668342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.338252 (+669910us) service_pool.cc:224] Handling call
0709 13:20:23.338632 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.339119 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.339160 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.348694 (+  9534us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.727464 (+378770us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:23.812017 (+ 84553us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.812354 (+   337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.812477 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.948515 (+136038us) raft_consensus.cc:1685] finished
0709 13:20:23.948542 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.948702 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204197,"prepare.queue_time_us":84992,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2204,"raft.queue_time_us":11389,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":30512,"thread_start_us":340637,"threads_started":1,"wal-append.queue_time_us":380420}
W20260709 13:20:23.957391  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58292.3us
I20260709 13:20:23.959092  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:23.904860  9015 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:23.893731  8652 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.876106  8855 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.918071  9014 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.921458  8929 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:23.919878  8989 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:23.970430  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 64111.3us
I20260709 13:20:23.974515  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:23.923188  9023 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:23.949119  8992 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.916715  8617 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:20:23.928452  8899 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:20:23.967332  9015 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:23.968744  8735 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:23.982342  4138 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:23.911859  9013 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:20:23.968202  8230 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.967916  9021 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:23.980446  8717 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:23.978307  8873 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:24.002529  4221 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:23.981515  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:23.992650  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2133) took 1079 ms. Trace:
I20260709 13:20:23.973888  9014 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.868145  9022 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:23.973148  8990 consensus_queue.cc:1059] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:23.976609  8989 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:23.986004  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.021075  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:24.022028  4221 raft_consensus.cc:606] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.004216  4145 rpcz_store.cc:276] 0709 13:20:22.913627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.793643 (+880016us) service_pool.cc:224] Handling call
0709 13:20:23.794061 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.794509 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:23.843992 (+ 49483us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.992199 (+148207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.992261 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:23.992313 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.992417 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.992579 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29611,"prepare.queue_time_us":75013,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":5739,"thread_start_us":140741,"threads_started":1}
I20260709 13:20:23.982220  8992 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.972608  8213 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:20:23.987550  8953 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:24.011556  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:24.018504  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 103706us
I20260709 13:20:24.037158  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:24.038749  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:24.041335  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:23.989786  9015 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.044016  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:24.056592  9021 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:24.057591  8997 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.026039  8989 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.062079  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2495) took 1260 ms. Trace:
I20260709 13:20:24.062461  4138 rpcz_store.cc:276] 0709 13:20:22.802030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.797821 (+995791us) service_pool.cc:224] Handling call
0709 13:20:23.798143 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.989005 (+190862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.061857 (+ 72852us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540044a054. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:24.062024 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423109504}
I20260709 13:20:24.064914  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.065717  4288 raft_consensus.cc:2393] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:24.060307  8213 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:24.066097  8213 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:24.066900  8213 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.067966  8213 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.069798  8652 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.008262  8735 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:24.008782  8873 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.073495  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.042932  8929 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:24.076851  8873 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.042701  8386 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.046101  8319 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:20:24.088092  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 156517us
I20260709 13:20:24.008468  8230 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.093364  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.094182  4288 raft_consensus.cc:2410] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:20:24.095594  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.099879  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:24.101202  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:24.083806  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.078426  9004 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.106590  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:24.110621  8995 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.106513  9013 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.113812  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:24.175879  4219 raft_consensus.cc:606] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.110621  8735 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.125278  8855 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.195255  8855 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:24.128484  9027 raft_consensus.cc:3055] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:24.130858  8500 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:24.131248  8230 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.139067  8873 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.141873  4892 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.142421  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44870 (request call id 0) took 3251 ms. Trace:
I20260709 13:20:24.151084  8931 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.088651  8652 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:24.152245  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:23.999935  4040 catalog_manager.cc:5697] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 10, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 10 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:24.091240  8929 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:24.100190  8994 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.005s
I20260709 13:20:24.108925  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:24.162339  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 78658.9us
I20260709 13:20:24.232481  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.163339  4186 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:24.167192  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:24.234187  4214 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:24.169814  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:24.236727  4222 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:24.173015  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:24.174902  9004 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.188656  9037 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:24.175418  8995 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.175729  9013 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.184084  8916 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:24.224498  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 72352.2us
W20260709 13:20:24.267369  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.226317  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 84572.2us
I20260709 13:20:24.243801  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.211333  8746 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:24.255604  9035 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:20:24.213439  8500 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:24.256296  8873 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.173089  8899 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:20:24.211766  9027 raft_consensus.cc:740] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:20:24.258683  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 95487.2us
I20260709 13:20:24.213761  8855 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.277613  4214 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:24.295123  8751 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:24.295599  8751 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:24.221199  8918 rpcz_store.cc:276] 0709 13:20:20.890720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.891019 (+   299us) service_pool.cc:224] Handling call
0709 13:20:22.161530 (+1270511us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b18003fcba0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ed1d73d 00007fee3ece8f3f 00007fee3ece86b3 00007fee3ece09fa 00007fee43ca84c9 00007fee3d224c54 00007fee3d224be2 00007fee3d224b11 00007fee3d224a8c 00007fee3d223d42
0709 13:20:22.271899 (+110369us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b54005f44a0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec57a1d 00007fee3ec3e1a4 00007fee3ecc0447 00007fee3ecdd70a 00007fee3ecde76a 00007fee3ecdd91b 00007fee3ece903c 00007fee3ece86b3 00007fee3ece09fa 00007fee43ca84c9
0709 13:20:22.478830 (+206931us) log.cc:844] Serialized 494 byte log entry
0709 13:20:22.602076 (+123246us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b58005d17d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3ec3c43c 00007fee3ec42d53 00007fee3ec42cd9 00007fee3ec42c69 00007fee3ec42c31 00007fee3ec41dfd 000000000038f354 000000000038f199 00007fee3bbf5475 00007fee3bbf77c1
0709 13:20:24.142295 (+1540219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":339,"raft.run_cpu_time_us":1298,"raft.run_wall_time_us":4731,"spinlock_wait_cycles":222124928,"thread_start_us":113697,"threads_started":1,"wal-append.queue_time_us":110596,"wal-append.run_cpu_time_us":2633,"wal-append.run_wall_time_us":1011820}
I20260709 13:20:24.298854  8751 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.300133  8751 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.281184  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:24.278527  8652 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:24.304891  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.285795  8917 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:24.231323  8973 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:24.228595  8230 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:24.285667  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 245580us
W20260709 13:20:24.275211  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.257404  8995 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.322643  8749 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.266273  9013 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.307166  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.329686  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:24.272037  4112 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:24.285207  9023 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:24.289952  8319 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:24.337291  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 65400.2us
I20260709 13:20:24.330667  8751 raft_consensus.cc:993] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:24.338804  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:24.330924  8812 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:20:24.359614  4214 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:24.303828  8929 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.346670  8855 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:24.347267  9027 consensus_queue.cc:260] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.349833  4029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a35e1cee8a15436dbfaf75dd67824aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:20:24.351401  8319 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.311760  8916 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:24.288857  8746 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.354815  8500 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.353528  4040 catalog_manager.cc:5697] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 3 to 4, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 4 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:24.317808  8899 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:24.398808  8899 raft_consensus.cc:1081] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
W20260709 13:20:24.388235  4029 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 53886.7us
W20260709 13:20:24.401928  8885 consensus_queue.cc:1175] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34e6205f3c1d434193126fef20d73800" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:24.377717  8751 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:24.337468  8917 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:24.377991  8953 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:24.410640  8953 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:24.392643  9027 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:24.411543  8319 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.412716  9014 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.396620  8749 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.396816  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:24.397222  8500 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:24.397754  8992 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.356537  8230 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:24.337689  8989 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.388813  9025 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:24.395332  8746 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:24.429777  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 122446us
I20260709 13:20:24.335891  9024 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.385967  8929 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.442565  8873 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:24.443476  8873 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.446424  8873 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:24.447343  8873 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:24.448911  8749 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:24.449616  8749 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.451004  9022 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:24.453069  8230 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.439061  9025 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.461925  9025 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.452276  8749 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.464743  4296 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:24.466457  8989 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:24.471158  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.473069  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:24.474951  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:24.478679  8990 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.482535  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:24.484082  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.485239  4288 raft_consensus.cc:2410] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:20:24.485368  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:24.486416  4290 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.488368  4295 pending_rounds.cc:85] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:20:24.488577  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.488925  4295 pending_rounds.cc:107] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:24.489426  4295 raft_consensus.cc:2889] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.490302  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:24.490922  4291 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.492429  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.493078  4289 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:24.493279  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 163710us
I20260709 13:20:24.495004  4288 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:24.498943  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:20:24.508649  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.514591  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:24.524717  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.526202  4292 raft_consensus.cc:2410] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:20:24.447962  8873 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:24.563639  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69551us
W20260709 13:20:24.482314  9051 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:20:24.574002  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 75124.9us
I20260709 13:20:24.411603  8953 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.493906  8855 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.583127  4291 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:24.590498  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:24.479386  8990 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.578264  8812 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:24.593945  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:24.514133  9037 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.593672  8717 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.513913  9038 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.603961  4296 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:24.609282  4291 raft_consensus.cc:1240] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:24.574364  8950 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.606997  9023 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:24.615528  8652 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.621497  9023 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.621942  8652 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.623977  9023 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:24.624817  8806 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.602130  8747 raft_consensus.cc:993] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:24.606137  4290 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:24.627142  8950 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.591145  8989 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:24.606778  8916 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:24.628482  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.626748  8992 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.624734  8652 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.636628  9013 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:24.670272  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.672722  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.696898  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.613013  9015 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.539s	user 0.016s	sys 0.007s
W20260709 13:20:24.715579  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.716385  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.701947  9052 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:20:24.640233  8230 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:24.603108  8855 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.613960  8812 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.614902  8717 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.674994  9043 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.613005  9037 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.725167  8652 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.721791  8989 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:24.660076  8995 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.719954  8806 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.762885  9014 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:20:24.667280  9053 consensus_queue.cc:1059] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:20:24.741178  8747 raft_consensus.cc:1081] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:24.751488  8230 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.777822  4288 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:24.784080  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.738572  9055 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:20:24.767558  8973 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:24.806109  4291 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:24.804490  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.725387  9015 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.726073  8916 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.776286  8806 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.817543  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:24.818136  8717 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.818727  8717 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.819226  8717 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.819980  8230 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:24.816522  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:24.820955  9045 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:20:24.818746  9058 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:20:24.823382  9057 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:20:24.824635  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:24.826336  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:24.858578  4219 raft_consensus.cc:606] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:24.829252  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.832250  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.833290  9013 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.835364  8319 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.835846  9037 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.805905  9024 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:24.838167  4291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:20:24.868700  4291 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:24.869338  4291 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.838388  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.870886  4142 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.871820  4222 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:20:24.873176  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:24.841557  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.874125  4147 raft_consensus.cc:2376] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10. Re-sending same reply.
I20260709 13:20:24.843902  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.875303  4146 raft_consensus.cc:2376] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12. Re-sending same reply.
I20260709 13:20:24.876675  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:24.877550  4146 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 8.
I20260709 13:20:24.878720  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:24.849423  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.766197  9043 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.883292  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:24.886070  4144 raft_consensus.cc:2393] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:24.857944  4139 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:24.859575  4141 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.858922  4288 raft_consensus.cc:2410] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:20:24.859189  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 189598us
I20260709 13:20:24.865000  4294 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:24.865854  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:24.814611  9023 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:24.770617  8652 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:24.887692  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.895941  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:24.901804  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.930003  4147 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:24.932111  4147 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:24.934458  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:24.937757  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:24.939177  4142 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:24.929158  4140 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:24.940435  4147 raft_consensus.cc:2376] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14. Re-sending same reply.
I20260709 13:20:24.857378  8735 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:20:24.926211  9022 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.958454  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:24.975440  4145 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.975548  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:24.962462  4141 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:24.987388  4140 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:24.925927  8990 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.009491  8990 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.009939  8746 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:25.010638  8746 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:25.010430  8990 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.014407  8990 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.016304  4292 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:25.018458  4288 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:25.021661  4292 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:24.992278  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:25.025004  4293 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:25.027921  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:25.029891  8918 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:25.030457  4296 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:25.030532  8918 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.032371  8918 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.011826  8746 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.037565  8746 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:25.013017  4139 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:25.041281  8942 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:25.049573  8717 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.053702  9038 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:25.057304  8873 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.061129  8950 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.064173  9038 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.067907  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.073237  4221 raft_consensus.cc:2410] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:20:25.068405  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.068866  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:25.076961  4219 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:25.053074  8918 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.019749  4288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:20:25.090305  4288 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:25.091048  4288 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:25.093436  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.094863  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.098049  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:25.098781  4294 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.109608  8918 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:25.110173  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.956213  4291 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:24.885221  8319 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:25.123273  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 128385us
I20260709 13:20:25.127591  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:25.108001  4294 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
W20260709 13:20:25.134352  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.139240  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:24.929049  8806 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.190s
I20260709 13:20:25.140905  4291 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:24.969776  9037 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.147644  4187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.061s	sys 0.067s
W20260709 13:20:25.154534  4187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.061s	sys 0.067s
W20260709 13:20:25.154904  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 548546us
I20260709 13:20:25.146049  4287 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:24.925877  9023 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.117466  8736 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.161379  4291 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:20:25.165602  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.174913  4214 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:24.867045  8989 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:25.180100  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.182386  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:25.182806  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:25.183566  4216 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.190438  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:25.147454  8973 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:25.195806  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:25.198088  4294 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:25.119431  9022 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.204144  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:25.210108  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:25.213910  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:25.214605  4294 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:25.172930  8855 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.215987  4293 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:25.217674  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.219898  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:25.224098  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:25.224947  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:25.212806  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:25.225777  4287 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 6.
I20260709 13:20:25.213464  8230 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:25.234664  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:25.243252  4219 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:25.194980  8918 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.214468  8812 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.232163  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:25.249728  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:25.258209  4923 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:25.170810  9037 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.192528  8888 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:20:25.214548  8995 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.214505  8973 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:20:25.247798  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.228996  8751 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:20:25.262625  4110 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:25.255163  4288 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.228266  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:25.274513  4293 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:25.232072  8712 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:20:25.284175  4292 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:25.285645  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:25.238770  9062 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.222163  9020 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:20:25.261178  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:25.299050  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.360601  4219 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:25.249460  8942 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:25.296025  8899 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:25.305195  9047 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:25.306788  9043 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.297369  8917 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:20:25.265941  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:25.307020  4291 raft_consensus.cc:2410] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:20:25.308252  4293 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:25.309859  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81745.4us
I20260709 13:20:25.379410  4893 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:25.282321  4894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.031s	sys 0.034s
W20260709 13:20:25.382507  4894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.033s	sys 0.034s
I20260709 13:20:25.329108  4294 raft_consensus.cc:2410] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:20:25.261983  9015 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:25.336781  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 74288.6us
W20260709 13:20:25.415310  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145047us
I20260709 13:20:25.339669  4143 raft_consensus.cc:2955] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 3 to 8, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:25.362303  4288 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:20:25.256456  8736 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:20:25.248267  8950 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:25.345536  8918 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:25.301148  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:25.417078  4110 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:25.342715  8812 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:25.421444  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:25.367779  8899 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:25.475201  4289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.028s
I20260709 13:20:25.477793  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:25.481644  4289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.013s	sys 0.028s
I20260709 13:20:25.375903  9062 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:25.485006  9062 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:25.488982  4923 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:20:25.422681  8500 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.990s	user 0.013s	sys 0.002s
I20260709 13:20:25.370087  8942 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.386785  8916 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:25.463302  8812 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.489945  9062 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:25.499629  9022 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.416388  9065 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:25.519134  4216 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
W20260709 13:20:25.719460  4217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.018s	sys 0.007s
W20260709 13:20:25.720392  4217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.018s	sys 0.007s
W20260709 13:20:25.723233  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.724107  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.724866  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.726039  9037 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:25.726996  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.727305  9037 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:25.728794  9037 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.617079  8213 raft_consensus.cc:993] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:25.703656  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:25.505040  8230 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:25.472401  8319 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.618045  8652 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:25.738587  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:25.719545  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 455608us
I20260709 13:20:25.739108  8652 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:25.741308  8717 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:25.523021  8812 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.742749  9037 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.378126  9047 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.607486  8747 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:25.550813  8899 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.640157  8942 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.463303  8973 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.474484  8995 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:25.837764  8995 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.556988  9065 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:25.842411  9065 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.609869  9023 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.548786  9038 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.864614  8230 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.865787  8230 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.868817  9066 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.870000  9066 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.871343  8230 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.872174  8230 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:25.872864  9055 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:25.873471  9055 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:25.873162  8230 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.876542  8230 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:25.878917  4112 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:25.880702  9079 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:25.881536  9079 raft_consensus.cc:697] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:25.598378  9052 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:20:25.622474  9059 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.357s	user 0.003s	sys 0.000s
I20260709 13:20:25.626135  9064 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:25.888947  9064 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:20:25.714725  4145 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.005s
I20260709 13:20:25.892688  4145 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
W20260709 13:20:25.701546  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 284320us
I20260709 13:20:25.770674  8213 raft_consensus.cc:1081] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:25.770620  9077 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 13:20:25.774255  9070 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:20:25.777446  9080 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:25.654960  9025 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.192s	user 0.011s	sys 0.006s
I20260709 13:20:25.814730  8319 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:25.896142  8873 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:25.902525  8873 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:25.897145  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 158921us
I20260709 13:20:25.905015  9025 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.905776  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:25.823407  8747 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:25.823547  9043 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:25.827306  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88053.4us
I20260709 13:20:25.854261  4892 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:25.854563  9053 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:20:25.855320  9006 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:25.859200  9073 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:20:25.859887  9020 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.860694  8929 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.406s	user 0.011s	sys 0.004s
I20260709 13:20:25.891079  9064 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.908252  9025 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.969875  9080 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.937867  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:25.909528  9023 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.915495  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.867974  9038 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.901010  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2430) took 1416 ms. Trace:
I20260709 13:20:25.937103  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.949146  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:25.975818  9089 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:20:25.970366  9006 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:25.933363  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.909054  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.950085  8652 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:26.033473  8652 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.025739  4295 rpcz_store.cc:276] 0709 13:20:24.484625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.487538 (+  2913us) service_pool.cc:224] Handling call
0709 13:20:24.488050 (+   512us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:24.563117 (+ 75067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.563152 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:24.563937 (+   785us) log.cc:844] Serialized 52 byte log entry
0709 13:20:24.859678 (+295741us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:25.299717 (+440039us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.300404 (+   687us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.300777 (+   373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.300882 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.621568 (+320686us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:25.900460 (+278892us) raft_consensus.cc:1685] finished
0709 13:20:25.900514 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.900744 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24524,"prepare.queue_time_us":806670,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":63041,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":29407,"spinlock_wait_cycles":139888768,"thread_start_us":631917,"threads_started":2,"wal-append.queue_time_us":640075}
I20260709 13:20:25.936113  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.941164  8995 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:25.887085  9079 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:25.908774  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.910172  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:25.951514  9047 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:25.984699  8873 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.028213  4217 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:25.954694  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 500) took 1125 ms. Trace:
I20260709 13:20:25.875424  9055 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:25.986003  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 132144us
I20260709 13:20:25.969178  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:25.971786  4921 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:25.908998  4146 raft_consensus.cc:2368] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12.
I20260709 13:20:25.986519  8885 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:25.908331  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:25.896689  9015 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:26.023147  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 44576.8us
I20260709 13:20:26.028887  8989 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.028203  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 133793us
I20260709 13:20:26.036329  8652 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.063736  4294 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.055786  4145 rpcz_store.cc:276] 0709 13:20:24.828826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.828959 (+   133us) service_pool.cc:224] Handling call
0709 13:20:25.954231 (+1125272us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400077454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:25.954422 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266923776}
W20260709 13:20:26.064523  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 95559.2us
W20260709 13:20:26.067349  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 159343us
I20260709 13:20:26.045552  4218 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:26.069446  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:26.069649  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.064777  4295 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:26.044391  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:26.132154  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.135118  8663 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:26.135696  8663 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.064167  9032 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:26.080158  9080 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:26.058945  8746 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.021s	user 0.011s	sys 0.011s
I20260709 13:20:26.066219  8885 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:26.143852  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46365us
I20260709 13:20:26.117440  8652 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:26.065215  9064 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.039652  9006 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:26.068996  9025 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:26.139743  8712 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:26.157694  8885 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:26.167783  9088 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:26.168186  9055 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.176518  4187 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.067891  9015 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.080935  8989 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.137040  8663 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.160183  9032 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.157827  8652 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:26.155474  8995 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:26.180964  8712 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.217415  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.225101  4292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:20:26.176628  8747 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.226363  4292 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:26.226704  9015 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:26.226919  4292 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:26.228178  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 51984.5us
I20260709 13:20:26.231674  9088 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.235450  9088 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.236567  8746 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:26.236914  9053 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:26.237587  9053 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.238232  9053 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:26.238910  8712 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:26.243258  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 113778us
I20260709 13:20:26.244573  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.246397  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:26.249063  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:26.251379  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.252395  4220 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:26.237527  8746 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.208205  8652 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.152194  9020 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:26.274555  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.275827  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.277683  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.158345  9043 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:26.282599  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.256093  4261 leader_election.cc:336] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.611s (SENT)
I20260709 13:20:26.281563  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:26.271247  8747 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:26.273113  9066 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.280782  9025 raft_consensus.cc:2764] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:20:26.302645  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 56332us
I20260709 13:20:26.307075  4219 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:26.309078  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:26.303850  4187 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.283334  8942 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:26.238161  9063 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:20:26.290518  8712 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.308068  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:26.302171  9006 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:26.329561  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.312026  4292 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:26.331367  4261 leader_election.cc:336] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.611s (SENT)
I20260709 13:20:26.297737  8995 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:26.349392  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.341564  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:26.327584  9006 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.356669  4217 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:26.361048  8663 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.364446  9089 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:20:26.365281  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 86742us
I20260709 13:20:26.369656  4213 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.371750  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.315361  8953 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:26.374704  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 130304us
I20260709 13:20:26.372653  4295 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
W20260709 13:20:26.378698  9103 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:20:26.380617  8607 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:26.381546  4146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2515) took 1511 ms (client timeout 1869 ms). Trace:
I20260709 13:20:26.381800  9088 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:26.391396  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 74286.8us
I20260709 13:20:26.392086  9023 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:26.392421  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.392848  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.343235  9079 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:26.372143  9006 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.405411  4292 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:26.384553  4146 rpcz_store.cc:269] 0709 13:20:24.869921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.878373 (+  8452us) service_pool.cc:224] Handling call
0709 13:20:26.345289 (+1466916us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540022fbd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:26.381426 (+ 36137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2366524800}
I20260709 13:20:26.381582  8942 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:20:26.425868  4111 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.399120  9047 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:26.359974  9032 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.392839  9015 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:26.437779  4143 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.882s	user 0.007s	sys 0.017s
I20260709 13:20:26.438946  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.430241  9037 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:26.461817  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.463707  9025 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:26.450271  9062 consensus_meta.cc:287] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.854s	user 0.012s	sys 0.009s
I20260709 13:20:26.466681  4921 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:26.422142  9053 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.431906  8873 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:26.472600  9025 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:26.473711  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 121956us
I20260709 13:20:26.413230  8953 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.480530  8873 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.483938  9063 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:26.484365  9025 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.484961  8917 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:26.486109  8230 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:26.488607  9080 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:26.488965  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 80138.5us
I20260709 13:20:26.490164  4112 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:26.476022  9047 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:20:26.492885  8717 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:26.493382  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:26.494508  8995 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.496817  4218 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:20:26.497331  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69703.5us
I20260709 13:20:26.498169  8989 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.498678  8607 raft_consensus.cc:993] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:26.456444  9077 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:20:26.517756  8953 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.520401  9053 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.521986  8230 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.469601  9088 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.524575  4289 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 12. Ops: []
I20260709 13:20:26.525549  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.526468  9088 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.499569  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:26.453253  9015 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.524153  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.528901  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.529914  4139 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:26.530913  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:26.532836  8899 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.533572  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 503) took 1700 ms. Trace:
I20260709 13:20:26.534005  4143 rpcz_store.cc:276] 0709 13:20:24.833105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.837329 (+  4224us) service_pool.cc:224] Handling call
0709 13:20:24.837858 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.858262 (+ 20404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.858297 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.859385 (+  1088us) log.cc:844] Serialized 494 byte log entry
0709 13:20:25.339470 (+480085us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:26.450446 (+1110976us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.492532 (+ 42086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.533053 (+ 40521us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5400069854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:26.533115 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:26.533166 (+    51us) raft_consensus.cc:1685] finished
0709 13:20:26.533270 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.533477 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6356,"raft.queue_time_us":18315,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":6797,"spinlock_wait_cycles":45914496,"thread_start_us":479679,"threads_started":1,"wal-append.queue_time_us":646053}
I20260709 13:20:26.536545  9020 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.513667  8717 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.540709  4921 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:26.541999  8873 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:26.511188  9025 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:26.542668  9025 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:26.543107  9025 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.470307  9023 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:26.450620  9079 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.510032  9037 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.515877  9043 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.530030  9015 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:26.503233  9063 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:26.469457  9062 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.544768  4295 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:26.513247  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:26.567469  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:26.544943  8885 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.569864  4923 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:26.571175  8885 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.571707  8973 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.556617  9063 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:26.572314  8973 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.575085  8973 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.554512  8717 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.575959  4143 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:20:26.577445  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:26.576270  8230 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.580161  4213 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:26.576927  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:26.584885  8607 raft_consensus.cc:1081] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
W20260709 13:20:26.585655  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 76765.5us
I20260709 13:20:26.586794  4112 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:26.575131  9062 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.588953  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.589278  9062 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:26.589740  9062 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:26.590180  9062 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.590597  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.592820  8736 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:26.594499  9037 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:26.595155  8736 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:26.596021  8736 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:26.599764  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:26.601445  4140 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:20:26.605854  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.578377  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.609436  4145 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:26.610365  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.599761  4147 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:20:26.611315  4217 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:26.600270  8736 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.613381  8736 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.617141  4293 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:26.618881  8652 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.621848  8652 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.597240  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:26.597572  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.597719  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.598152  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:26.598484  9023 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:26.622040  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.596868  9079 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.623826  9081 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:26.623860  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:26.592182  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:26.640743  4289 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:26.633844  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.634299  9088 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:26.635387  9054 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:26.637363  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.642066  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.644042  4292 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:26.654754  4218 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:20:26.648049  8998 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:20:26.665006  9023 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:26.666342  9023 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.668985  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:26.670485  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.671350  4146 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:26.673349  4925 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
W20260709 13:20:26.675585  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.668569  9088 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.677237  8888 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:26.677696  8888 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.679513  9088 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.680584  8917 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:26.640799  9081 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.641691  9065 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:20:26.684774  4291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:20:26.685438  4291 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:26.685832  4291 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.648823  9054 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.687464  9054 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.689469  9054 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:26.680786  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88728.7us
I20260709 13:20:26.694422  4187 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.695755  8917 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:26.622213  9006 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.668033  8953 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:20:26.674727  4110 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:26.697546  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:26.714350  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.698623  4112 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:26.696316  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.722857  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:26.723696  4292 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:26.697371  8917 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.725605  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.726414  4146 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.726512  8917 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.722527  4290 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
W20260709 13:20:26.732831  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 58216.9us
I20260709 13:20:26.739477  4143 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:26.740173  8995 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:26.740710  8995 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:26.740841  9006 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.741180  8995 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:26.741992  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:26.743801  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:26.744542  4292 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.754246  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:26.754079  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.755636  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:26.762635  4289 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:20:26.763674  8230 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:26.745951  9088 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:26.765324  9079 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:26.767266  4145 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:26.768278  8746 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:26.754673  8712 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.781348  4923 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:26.786692  9063 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.745308  9062 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.791009  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.777876  8712 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.781164  9032 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.793148  8712 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.793593  9032 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.771528  8736 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:26.798365  4141 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:26.800184  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 103972us
I20260709 13:20:26.796296  9088 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:26.802825  9088 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:26.805035  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.803264  9032 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:26.806924  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.807169  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:26.822198  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.824978  4292 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:26.822950  4147 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:20:26.819046  8736 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.849627  4143 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:26.851353  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.852566  4217 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 9.
I20260709 13:20:26.852986  8736 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.853753  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:26.854357  4221 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.851433  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.857240  4147 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:26.849943  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:26.858641  8888 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.861038  4923 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:26.862380  9006 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:26.868880  4893 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:26.879957  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:26.882170  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.884991  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.889703  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.894779  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.903707  4221 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:26.908951  8888 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:26.912451  8230 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:26.909307  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.914613  4139 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.918778  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:26.920706  4892 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:26.840301  9025 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.926256  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:26.937127  4291 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.938694  9055 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:26.939379  9055 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:26.940096  4291 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:26.941357  8652 raft_consensus.cc:3055] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:26.945528  9081 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:26.946638  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:26.947587  9062 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:26.948907  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.949761  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:26.948024  9093 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:26.955520  8230 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:26.909852  9064 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:26.924850  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:26.982832  8230 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.984964  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:26.959241  8652 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:26.988876  8652 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.990454  8652 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:26.991878  9023 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:26.958155  4146 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:26.974560  4138 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:26.996361  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.996706  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:26.997274  4138 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:26.998937  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.977234  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.000196  4142 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.978493  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.005195  9081 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.006045  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.007381  4141 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:26.980566  4140 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:27.011013  4138 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:26.990470  9006 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:27.027688  9006 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:27.029439  9006 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:26.975800  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:26.950555  9063 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:27.033231  4144 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:27.034135  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:26.982865  9064 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:27.024258  4291 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:27.035425  9064 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:27.036813  4139 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:27.025983  9025 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:26.983242  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58518.2us
I20260709 13:20:26.960444  4147 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:27.035028  4213 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:27.049764  4140 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:27.025388  4288 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:27.026803  4141 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:27.018585  4187 connection.cc:256] RPC call timeout handler was delayed by -1.3634114640001371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:20:27.062093  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.064558  4145 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:27.079995  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.084923  4142 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:27.086980  8230 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:27.104853  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.109866  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:27.105973  9122 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.181s	user 0.001s	sys 0.006s
I20260709 13:20:27.118036  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.121564  4142 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.137195  4215 raft_consensus.cc:2368] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16.
I20260709 13:20:27.128465  4145 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:27.113049  9083 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:20:27.144208  9063 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:27.144761  9063 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:27.145826  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:27.145936  9063 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.149029  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.154536  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.155339  4140 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:27.083326  9032 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:20:27.163203  4213 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:27.164979  4112 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:27.166095  9062 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:27.166620  9062 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:27.167932  4145 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:27.173219  4220 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:20:27.175781  4216 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:27.159582  4142 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:27.147419  9063 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.375398  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.374416  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.114687  9055 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.378373  4145 raft_consensus.cc:2376] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11. Re-sending same reply.
I20260709 13:20:27.379447  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.195537  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.380050  4145 raft_consensus.cc:2376] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16. Re-sending same reply.
I20260709 13:20:27.381255  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.382066  4145 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:27.382993  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.383575  4145 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 6.
I20260709 13:20:27.152928  9093 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:27.199280  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.201583  8712 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.183995  8995 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.203293  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.204135  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.204895  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.185554  9083 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:27.209043  9037 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.202756  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.167677  9062 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.217617  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:27.221966  9124 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:20:27.222949  9125 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:27.234179  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.237452  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.381958  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.401607  4142 raft_consensus.cc:2376] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11. Re-sending same reply.
I20260709 13:20:27.241914  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.219924  9054 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.282686  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.283356  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.410558  4928 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 9 index: 12. (index mismatch)
I20260709 13:20:27.290357  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2854) took 1142 ms. Trace:
W20260709 13:20:27.320411  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.319880  9064 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:27.356626  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.360119  4187 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:44154 dropped due to backpressure: service queue is full with 50 items [suppressed 20 similar messages]
W20260709 13:20:27.410568  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.381255  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.413719  4143 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:27.397610  4146 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:27.394774  4144 raft_consensus.cc:2376] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13. Re-sending same reply.
I20260709 13:20:27.238125  4288 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.402724  4140 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:27.403262  4139 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.403901  4147 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 9: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:27.425698  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.426635  4147 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:27.427838  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.404477  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.395844  9083 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:27.437299  9023 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.437893  9023 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.438129  9083 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:27.404366  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.432994  8652 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.433097  8230 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:27.433955  9025 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:27.440119  9023 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:27.440582  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.440228  9083 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:27.445631  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.440961  8652 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.441268  8230 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.453310  8652 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:27.451026  4111 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:37124 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2195)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2523)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2527)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2529)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2533)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 509)
I20260709 13:20:27.454716  8230 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:27.453621  4145 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:27.444047  4147 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:27.441644  9025 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:27.457340  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.459213  9025 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:27.460582  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:27.457115  4111 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52134 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2195)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2523)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2527)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2529)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2533)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 509)
I20260709 13:20:27.467602  4214 raft_consensus.cc:2368] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14.
W20260709 13:20:27.467851  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 2.147s (SENT) [suppressed 56 similar messages]
I20260709 13:20:27.469957  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.472081  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.472926  4142 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
W20260709 13:20:27.473383  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.475646  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 391116us
I20260709 13:20:27.478854  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.479581  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.480962  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.481494  4139 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:27.480291  4140 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:27.487015  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.487591  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.491744  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.479717  4141 raft_consensus.cc:2376] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15. Re-sending same reply.
I20260709 13:20:27.492871  4146 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:27.493636  4142 raft_consensus.cc:2376] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9. Re-sending same reply.
I20260709 13:20:27.489177  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.491294  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.411564  4294 rpcz_store.cc:276] 0709 13:20:26.148498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.148964 (+   466us) service_pool.cc:224] Handling call
0709 13:20:26.164907 (+ 15943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.224990 (+ 60083us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:26.421727 (+196737us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.804684 (+382957us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b180014ed20. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e88223a 00007fee3ececa2a
0709 13:20:26.951922 (+147238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.951979 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:26.952029 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.250116 (+298087us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b180014ed20. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbc32a6 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419
0709 13:20:27.289946 (+ 39830us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b5400277ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:27.290008 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.290266 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":225715,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":94,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":67760,"spinlock_wait_cycles":115695232,"thread_start_us":340661,"threads_started":2,"wal-append.queue_time_us":652693}
I20260709 13:20:27.499464  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.501199  4141 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:27.497464  4139 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:20:27.480633  9116 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.540849  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.549501  8712 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:27.549963  9116 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.413501  4187 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:44154 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2195)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2198)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2179)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2162)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2847)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2848)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2181)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2849)
I20260709 13:20:27.557570  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:27.558121  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.558911  4143 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:27.559849  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.561271  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.562716  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.562950  9055 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.563658  4222 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:27.565368  4213 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:27.566241  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.566448  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.567615  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.567696  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.568966  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:27.569319  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 150611us
I20260709 13:20:27.569937  4145 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:27.570791  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.571877  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.572849  4143 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:27.574621  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.575284  4145 raft_consensus.cc:2376] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 14. Re-sending same reply.
I20260709 13:20:27.576186  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.576884  4213 raft_consensus.cc:2376] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16. Re-sending same reply.
I20260709 13:20:27.577211  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.465826  9054 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.582356  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.580271  4216 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:27.468252  9037 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.585752  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.572707  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:27.544049  9103 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:20:27.586932  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.597152  4291 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:27.609644  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.590623  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.591765  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.594584  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.597918  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.608671  4145 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.598665  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.573194  9093 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:27.584543  9006 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:27.608669  4295 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.588866  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.597196  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.618062  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.618216  4146 raft_consensus.cc:2376] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14. Re-sending same reply.
I20260709 13:20:27.611779  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:27.589717  4294 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:27.620052  4143 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:27.636826  4292 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.642783  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.643872  4289 raft_consensus.cc:2368] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12.
I20260709 13:20:27.645215  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.646220  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.648885  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.650665  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.650789  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.650826  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.652720  4141 raft_consensus.cc:2376] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9. Re-sending same reply.
W20260709 13:20:27.654573  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 102566us
I20260709 13:20:27.656895  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.661912  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.663740  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.666417  4216 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:27.667807  8995 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:27.668875  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.670173  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.671085  4217 raft_consensus.cc:2368] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:27.657485  9130 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:27.672585  4141 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:27.672977  9130 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:27.673623  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.673952  9130 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:27.677897  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.678788  4147 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:27.679869  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.681130  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.684293  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:27.684573  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.684693  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.685070  4292 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:27.685525  4287 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.686322  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.686564  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.686820  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.687187  4144 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.687547  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.687955  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.685592  4295 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.667697  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.696902  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.688799  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.688968  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.700901  4296 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.701189  9137 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:27.701505  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.689528  4213 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:27.692999  8995 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.693341  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.722541  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.723377  4141 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:20:27.723481  4142 raft_consensus.cc:1813] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Handling vote request from an unknown peer 34e6205f3c1d434193126fef20d73800
I20260709 13:20:27.693892  4215 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:27.672005  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.703835  9037 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:27.704312  9116 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:27.704463  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.736572  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.737098  4145 raft_consensus.cc:2376] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13. Re-sending same reply.
I20260709 13:20:27.706315  9054 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:27.707121  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.707350  9064 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:27.744385  4143 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
W20260709 13:20:27.709921  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45197.7us
I20260709 13:20:27.710340  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.711699  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.746670  4138 raft_consensus.cc:2376] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12. Re-sending same reply.
I20260709 13:20:27.712086  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:27.703860  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:27.689601  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 110239us
I20260709 13:20:27.702962  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.748668  4146 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:27.719722  4292 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:27.730809  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.750435  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.752130  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:27.752811  4139 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.732194  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.705039  9142 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:27.735586  4142 raft_consensus.cc:2410] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:27.738129  4147 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.743321  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.754220  4215 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:27.755321  4187 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.869s (SENT)
I20260709 13:20:27.755856  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:27.711450  9143 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:20:27.769585  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.771365  4138 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 12. Ops: []
I20260709 13:20:27.773329  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.774504  4216 raft_consensus.cc:2368] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:27.775919  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.770355  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.779755  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.781253  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.782526  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.783269  4213 raft_consensus.cc:2368] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:27.784111  4142 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:27.784150  4139 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:27.787388  4293 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.787990  4291 raft_consensus.cc:2393] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.788625  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.790961  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.791594  4217 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:27.793689  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:27.794402  4146 raft_consensus.cc:2376] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 7. Re-sending same reply.
W20260709 13:20:27.795742  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50057us
I20260709 13:20:27.796128  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:27.798215  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.799111  4143 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:27.800678  4143 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:20:27.805300  4187 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.905s (SENT)
I20260709 13:20:27.756947  9142 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:27.805932  4187 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:27.806686  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.733976  8995 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:27.808604  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.809684  4216 raft_consensus.cc:2368] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:27.810060  4143 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:27.811112  4143 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.811589  4215 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:27.814872  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:27.815321  4295 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:27.815495  4147 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:27.817332  4147 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:27.817898  4145 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.818029  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:27.820559  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.821274  4215 raft_consensus.cc:2376] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14. Re-sending same reply.
I20260709 13:20:27.822208  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.822331  4293 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.813969  9144 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:20:27.736024  9088 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:20:27.751204  9081 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:20:27.826898  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.830031  4215 raft_consensus.cc:2368] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16.
I20260709 13:20:27.832603  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.833875  4140 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:27.834896  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.836102  4112 leader_election.cc:400] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14.
I20260709 13:20:27.836557  4112 leader_election.cc:403] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:27.836270  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:27.840652  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.841676  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.835597  4216 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:27.843590  4213 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:27.788820  9146 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:20:27.845152  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.846918  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.847540  4213 raft_consensus.cc:2376] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12. Re-sending same reply.
I20260709 13:20:27.848500  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.849154  4213 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:27.850669  4291 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:20:27.852095  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.855414  4287 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:27.856030  4138 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:20:27.859789  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.851275  4291 pending_rounds.cc:85] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 4
I20260709 13:20:27.860913  4213 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:27.827512  9080 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:27.864033  9146 consensus_queue.cc:1243] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:20:27.863771  9006 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:27.863896  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 58695us
I20260709 13:20:27.867256  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.866811  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:27.868880  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:27.869576  4294 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.869627  4296 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.873548  4146 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:27.875799  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.881434  4296 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:27.885459  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:27.892066  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.893435  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:27.861405  4291 pending_rounds.cc:107] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:20:27.898620  4291 raft_consensus.cc:2889] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.900980  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.902446  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.903687  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:27.906204  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.908958  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:27.904386  4290 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
W20260709 13:20:27.909869  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 104528us
I20260709 13:20:27.913702  4213 raft_consensus.cc:2468] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
W20260709 13:20:27.915390  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.913857  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:27.917946  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:27.919430  4213 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:27.902139  4218 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:27.921938  4218 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:27.931525  4893 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:27.937877  4215 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:27.877115  9079 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14.
W20260709 13:20:27.943869  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75378.9us
W20260709 13:20:27.945884  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.945222  4218 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:27.946141  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:27.957144  4213 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:27.937551  9023 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.960490  4146 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:27.949944  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:27.936929  9123 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:27.945649  9065 raft_consensus.cc:2804] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:27.972781  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:27.970999  9080 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:27.979190  4218 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:27.986109  8230 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:27.984431  4213 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:28.010411  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.022818  4141 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:28.022956  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 92142.8us
I20260709 13:20:28.029673  4146 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:20:28.034027  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.041550  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:28.023039  9148 raft_consensus.cc:2764] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:20:27.996444  9065 raft_consensus.cc:697] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:28.052886  4146 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:27.980876  9023 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:28.061628  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 152849us
I20260709 13:20:27.949955  9142 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:28.023407  9063 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:28.044948  9145 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:20:28.024255  9088 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.063683  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:28.038589  9054 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:28.070034  4216 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:20:28.069563  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 62734.4us
I20260709 13:20:28.077301  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.081749  4187 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.084187  4187 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.075331  4291 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:28.088371  4144 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:28.089747  4142 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:28.004619  9123 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:28.093617  4141 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:20:28.069839  9055 consensus_meta.cc:287] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.506s	user 0.017s	sys 0.001s
I20260709 13:20:28.106664  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:28.108672  4214 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:28.109128  4220 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:28.107456  4290 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:28.113483  4220 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:28.092839  9081 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.103724  9080 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:28.104602  8995 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:28.106858  8736 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:28.110620  9148 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:28.131808  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.127655  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 100228us
I20260709 13:20:28.117846  9142 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:28.087776  9088 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:28.102938  9054 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:28.146459  4217 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:28.147775  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:28.149322  4221 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:28.154597  4295 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:28.155325  4295 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:28.145602  8736 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:28.168205  9147 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
I20260709 13:20:28.168303  8736 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:28.162189  9083 consensus_meta.cc:287] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.716s	user 0.015s	sys 0.000s
I20260709 13:20:28.166378  4295 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:28.150177  9148 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:28.198202  9037 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:28.199047  9037 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:28.205695  9151 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:20:28.123934  9065 consensus_queue.cc:237] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:28.224910  8712 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:28.225704  8712 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:28.226195  9088 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:28.232832  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 137177us
I20260709 13:20:28.237557  9123 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:28.227141  8712 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:28.253875  4222 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:28.255765  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2188) took 1029 ms. Trace:
I20260709 13:20:28.256274  4222 rpcz_store.cc:276] 0709 13:20:27.226668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.820731 (+594063us) service_pool.cc:224] Handling call
0709 13:20:28.255658 (+434927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:28.236136  9054 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:28.263757  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:28.269156  4295 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:28.264150  8712 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.271201  4925 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:28.277004  4290 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 9 index: 12. (index mismatch)
I20260709 13:20:28.280948  9054 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:28.281669  9054 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:28.292590  9023 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:28.294636  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.295569  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.299388  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:28.300652  4291 raft_consensus.cc:2410] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:28.303637  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.311085  9054 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:28.312816  9130 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:28.318930  4288 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:20:28.319427  4288 pending_rounds.cc:85] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:20:28.319650  4288 pending_rounds.cc:107] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:20:28.319877  4288 raft_consensus.cc:2889] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.324267  8995 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.325222  8995 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:28.326609  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.278440  9037 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:28.327548  9037 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:28.271440  9160 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:28.329722  9160 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:28.330137  9160 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:28.333796  9148 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:28.338099  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:28.341543  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:28.359269  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.336934  9123 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.346127  9116 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:28.399752  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.412266  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 45823.8us
W20260709 13:20:28.415033  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 274129us
I20260709 13:20:28.415910  4295 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:20:28.421200  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 79753.7us
I20260709 13:20:28.365723  9079 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.415939  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:28.404678  9116 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:28.482162  9080 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:20:28.432323  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.457144  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.469287  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:28.472404  9166 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:20:28.420097  9123 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:20:28.429352  9146 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:20:28.525790  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.539850  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.532006  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:28.532434  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:28.542311  4217 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:28.483816  9063 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:20:28.549249  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:28.552318  4214 raft_consensus.cc:2410] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:20:28.556233  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 74610.2us
I20260709 13:20:28.556821  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:28.560616  4219 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
W20260709 13:20:28.560954  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 86838.6us
I20260709 13:20:28.570312  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:28.572818  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2203) took 1156 ms. Trace:
I20260709 13:20:28.573328  4140 rpcz_store.cc:276] 0709 13:20:27.416499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.706808 (+290309us) service_pool.cc:224] Handling call
0709 13:20:28.572555 (+865747us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b540044a054. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:28.572745 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209510272}
W20260709 13:20:28.574589  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 88926.7us
W20260709 13:20:28.576213  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.486815  9062 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:20:28.549365  9142 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:28.549182  9157 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:28.579106  9080 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:20:28.641062  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 225185us
I20260709 13:20:28.545598  9123 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:28.666718  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 197579us
W20260709 13:20:28.669785  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 106100us
I20260709 13:20:28.590022  9142 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:28.672696  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:28.704710  4292 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:28.705672  4296 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:20:28.706156  4296 pending_rounds.cc:85] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:20:28.706404  4296 pending_rounds.cc:107] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:28.706666  4296 raft_consensus.cc:2889] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.713414  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:28.705238  4292 pending_rounds.cc:85] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:28.715206  4292 pending_rounds.cc:107] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:28.630486  9080 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:28.715499  4292 raft_consensus.cc:2889] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.715520  4111 leader_election.cc:400] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12.
I20260709 13:20:28.716490  4111 leader_election.cc:403] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.722632  9155 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.213s
W20260709 13:20:28.724186  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 82260.7us
I20260709 13:20:28.725816  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:28.727181  9143 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:28.729952  4287 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:28.731366  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.732928  9165 log.cc:927] Time spent T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:20:28.734055  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2552) took 1030 ms. Trace:
I20260709 13:20:28.734593  4141 rpcz_store.cc:276] 0709 13:20:27.703336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.023922 (+320586us) service_pool.cc:224] Handling call
0709 13:20:28.024201 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.094263 (+ 70062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.733666 (+639403us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b540010fc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:28.733940 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158306048}
I20260709 13:20:28.739441  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 745) took 1260 ms. Trace:
I20260709 13:20:28.740378  4213 rpcz_store.cc:276] 0709 13:20:27.478930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.028948 (+550018us) service_pool.cc:224] Handling call
0709 13:20:28.050220 (+ 21272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.175938 (+125718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.175996 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:28.176070 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:28.176126 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.738976 (+562850us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400215554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:28.739045 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.739261 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288210816}
I20260709 13:20:28.743307  9123 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:28.744460  9168 consensus_queue.cc:1059] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:28.745496  9168 consensus_queue.cc:1243] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer b81584b21ed144698954548303f1e507 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:28.673036  9157 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.746297  9157 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.746692  9157 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:28.756462  4221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2180) took 1524 ms (client timeout 1505 ms). Trace:
I20260709 13:20:28.757939  4290 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:20:28.759929  9167 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:20:28.757310  4221 rpcz_store.cc:269] 0709 13:20:27.223989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.233846 (+  9857us) service_pool.cc:224] Handling call
0709 13:20:28.748030 (+1514184us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54002f5154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:28.748200 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625489664}
I20260709 13:20:28.682336  9142 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:20:28.770274  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 62176.7us
I20260709 13:20:28.771847  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:28.773317  4220 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:28.777678  4219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2163) took 1577 ms (client timeout 1580 ms). Trace:
W20260709 13:20:28.702066  9131 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:20:28.770064  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:28.778357  4219 rpcz_store.cc:269] 0709 13:20:27.200721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.562447 (+361726us) service_pool.cc:224] Handling call
0709 13:20:28.777408 (+1214961us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540001f254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:28.777590 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589944704}
I20260709 13:20:28.785933  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:28.801477  4287 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:28.804860  4213 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:28.808812  4221 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:28.775579  9168 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:28.801832  9156 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12.
I20260709 13:20:28.642163  9116 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:28.837312  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 132509us
I20260709 13:20:28.855129  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:28.850638  8712 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.000s
I20260709 13:20:28.833127  9177 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:20:28.820703  9172 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:20:28.851588  9080 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:28.870092  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 144345us
I20260709 13:20:28.871541  8736 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:28.820010  9064 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:20:28.890935  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44514.7us
W20260709 13:20:28.900988  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.880179  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.893738  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:28.892302  9143 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:28.896545  8736 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:28.905509  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.905644  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:28.909403  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:28.913105  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 77783.3us
I20260709 13:20:28.855931  9083 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:20:28.890372  9079 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.918398  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:28.924263  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 106619us
I20260709 13:20:28.928846  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:28.923738  9146 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:28.906914  9062 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:20:28.944238  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.944962  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.916442  9123 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.948896  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.955422  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:28.954885  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:28.953512  8652 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.962953  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:28.964550  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 147195us
I20260709 13:20:28.969337  9156 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.980031  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.984462  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.988072  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:28.960901  9182 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.957290  9146 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:28.972363  9088 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.009001  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.001361  9191 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:20:29.000861  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:29.012507  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.012639  9088 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:28.996502  9156 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:29.007706  9037 raft_consensus.cc:2764] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:20:28.961845  9188 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.965627  9183 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:29.017242  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:29.019160  9168 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.022576  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:29.026110  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:28.994647  9148 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:29.026902  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.000586  9180 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:29.006920  8885 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.013931  8736 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:29.014402  9143 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:28.986001  8712 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:20:29.006394  9182 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.047423  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:29.021358  9184 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:29.049265  8885 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:29.022725  9188 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:29.055821  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.026096  8717 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.026794  9123 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:29.056833  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 89174.7us
I20260709 13:20:29.021368  9183 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:29.064241  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:29.060232  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 98597.9us
I20260709 13:20:29.025815  9168 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:29.029961  9148 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.021003  8652 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:20:29.075052  9200 raft_consensus.cc:2764] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:29.075266  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.073566  9198 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:29.071149  9183 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:29.080421  9148 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.056041  9170 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:29.083199  9173 consensus_queue.cc:1175] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b81584b21ed144698954548303f1e507" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260709 13:20:29.055061  9182 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.063510  9188 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.087430  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:29.059845  9037 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:29.066164  9144 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:29.089745  8995 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:29.118065  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.120584  9179 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:29.121073  9200 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:29.125496  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50325us
I20260709 13:20:29.132373  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.086313  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:29.138371  4287 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:29.138896  4287 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:29.141566  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55382.6us
I20260709 13:20:29.119685  9054 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:29.145640  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:29.032572  9146 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.173990  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:29.116312  9037 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:29.179482  4147 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:20:29.179922  9199 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:20:29.180371  9196 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
W20260709 13:20:29.193996  9160 consensus_meta.cc:287] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.006s
I20260709 13:20:29.194721  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:29.184523  9175 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:20:29.194579  9160 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.196771  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:29.149451  9170 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:20:29.198421  9160 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:29.201489  4928 raft_consensus.cc:1217] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Deduplicated request from leader. Original: 8.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 13:20:29.202047  4928 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:20:29.140128  9200 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:29.204628  9200 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.204241  9160 consensus_queue.cc:1059] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:29.205475  9160 consensus_queue.cc:1243] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer b81584b21ed144698954548303f1e507 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:29.208920  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:29.171924  4287 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.213120  4287 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:29.195551  4294 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:29.210651  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:29.151857  8717 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:29.221329  4296 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:29.171031  9123 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:29.143846  9116 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:20:29.214468  9037 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:29.183745  9144 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:29.186269  8995 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:20:29.249891  9142 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:29.233759  9083 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:20:29.226543  8717 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.221412  9184 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:29.234652  9023 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:29.273185  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 97963.2us
I20260709 13:20:29.273756  9023 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:29.274689  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.275429  8736 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.283910  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:29.268527  4287 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:20:29.297186  4287 pending_rounds.cc:85] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 4
I20260709 13:20:29.297334  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:29.258831  9160 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:29.293838  9025 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:29.293493  9144 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.297646  4287 pending_rounds.cc:107] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:20:29.290632  4291 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:29.271708  8717 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:29.307293  4287 raft_consensus.cc:2889] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:29.298331  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 228845us
I20260709 13:20:29.350106  9196 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:29.352468  9201 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:29.353446  9201 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:29.353967  9201 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.328441  9023 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:29.328845  9206 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:20:29.355590  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.290879  9079 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:29.293581  8885 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:29.369038  4287 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:29.389571  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.358304  9203 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:29.392488  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.403326  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.404608  9203 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:29.362767  9206 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:29.302919  9188 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.413957  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:29.405421  9203 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.380213  9023 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:29.418514  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 112376us
I20260709 13:20:29.323258  9182 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:29.405860  9137 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.029s	sys 0.020s
W20260709 13:20:29.421595  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 124350us
I20260709 13:20:29.370352  9079 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.427076  4287 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
I20260709 13:20:29.410899  9160 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:29.422976  9157 consensus_meta.cc:287] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.006s
I20260709 13:20:29.405949  9055 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:20:29.423359  9196 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.449621  9196 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.454958  9188 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:29.432782  9137 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.029s	sys 0.020s
I20260709 13:20:29.447748  9211 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.469259  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:29.447089  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:29.466776  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.482262  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.483167  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.426255  9023 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.488983  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:29.490263  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:29.492141  4142 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:20:29.478823  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.497025  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:29.497264  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:29.455252  9196 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:29.500069  4293 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:29.506865  9143 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:29.507570  9143 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:29.507943  9182 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:29.508651  9142 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:29.508733  9143 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.487468  9123 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.510720  9123 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:29.514281  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.417979  9184 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.514583  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:29.523296  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 52004.2us
I20260709 13:20:29.513159  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.525197  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.527544  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:29.507205  9216 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:29.446316  9160 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.439841  9157 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:29.557816  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:29.571396  4219 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:29.556031  4215 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:29.559800  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:29.561901  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:29.562906  9148 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.566504  9200 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.567814  9213 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:29.568982  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:29.569190  9079 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:29.574405  4220 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:29.570608  9155 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.576642  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:29.629106  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 82336.5us
I20260709 13:20:29.688854  4141 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:29.691967  9123 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:29.474927  9211 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.712601  9226 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:29.534855  9206 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.713307  4147 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:29.541582  9142 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:29.719022  4295 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:29.721374  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 143448us
W20260709 13:20:29.723659  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 196187us
I20260709 13:20:29.556466  9177 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:20:29.743443  4288 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:20:29.755105  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.755777  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 179204us
I20260709 13:20:29.757085  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:29.702960  9083 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:29.771251  9054 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:29.771875  8712 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.776811  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:29.772042  9172 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.772483  9063 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.782214  4146 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:29.783552  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:29.791579  4138 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:29.775563  4261 connection.cc:256] RPC call timeout handler was delayed by -2.1223587780000344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:20:29.777007  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.776789  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:29.777737  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:29.798326  4220 raft_consensus.cc:2376] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13. Re-sending same reply.
W20260709 13:20:29.798949  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.778231  4219 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:29.778532  9177 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.797380  4218 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:29.779815  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:29.780907  9210 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:20:29.703388  9213 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:29.821491  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64562us
I20260709 13:20:29.822499  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:29.771934  9143 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:29.812817  9183 consensus_meta.cc:287] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.005s
I20260709 13:20:29.782187  9182 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:29.786226  9025 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:29.730868  9155 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:29.859531  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.801949  9204 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.806401  9142 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:29.865638  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:29.849026  8736 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.573s	user 0.014s	sys 0.002s
I20260709 13:20:29.823948  9213 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.805576  8712 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.876626  4221 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:29.812752  9063 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.812456  9054 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:29.848671  9175 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:29.852497  9154 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:29.852391  9226 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:29.819788  9177 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.947144  9063 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:29.811355  9172 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.885169  9025 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.852936  9143 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:29.854003  9183 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.010306  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.016572  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.859248  9182 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:29.895869  9175 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.901008  9062 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:30.079480  9223 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.126s	user 0.000s	sys 0.010s
W20260709 13:20:30.080049  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.083243  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 225692us
I20260709 13:20:29.872247  9156 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:20:30.085789  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 288431us
I20260709 13:20:30.084679  4112 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:30.080017  9201 consensus_meta.cc:287] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.726s	user 0.015s	sys 0.001s
I20260709 13:20:30.135226  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:30.139236  4261 connection.cc:256] RPC call timeout handler was delayed by -2.0680967979999423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 13:20:30.144372  4139 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:20:30.145509  4139 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:29.875671  9204 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.140139  4261 leader_election.cc:336] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Timed out: RequestConsensusVote RPC to 127.2.243.66:45005 timed out after 1.524s (SENT)
I20260709 13:20:30.071982  9160 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:30.091147  9175 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:30.082882  8736 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:30.155252  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9441268529999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:20:30.162945  4261 connection.cc:256] RPC call timeout handler was delayed by -1.9261268529999143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:20:30.163465  4261 connection.cc:256] RPC call timeout handler was delayed by -1.8281030000000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 13:20:30.130304  9063 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.136875  9168 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.059s	user 0.015s	sys 0.010s
I20260709 13:20:30.125582  9055 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.125696  9083 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.156160  9195 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:30.200248  9215 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:30.200970  9215 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.201462  9215 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:30.209363  9183 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:30.210377  9183 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.211741  9183 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.161648  4187 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:30.085391  9025 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.156641  9157 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:30.132922  8717 consensus_meta.cc:287] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.779s	user 0.019s	sys 0.004s
I20260709 13:20:30.193153  9211 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:30.197559  9224 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:20:30.198580  8712 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.119789  9142 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.212838  9083 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.163947  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7866858659999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 13:20:30.214972  9148 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:30.267604  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.217176  9137 raft_consensus.cc:3055] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:30.079828  9226 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.220824  9219 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.355s	user 0.000s	sys 0.002s
I20260709 13:20:30.173084  9063 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.224623  4144 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:30.228103  9037 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.961s	user 0.023s	sys 0.002s
W20260709 13:20:30.267047  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7776587779999318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 13:20:30.231858  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:30.327811  4261 connection.cc:256] RPC call timeout handler was delayed by -1.7326858659998834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:20:30.328614  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6312699229999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
I20260709 13:20:30.131542  9062 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.272765  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 106773us
I20260709 13:20:30.166834  9160 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:30.329026  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6242432169999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 13:20:30.141319  9201 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.236254  9233 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:20:30.350083  4261 connection.cc:256] RPC call timeout handler was delayed by -1.6107805300000564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2646s for a response
W20260709 13:20:30.351415  4261 connection.cc:256] RPC call timeout handler was delayed by -1.5535858660000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 13:20:30.344290  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.352246  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4887268529998892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:20:30.354779  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4338858660000824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:20:30.357235  4261 connection.cc:256] RPC call timeout handler was delayed by -1.4086858660000416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 13:20:30.244164  9218 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.436s	user 0.002s	sys 0.000s
W20260709 13:20:30.250777  9210 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:30.319243  8712 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.271286  9137 raft_consensus.cc:740] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:30.241921  9177 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.271962  9173 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.357820  4261 connection.cc:256] RPC call timeout handler was delayed by -1.339326852999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260709 13:20:30.247524  9188 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.243470  9182 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.246275  9204 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.377187  4292 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:30.175277  8736 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.290529  8717 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.381868  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:30.236855  9055 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.376981  9157 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.381625  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3308968540000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 13:20:30.237737  9168 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.394488  4144 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
W20260709 13:20:30.401477  4261 connection.cc:256] RPC call timeout handler was delayed by -1.3260640710000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:20:30.402007  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2139081650000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:20:30.391945  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 307350us
I20260709 13:20:30.237546  9172 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.370090  9191 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:20:30.380228  9241 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.391316  9211 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.388173  9177 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:30.367424  9160 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.360919  9037 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:30.441625  4138 consensus_meta.cc:287] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
I20260709 13:20:30.391184  9123 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.399389  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 518) took 1223 ms. Trace:
I20260709 13:20:30.390018  9188 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.444885  4141 rpcz_store.cc:276] 0709 13:20:29.175833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.176038 (+   205us) service_pool.cc:224] Handling call
0709 13:20:29.176377 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.712034 (+535657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.398950 (+686916us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400077454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:30.399288 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173096320}
I20260709 13:20:30.415911  9238 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.390321  9173 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.376472  8712 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.435089  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 273502us
I20260709 13:20:30.436307  4289 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:20:30.431630  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2907) took 1078 ms. Trace:
I20260709 13:20:30.442167  4138 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
W20260709 13:20:30.443416  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.402364  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1967684769999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 13:20:30.437969  9177 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.430056  4146 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:20:30.413308  9155 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.452271  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:30.455122  9198 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:30.472690  9248 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.473078  9202 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 1.283s	user 0.008s	sys 0.000s
I20260709 13:20:30.473400  9248 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.475317  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 755) took 1431 ms. Trace:
I20260709 13:20:30.461733  4293 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:30.434716  9054 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:30.460569  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1956434969999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 13:20:30.437295  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 68163.7us
I20260709 13:20:30.472424  9198 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.457362  9123 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.437790  9211 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.458477  4290 rpcz_store.cc:276] 0709 13:20:29.353264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.361324 (+  8060us) service_pool.cc:224] Handling call
0709 13:20:29.361834 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.363033 (+  1199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.363066 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:29.371103 (+  8037us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.471782 (+100679us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:29.471851 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.471969 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.431247 (+959278us) raft_consensus.cc:1685] finished
0709 13:20:30.431284 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.431529 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5754,"raft.queue_time_us":5707,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11143,"thread_start_us":50784,"threads_started":1,"wal-append.queue_time_us":125158}
I20260709 13:20:30.410900  9157 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.420738  8652 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:20:30.477777  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1493301599998631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 13:20:30.479651  9198 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.510552  9211 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.444796  9143 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:30.511293  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1071589439998206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:20:30.512121  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0810589440000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:20:30.512719  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0518638319999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
I20260709 13:20:30.513860  9143 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.514037  9201 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:30.486434  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:30.517282  4144 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:30.498139  4222 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
I20260709 13:20:30.483330  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:30.498991  4141 raft_consensus.cc:2376] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13. Re-sending same reply.
I20260709 13:20:30.520902  4143 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:30.501384  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:30.477372  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 823) took 1891 ms. Trace:
I20260709 13:20:30.496265  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:30.499606  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:30.497496  4893 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:30.525000  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:30.511389  9083 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.475744  4216 rpcz_store.cc:276] 0709 13:20:29.043639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.044076 (+   437us) service_pool.cc:224] Handling call
0709 13:20:29.044798 (+   722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.049491 (+  4693us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:29.049952 (+   461us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.120305 (+ 70353us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:29.143933 (+ 23628us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.144109 (+   176us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:29.144153 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.144247 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.403562 (+1259315us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:30.474930 (+ 71368us) raft_consensus.cc:1685] finished
0709 13:20:30.475054 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.475222 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5848,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":5469,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":4775,"spinlock_wait_cycles":57683840,"thread_start_us":69199,"threads_started":1,"wal-append.queue_time_us":120721}
I20260709 13:20:30.514642  9143 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:30.555263  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.522184  4291 rpcz_store.cc:276] 0709 13:20:28.585831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.586196 (+   365us) service_pool.cc:224] Handling call
0709 13:20:28.632219 (+ 46023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.328870 (+696651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.477087 (+1148217us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54002d6ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:30.477295 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513662208}
W20260709 13:20:30.614014  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.586874  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:30.562227  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:30.615794  4140 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:30.498407  9177 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.435369  9241 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.489820  9037 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.529743  9204 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.476300  9248 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.489603  9123 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.477792  9160 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:30.641678  4138 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:30.580868  9198 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:30.630522  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 837) took 1191 ms. Trace:
I20260709 13:20:30.485080  9025 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.681236  4291 rpcz_store.cc:276] 0709 13:20:29.439538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.613374 (+1173836us) service_pool.cc:224] Handling call
0709 13:20:30.629869 (+ 16495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.630105 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.630135 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.630181 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:30.630244 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.630309 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.630449 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:30.584626  9201 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.588060  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2903) took 1260 ms. Trace:
W20260709 13:20:30.483187  9154 consensus_meta.cc:287] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 13:20:30.636305  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2557) took 1157 ms. Trace:
I20260709 13:20:30.689237  4147 rpcz_store.cc:276] 0709 13:20:29.487974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.506347 (+ 18373us) service_pool.cc:224] Handling call
0709 13:20:29.506749 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.713810 (+207061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.636064 (+922254us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540044a554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:30.636243 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474484992}
I20260709 13:20:30.583909  9054 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:30.565266  9173 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.443060  9137 consensus_queue.cc:260] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.640259  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:30.635628  9203 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.203s	user 0.008s	sys 0.009s
I20260709 13:20:30.644476  9242 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:30.652716  9055 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.459830  9238 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.658849  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 145300us
I20260709 13:20:30.659484  9244 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:20:30.635196  9063 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.661830  9241 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.698814  8652 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.667438  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 2876) took 1384 ms. Trace:
I20260709 13:20:30.748382  4221 rpcz_store.cc:276] 0709 13:20:29.283424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.283560 (+   136us) service_pool.cc:224] Handling call
0709 13:20:30.667216 (+1383656us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400181854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:30.667364 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360921728}
I20260709 13:20:30.717320  9137 raft_consensus.cc:3060] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:30.721287  9242 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.671639  9023 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:30.678671  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.700107  9201 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.479139  9175 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.705569  9054 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.691082  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:30.688016  9123 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.696749  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:30.779338  4140 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:30.697979  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 835) took 1274 ms. Trace:
I20260709 13:20:30.621762  9182 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:20:30.699317  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:30.780515  4293 rpcz_store.cc:276] 0709 13:20:29.423187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.501099 (+ 77912us) service_pool.cc:224] Handling call
0709 13:20:29.501530 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.477129 (+975599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.697694 (+220565us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54003548d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:30.697910 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207738624}
W20260709 13:20:30.708611  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 120816us
I20260709 13:20:30.681012  9198 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.729427  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:30.640311  9204 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.700929  9154 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:30.683315  9168 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:30.665753  8712 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.670790  9188 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:30.771500  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.679610  9215 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:30.744444  9213 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.860s	user 0.004s	sys 0.012s
I20260709 13:20:30.686406  4288 rpcz_store.cc:276] 0709 13:20:29.327182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.327503 (+   321us) service_pool.cc:224] Handling call
0709 13:20:29.349789 (+ 22286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.757156 (+407367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.587741 (+830585us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54003539d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:30.587982 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878237440}
I20260709 13:20:30.742605  9025 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.710032  9203 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.801542  4187 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:30.751526  8717 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:30.812075  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 65493.8us
I20260709 13:20:30.812808  9263 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:30.814366  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.768994  9248 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.823662  4139 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:30.841596  8736 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.804383  9198 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.921602  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:30.864763  4140 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:20:30.859905  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59937.6us
I20260709 13:20:30.939541  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:30.755092  8652 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.943270  4144 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:30.901991  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.856724  9234 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.394s	user 0.000s	sys 0.004s
I20260709 13:20:30.948530  4140 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:30.949030  4287 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:30.953954  8652 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.942358  8712 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:30.957422  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:30.958009  9054 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.958360  9160 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:30.866146  9025 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:30.962968  9203 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.857261  9232 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.965416  9204 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:30.802120  9123 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:30.858995  9254 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:30.972882  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 840) took 1146 ms. Trace:
I20260709 13:20:30.817870  9249 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:20:30.856282  9237 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:30.924299  9168 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.989784  4140 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:30.996435  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:30.849866  9213 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:30.935339  9248 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:31.006366  8712 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:30.992118  9157 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:30.996397  9206 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:30.933152  9263 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:30.991063  9216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.020s	sys 0.046s
W20260709 13:20:31.029747  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 228263us
W20260709 13:20:31.079644  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83320.5us
I20260709 13:20:31.081149  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:31.012136  4296 rpcz_store.cc:276] 0709 13:20:29.826977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.971532 (+1144555us) service_pool.cc:224] Handling call
0709 13:20:30.972090 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.972462 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.972494 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.972547 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:30.972584 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.972658 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.972808 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:31.083699  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 841) took 1234 ms. Trace:
I20260709 13:20:31.034158  4140 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:20:31.035669  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54842.4us
I20260709 13:20:31.070333  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.071872  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:31.073150  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.076637  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:31.084259  4296 rpcz_store.cc:276] 0709 13:20:29.849194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.082428 (+1233234us) service_pool.cc:224] Handling call
0709 13:20:31.082906 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.083170 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.083226 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:31.083293 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:31.083344 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.083431 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.083610 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:31.076028  9216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.021s	sys 0.046s
I20260709 13:20:31.102950  4187 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:31.062783  9203 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.101497  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:31.095992  4925 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:31.064834  9200 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:31.038484  9168 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:31.110723  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2898) took 1985 ms. Trace:
I20260709 13:20:31.125641  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 839) took 1552 ms. Trace:
I20260709 13:20:31.113315  9174 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:31.115085  8712 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.129863  4927 raft_consensus.cc:1217] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Deduplicated request from leader. Original: 8.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 13:20:31.120281  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2911) took 1662 ms. Trace:
I20260709 13:20:31.135022  4291 rpcz_store.cc:276] 0709 13:20:29.458181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.692533 (+1234352us) service_pool.cc:224] Handling call
0709 13:20:30.696800 (+  4267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.697256 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.697293 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.697888 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.992852 (+294964us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:30.992915 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.993019 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.119964 (+126945us) raft_consensus.cc:1685] finished
0709 13:20:31.119990 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.120190 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1295,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":17349,"thread_start_us":250086,"threads_started":1,"wal-append.queue_time_us":296272}
I20260709 13:20:31.104195  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:31.124142  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.141268  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.116074  9257 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:20:31.030645  9237 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:31.015527  9232 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:31.136287  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:31.074589  9177 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.109894  9025 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.106189  9055 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:31.106271  9216 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:31.139494  9184 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:31.125222  9182 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:31.129107  4295 rpcz_store.cc:276] 0709 13:20:29.125399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.125582 (+   183us) service_pool.cc:224] Handling call
0709 13:20:29.147985 (+ 22403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.719761 (+571776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.110427 (+1390666us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400277ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:31.110655 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312484608}
I20260709 13:20:31.144771  4927 raft_consensus.cc:1240] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:20:31.129549  4288 rpcz_store.cc:276] 0709 13:20:29.572919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.827168 (+1254249us) service_pool.cc:224] Handling call
0709 13:20:30.926845 (+ 99677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.927168 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:31.068250 (+141082us) log.cc:844] Serialized 14 byte log entry
0709 13:20:31.125270 (+ 57020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:31.125337 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:31.125387 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.125457 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.125582 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2881,"thread_start_us":155619,"threads_started":2}
I20260709 13:20:31.129752  9174 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:31.158113  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2565) took 1639 ms. Trace:
W20260709 13:20:31.159636  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55507.2us
I20260709 13:20:31.183661  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:31.133512  9143 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.161422  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.166275  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 833) took 1794 ms. Trace:
I20260709 13:20:31.106916  9206 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:31.137916  9201 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.139886  9204 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:20:31.169099  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.140472  9175 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.181293  4142 rpcz_store.cc:276] 0709 13:20:29.519021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.532136 (+ 13115us) service_pool.cc:224] Handling call
0709 13:20:29.532746 (+   610us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:29.574312 (+ 41566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.574352 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:29.628747 (+ 54395us) log.cc:844] Serialized 52 byte log entry
0709 13:20:29.878944 (+250197us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:30.136086 (+257142us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.380115 (+244029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.380252 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.655754 (+275502us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:31.143812 (+488058us) raft_consensus.cc:1685] finished
0709 13:20:31.157845 (+ 14033us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.158037 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134274,"prepare.queue_time_us":67030,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":97838,"raft.run_cpu_time_us":6272,"raft.run_wall_time_us":114468,"spinlock_wait_cycles":429687552,"thread_start_us":547847,"threads_started":3,"wal-append.queue_time_us":441477}
I20260709 13:20:31.187904  4287 rpcz_store.cc:276] 0709 13:20:29.371565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.438118 (+ 66553us) service_pool.cc:224] Handling call
0709 13:20:29.441682 (+  3564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.977630 (+1535948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.165855 (+188225us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002779d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:31.166180 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3454135040}
I20260709 13:20:31.192070  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.193817  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.191679  9249 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.204833  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.161865  9055 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:31.181313  9259 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.202s	user 0.002s	sys 0.000s
I20260709 13:20:31.163616  9242 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:31.212653  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:31.165437  9260 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:31.179397  9182 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.220175  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.222702  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.203828  9054 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:31.220780  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.224076  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.210568  9249 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.241662  9249 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.215299  9055 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.221549  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:31.256701  9232 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.257874  9263 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:31.213049  9173 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:31.222268  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2902) took 1895 ms. Trace:
I20260709 13:20:31.259727  9248 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.261126  9168 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.263890  9062 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.265695  9237 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.259496  4294 rpcz_store.cc:276] 0709 13:20:29.326529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.326686 (+   157us) service_pool.cc:224] Handling call
0709 13:20:29.327115 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.329908 (+  2793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.329942 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.650421 (+1320479us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b2c00138c78. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:30.650950 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.735013 (+ 84063us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:30.735055 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.735138 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.221988 (+486850us) raft_consensus.cc:1685] finished
0709 13:20:31.222008 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.222198 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2382,"raft.queue_time_us":7274,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":109,"spinlock_wait_cycles":40325376,"thread_start_us":83556,"threads_started":1,"wal-append.queue_time_us":165822}
I20260709 13:20:31.266709  9213 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:31.267267  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.223277  9260 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:31.227459  4288 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:31.270035  9260 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:31.229087  9268 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:20:31.232383  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:31.239521  9175 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.240641  9216 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.294215  4921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.292688  9123 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.274849  9174 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.297674  9174 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.300376  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.301229  9238 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.301682  9083 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:31.302299  9083 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.225768  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.251585  9177 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.216675  9182 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:31.317715  9180 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:31.318408  9180 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.320544  9246 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:31.321324  9246 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.322288  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.258694  9173 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:31.271258  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.274809  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:31.276975  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.329028  4295 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:31.329828  4221 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
W20260709 13:20:31.279691  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 54826.2us
I20260709 13:20:31.282078  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.334901  4288 raft_consensus.cc:2410] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:31.285907  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.286345  9267 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:31.227108  9054 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.226511  9206 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.292613  9175 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.333076  4185 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:31.340596  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:31.343786  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:31.344739  4287 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.342661  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:31.356221  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.283984  9183 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.360401  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:31.323889  9246 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.364849  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
W20260709 13:20:31.421576  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 56812.6us
I20260709 13:20:31.364034  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:31.372574  9177 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:31.372741  9188 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:31.373555  9081 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:31.348304  9080 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.375231  9173 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:31.375792  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.437763  4215 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:31.339438  9116 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:31.376312  9194 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:31.379827  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2904) took 2051 ms. Trace:
I20260709 13:20:31.380640  9196 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:31.381534  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2572) took 1856 ms. Trace:
I20260709 13:20:31.383713  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:31.383900  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.454597  4143 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:31.449476  4289 rpcz_store.cc:276] 0709 13:20:29.327949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.328087 (+   138us) service_pool.cc:224] Handling call
0709 13:20:29.329264 (+  1177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.458482 (+1129218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.379492 (+921010us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002774d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:31.379749 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2545258880}
I20260709 13:20:31.455432  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.386161  9175 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:31.391685  9187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.009s	sys 0.012s
I20260709 13:20:31.363436  9123 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.358577  9267 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.486009  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.486467  4295 raft_consensus.cc:2410] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:20:31.403599  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.404456  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2908) took 1976 ms. Trace:
I20260709 13:20:31.405834  9215 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.406529  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.489069  4214 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:31.407779  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:31.408113  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.491293  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.409828  9179 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:31.410971  4138 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:31.357321  9238 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:31.426440  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:31.429107  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2566) took 1909 ms. Trace:
I20260709 13:20:31.428926  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.434784  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:31.439028  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:31.433935  9237 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:31.487461  4292 rpcz_store.cc:276] 0709 13:20:29.428394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.737788 (+309394us) service_pool.cc:224] Handling call
0709 13:20:29.738255 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.387828 (+649573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.404160 (+1016332us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400276fd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:31.404390 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468878592}
I20260709 13:20:31.500389  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.496271  4146 rpcz_store.cc:276] 0709 13:20:29.519270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.786160 (+266890us) service_pool.cc:224] Handling call
0709 13:20:29.824680 (+ 38520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.471469 (+646789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.428781 (+957312us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540044c354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:31.429040 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372949248}
I20260709 13:20:31.501284  4292 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
W20260709 13:20:31.441170  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 77220.5us
I20260709 13:20:31.442248  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:31.451790  4287 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:31.465718  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:31.453338  4139 rpcz_store.cc:276] 0709 13:20:29.525257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.146807 (+621550us) service_pool.cc:224] Handling call
0709 13:20:30.147034 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.950049 (+803015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.381196 (+431147us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b540010fc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:31.381443 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555379456}
I20260709 13:20:31.505136  4215 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.497865  4142 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:31.505839  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.477459  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:31.396672  9083 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.343160  9054 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.452795  9213 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.509361  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.509977  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.521620  4221 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:31.522750  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.512750  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:31.513136  4261 leader_election.cc:400] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:31.523717  4261 leader_election.cc:403] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.523828  4147 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:31.516956  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.453121  9196 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:31.518033  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.518929  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.538057  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.539759  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:31.522639  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.540796  4216 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
W20260709 13:20:31.478569  9187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.009s	sys 0.012s
I20260709 13:20:31.454239  9194 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:31.449762  9177 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:31.526643  4261 leader_election.cc:400] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:31.523836  4221 raft_consensus.cc:2410] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:31.525902  4214 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:31.541790  4296 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:31.549646  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:31.504990  9237 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.546213  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:31.525938  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 178264us
I20260709 13:20:31.442162  9188 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.442085  9081 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.558171  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.565217  4144 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.565622  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:31.565999  4147 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:31.566416  4261 leader_election.cc:403] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.590381  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:31.590643  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 64148us
I20260709 13:20:31.592013  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:31.592734  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:31.589181  4295 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:31.594455  4295 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:31.568703  4143 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 7.
I20260709 13:20:31.595470  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2211) took 1210 ms. Trace:
I20260709 13:20:31.595820  4143 rpcz_store.cc:276] 0709 13:20:30.384839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.383405 (+998566us) service_pool.cc:224] Handling call
0709 13:20:31.595408 (+212003us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:31.595844  4295 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:31.597714  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:31.600209  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:31.465133  9116 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.605791  9206 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:31.606841  9206 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:31.608253  9206 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:31.614611  4261 leader_election.cc:400] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16.
I20260709 13:20:31.615182  4261 leader_election.cc:403] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.545536  9196 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:31.548767  9216 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:31.602088  4213 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:31.620532  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:31.622398  4215 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:31.629186  4143 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:31.498193  9123 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.561094  9194 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.515035  9179 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.586082  8712 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.586380  9237 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.520738  9238 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.646067  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.634891  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:31.652127  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 157625us
I20260709 13:20:31.654289  4295 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:31.649168  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:31.642740  9137 consensus_meta.cc:287] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.879s	user 0.006s	sys 0.010s
I20260709 13:20:31.617760  9055 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.686609  4144 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:31.647835  9184 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:31.661329  9188 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.661724  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.701308  4213 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
W20260709 13:20:31.659128  9276 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:20:31.668730  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.665608  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:31.666185  9081 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.679904  9146 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:31.689474  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
W20260709 13:20:31.720827  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55308.7us
I20260709 13:20:31.722057  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:31.671922  9238 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.647696  9243 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:31.695744  4290 raft_consensus.cc:1275] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:31.703286  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.651528  9248 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:31.747462  9241 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:31.747978  9241 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.747826  9248 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.750082  9195 consensus_queue.cc:1059] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:31.750573  9248 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.657845  9242 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:31.715402  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:31.716634  4217 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 17: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:31.736616  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:31.741907  4222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54764 (request call id 756) took 1511 ms (client timeout 1549 ms). Trace:
I20260709 13:20:31.752728  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:31.753140  4222 rpcz_store.cc:269] 0709 13:20:30.230449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.231466 (+  1017us) service_pool.cc:224] Handling call
0709 13:20:31.741682 (+1510216us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54001f7f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:31.741843 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389312384}
W20260709 13:20:31.744791  4141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2205) took 1362 ms (client timeout 1505 ms). Trace:
W20260709 13:20:31.754812  4141 rpcz_store.cc:269] 0709 13:20:30.382870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.451847 (+ 68977us) service_pool.cc:224] Handling call
0709 13:20:31.744546 (+1292699us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b54003da754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:31.744699 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62371712}
W20260709 13:20:31.746307  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.746922  9137 raft_consensus.cc:2764] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:31.687893  9283 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:31.767467  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:31.748484  9241 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.672905  8712 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:31.762732  9249 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.005s
I20260709 13:20:31.743865  9232 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.815220  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 528) took 1222 ms. Trace:
I20260709 13:20:31.807075  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:31.819397  4140 rpcz_store.cc:276] 0709 13:20:30.593176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.103451 (+510275us) service_pool.cc:224] Handling call
0709 13:20:31.103851 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.106943 (+  3092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.106975 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.107506 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.214515 (+107009us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:31.214565 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.214652 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.814939 (+600287us) raft_consensus.cc:1685] finished
0709 13:20:31.814968 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.815139 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2651,"raft.queue_time_us":2758,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":68815,"threads_started":1,"wal-append.queue_time_us":220647}
I20260709 13:20:31.767081  9283 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.761461  9183 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12.
I20260709 13:20:31.765470  9251 raft_consensus.cc:3055] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:31.772457  9238 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:31.772186  9175 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:31.772312  9146 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:31.869705  4147 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:31.864795  9146 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.873955  9146 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:31.874285  9284 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:20:31.831228  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:31.875126  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44048.6us
I20260709 13:20:31.876984  9063 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:31.877935  9063 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:31.881493  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 838) took 2392 ms. Trace:
I20260709 13:20:31.881238  9063 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.764886  9184 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:20:31.867460  9054 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.760399  9243 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.772866  9263 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
W20260709 13:20:31.913017  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.881934  4293 rpcz_store.cc:276] 0709 13:20:29.489133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.793525 (+1304392us) service_pool.cc:224] Handling call
0709 13:20:30.800086 (+  6561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.823047 (+ 22961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.823105 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.834718 (+ 11613us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.968293 (+133575us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:30.968369 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.880947 (+912578us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540025a3d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:31.881085 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.881138 (+    53us) raft_consensus.cc:1685] finished
0709 13:20:31.881149 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.881428 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6475,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"spinlock_wait_cycles":51295360,"thread_start_us":132426,"threads_started":1,"wal-append.queue_time_us":231656}
I20260709 13:20:31.914642  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.843379  9283 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:31.852524  9137 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:31.893936  9184 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:31.853096  9251 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:31.928148  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:31.829016  9249 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:31.894891  9267 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.913157  9179 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.891184  9216 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:20:31.919269  9177 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:31.935029  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.930420  9063 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.940685  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:31.925849  9184 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:31.940162  9198 consensus_meta.cc:287] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.972s	user 0.010s	sys 0.005s
I20260709 13:20:31.933970  9116 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:31.952060  9270 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.006s	sys 0.027s
I20260709 13:20:31.934226  9137 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:31.945212  9055 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:31.967721  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.951484  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:31.988209  9235 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.609s	user 0.005s	sys 0.004s
W20260709 13:20:31.968048  9270 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.006s	sys 0.027s
I20260709 13:20:31.990268  9213 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.997951  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:31.964248  9123 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.009961  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.011114  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.012090  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:32.014937  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.011885  4295 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:31.995522  9054 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:32.036695  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 269281us
I20260709 13:20:32.037014  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.037845  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:31.962150  9198 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.043989  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.058651  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:32.061513  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 295409us
I20260709 13:20:32.068121  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.022989  9146 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:31.967621  9251 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.077382  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:32.041744  9187 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:32.057648  4112 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:32.066713  9174 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.763s	user 0.012s	sys 0.003s
I20260709 13:20:32.084812  4928 raft_consensus.cc:2393] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 15: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:32.057932  9246 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:32.062731  8712 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.098104  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.102473  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.103523  4295 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:32.105373  9290 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:20:32.107452  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.108449  4288 raft_consensus.cc:2393] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 7: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:32.030272  9184 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.109385  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.110173  9184 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:32.082509  9187 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:32.110677  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.105310  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:32.091257  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 240084us
I20260709 13:20:32.121131  4292 raft_consensus.cc:2393] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:32.112833  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 836) took 2673 ms. Trace:
I20260709 13:20:32.128029  4290 rpcz_store.cc:276] 0709 13:20:29.439166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.530459 (+1091293us) service_pool.cc:224] Handling call
0709 13:20:30.530955 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.743030 (+1212075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.112541 (+369511us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003f1e54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:32.112766 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666259200}
I20260709 13:20:32.129921  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.131479  4288 raft_consensus.cc:2410] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:32.129349  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.133002  4295 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:32.083583  9285 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 13:20:32.077872  9213 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:32.092275  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:32.152297  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:32.152988  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:32.154810  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62601.8us
I20260709 13:20:32.090342  9246 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.158004  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:32.160077  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:32.095675  9062 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:32.164462  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:32.164592  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:32.074194  9263 consensus_queue.cc:1059] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:20:32.136253  9251 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:32.114593  9243 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.079411  9146 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:32.165676  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.185343  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.165313  9211 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:32.166507  9246 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:32.188318  4112 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:32.189317  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2502) took 1032 ms. Trace:
I20260709 13:20:32.168264  9062 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.187515  9168 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16.
W20260709 13:20:32.193511  9196 consensus_meta.cc:287] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.551s	user 0.014s	sys 0.003s
I20260709 13:20:32.167307  9270 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:20:32.195288  9301 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:20:32.187728  9054 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:20:32.234637  9062 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:32.198028  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2493) took 1047 ms. Trace:
I20260709 13:20:32.265793  4294 rpcz_store.cc:276] 0709 13:20:31.150216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.399229 (+249013us) service_pool.cc:224] Handling call
0709 13:20:31.399763 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.400309 (+   546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.400373 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.401083 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.641118 (+240035us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:31.935634 (+294516us) log.cc:844] Serialized 14 byte log entry
0709 13:20:31.937255 (+  1621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.937365 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.106178 (+168813us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180021c5e0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf5522 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:20:32.197666 (+ 91488us) raft_consensus.cc:1685] finished
0709 13:20:32.197809 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.197959 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":285676,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":88,"raft.queue_time_us":2596,"raft.run_cpu_time_us":487,"raft.run_wall_time_us":7476,"spinlock_wait_cycles":4842880,"thread_start_us":519023,"threads_started":2,"wal-append.queue_time_us":371242}
W20260709 13:20:32.271430  9182 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.006s
I20260709 13:20:32.184149  9055 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:20:32.272248  9182 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.200857  9146 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:32.275705  9182 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.089098  9137 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.114641  9187 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:32.205785  9237 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.000s
W20260709 13:20:32.205677  9080 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.763s	user 0.010s	sys 0.006s
W20260709 13:20:32.184887  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 172957us
I20260709 13:20:32.297143  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:32.231267  4287 rpcz_store.cc:276] 0709 13:20:31.156936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.504108 (+347172us) service_pool.cc:224] Handling call
0709 13:20:31.506684 (+  2576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.506968 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:31.707092 (+200124us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.187166 (+480074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:32.187242 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:32.187309 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.189000 (+  1691us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.189228 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":343695,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":50,"raft.queue_time_us":61556,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":641938,"threads_started":3,"wal-append.queue_time_us":410028}
W20260709 13:20:32.234741  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47779.9us
W20260709 13:20:32.238924  9302 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:20:32.239511  9205 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:32.230321  9211 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.245770  9242 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:32.256482  9180 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:32.234612  9194 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.014s
I20260709 13:20:32.201470  9198 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:32.281320  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 96283.1us
I20260709 13:20:32.284804  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:32.287285  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.299495  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:32.333184  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 102839us
I20260709 13:20:32.333709  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.334606  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.335376  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.336221  9175 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:32.336670  9175 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.336730  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.337195  9175 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:32.337631  9123 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.337894  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:32.338441  9215 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:32.338832  9263 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:32.339592  9215 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.233222  9243 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:32.341094  9243 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.300654  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:32.344571  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.345782  4287 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:32.347144  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.299820  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.235019  9256 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.235548  9196 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.336722  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:32.237323  9248 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:32.351063  9248 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:32.349951  4220 raft_consensus.cc:1240] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:32.352123  9248 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.351506  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.348718  4217 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
I20260709 13:20:32.308001  9260 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:32.314075  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.303639  9205 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:32.308633  9211 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:32.315642  9275 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.082s	user 0.000s	sys 0.008s
I20260709 13:20:32.282733  9250 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:32.348287  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.359619  9260 raft_consensus.cc:697] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:32.360901  9260 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.360842  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.362593  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.360805  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.363634  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.364638  4213 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.364773  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:32.364946  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.366159  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:32.366504  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.367442  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.368079  4294 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:32.350710  9196 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:32.368969  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:32.369377  9250 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:32.369748  4294 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.371739  9243 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.299810  9172 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:32.375821  4928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 607) took 1678 ms. Trace:
I20260709 13:20:32.378150  9216 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:32.305528  9204 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.381412  4287 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:32.305583  9187 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.393672  4928 rpcz_store.cc:276] 0709 13:20:30.697661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.699041 (+  1380us) service_pool.cc:224] Handling call
0709 13:20:32.375526 (+1676485us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54006d5454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:32.375713 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2954804608}
I20260709 13:20:32.408478  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:32.411890  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:32.413316  4287 raft_consensus.cc:2410] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:32.300638  9237 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.391415  4111 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:32.310365  9242 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:32.305687  9146 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:20:32.389568  4213 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
I20260709 13:20:32.436645  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.446663  4287 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:32.399576  9172 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:32.461637  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:32.331017  9194 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.421964  9080 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:20:32.478018  9215 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:32.478576  9215 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:32.478690  9194 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:32.479023  9175 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.480501  9237 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:32.481160  4145 raft_consensus.cc:2368] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14.
I20260709 13:20:32.482462  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37124 (request call id 534) took 1056 ms. Trace:
I20260709 13:20:32.482846  4145 rpcz_store.cc:276] 0709 13:20:31.425832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.426183 (+   351us) service_pool.cc:224] Handling call
0709 13:20:32.482264 (+1056081us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b5400265554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:32.482399 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242117376}
I20260709 13:20:32.489125  9250 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.416999  9243 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:32.522776  4295 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:32.499902  9249 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:32.503517  9063 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.556s	user 0.014s	sys 0.012s
I20260709 13:20:32.446079  9256 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:32.505066  9205 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.506650  9242 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.507613  9270 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:32.461547  9179 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:20:32.512878  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 51368.6us
I20260709 13:20:32.424654  9204 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.552855  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.489717  8712 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:32.512118  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2906) took 1101 ms. Trace:
I20260709 13:20:32.555238  4216 rpcz_store.cc:276] 0709 13:20:31.410891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.543840 (+132949us) service_pool.cc:224] Handling call
0709 13:20:31.546299 (+  2459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.631092 (+ 84793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.631128 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:31.631175 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:31.631214 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.490951 (+859737us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b54003c28d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:32.511914 (+ 20963us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.512056 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194499840}
I20260709 13:20:32.428517  9304 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:32.532560  4292 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:32.417035  9216 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.479046  9215 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:32.563632  9175 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:32.565033  9280 log.cc:927] Time spent T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.925s	user 0.005s	sys 0.000s
I20260709 13:20:32.569427  4294 raft_consensus.cc:2410] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:20:32.612854  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2490) took 1463 ms. Trace:
I20260709 13:20:32.613448  4291 rpcz_store.cc:276] 0709 13:20:31.149237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.156408 (+  7171us) service_pool.cc:224] Handling call
0709 13:20:31.156957 (+   549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.177348 (+ 20391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.177408 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.198096 (+ 20688us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.420062 (+221966us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:31.437019 (+ 16957us) log.cc:844] Serialized 14 byte log entry
0709 13:20:31.437313 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.437427 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.109419 (+671992us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b180006b860. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:20:32.564263 (+454844us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:32.612470 (+ 48207us) raft_consensus.cc:1685] finished
0709 13:20:32.612509 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.612760 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7096,"prepare.queue_time_us":28618,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":8259,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":28380,"spinlock_wait_cycles":18116608,"thread_start_us":146009,"threads_started":1,"wal-append.queue_time_us":396721}
I20260709 13:20:32.554977  8712 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:32.621084  8712 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:32.625943  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.545403  9270 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:32.576675  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.534024  9243 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.590799  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.591804  9249 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:32.538463  9256 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.605183  9304 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.453146  9278 consensus_queue.cc:1059] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:20:32.602710  9216 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:32.644830  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 253503us
I20260709 13:20:32.630674  9250 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:32.635475  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44761.5us
I20260709 13:20:32.629606  9205 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:32.639690  4214 raft_consensus.cc:2410] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:32.647059  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:32.642663  9283 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.711s	user 0.015s	sys 0.001s
I20260709 13:20:32.651214  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:32.640420  9256 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:32.661900  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 255046us
I20260709 13:20:32.646220  9242 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.668246  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.638574  9063 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.652647  9237 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.682395  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.685405  4218 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:32.690634  9237 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.693554  9237 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.694397  9323 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.698455  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.699164  9304 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.699388  4215 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:32.704442  9249 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:32.705011  9249 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:32.706137  9249 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:32.706938  9318 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:20:32.707571  9249 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:32.673655  9270 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.709254  9062 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.709693  9270 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.711781  9062 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:32.713197  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45065.2us
I20260709 13:20:32.704926  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:32.714813  4924 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:32.698578  4187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.025s	sys 0.024s
W20260709 13:20:32.715649  4187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.025s	sys 0.025s
W20260709 13:20:32.716230  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 1.15064e+06us
I20260709 13:20:32.715262  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.724196  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:32.725943  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 74863us
I20260709 13:20:32.727097  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.729019  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.735517  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 2892) took 1329 ms. Trace:
I20260709 13:20:32.738157  4892 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.736083  4220 rpcz_store.cc:276] 0709 13:20:31.405874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.407577 (+  1703us) service_pool.cc:224] Handling call
0709 13:20:31.407873 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.352061 (+944188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.735168 (+383107us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54003e5154. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:32.735439 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166090624}
I20260709 13:20:32.750262  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.751405  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.737917  9179 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.646629  9172 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.764838  4217 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:32.685416  9182 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:32.769112  9080 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.782079  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:32.764067  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.733237  8652 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.787551  4111 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.668787  9283 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.780941  9172 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:32.756759  9261 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:32.777581  9320 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:20:32.782193  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:32.742050  9278 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.770574  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.805681  4213 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:32.774878  9182 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:32.807299  9182 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.793321  9325 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.808457  9182 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:32.805326  9278 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:32.809556  9278 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.810642  4924 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:32.793692  9123 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.796747  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.819615  9063 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:32.820199  9063 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.820746  9063 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.824030  4216 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:32.827409  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.828948  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.800863  4215 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:32.687549  9211 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.830914  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.832036  9211 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:32.829084  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46870.5us
I20260709 13:20:32.786501  4185 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.782570  9324 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:32.832577  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:32.833705  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 47323.3us
I20260709 13:20:32.834079  4220 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:32.801749  9180 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:32.835042  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.836531  9083 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.837384  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.801622  4218 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:32.838457  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.839188  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.839573  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.840289  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.841930  4214 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:32.836045  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.843384  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.845039  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.845669  9083 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:32.846767  9177 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:32.847142  9177 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:32.847043  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:32.849192  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:32.850435  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 53808.4us
I20260709 13:20:32.832763  9283 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.854460  4213 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:32.858968  4213 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.838467  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.860858  4215 raft_consensus.cc:2410] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:32.864223  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:32.864969  4220 raft_consensus.cc:2368] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:32.867244  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.867671  4215 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:32.868918  4215 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:32.870072  4215 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:32.781939  9316 consensus_queue.cc:1048] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:20:32.872084  4215 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:32.859663  9123 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.878180  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.884783  4215 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.885389  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.848394  9177 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.893606  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:32.872861  9283 raft_consensus.cc:2764] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:32.904484  9180 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:32.905704  8712 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.908598  4217 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:32.914917  9278 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.882584  9248 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:32.899261  9304 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.917889  9256 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.918545  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2937) took 1040 ms. Trace:
I20260709 13:20:32.919906  9256 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.918884  4287 rpcz_store.cc:276] 0709 13:20:31.878115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.447819 (+569704us) service_pool.cc:224] Handling call
0709 13:20:32.454326 (+  6507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.603624 (+149298us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:32.604098 (+   474us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.794949 (+190851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:32.794999 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:32.795045 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.917511 (+122466us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b1800421000. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbc32a6 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419
0709 13:20:32.918302 (+   791us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54002963d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:32.918348 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.918489 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":870,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":91,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6021,"spinlock_wait_cycles":350680704,"thread_start_us":190363,"threads_started":1,"wal-append.queue_time_us":271144}
I20260709 13:20:32.921515  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:32.877835  9216 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:32.887605  9311 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:32.928570  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.929057  9283 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:32.929693  4220 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:32.904495  9246 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.005s
I20260709 13:20:32.936270  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.877127  9313 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.901387  9243 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.937886  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:32.958513  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.956063  4222 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:32.925490  8712 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:32.945340  9238 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:32.965592  9062 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:32.975519  9278 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.975811  9215 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.979506  4216 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 8.
I20260709 13:20:32.965938  8652 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:32.963568  9313 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:32.986318  9204 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:32.937733  9216 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.987666  4219 raft_consensus.cc:2410] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:32.988502  9180 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.989519  9063 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:32.991338  9304 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:32.997882  9215 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.004575  9196 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:33.005923  4218 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:33.006762  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:32.957921  9246 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:32.961733  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 112618us
W20260709 13:20:33.007715  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145174us
I20260709 13:20:33.021015  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:33.022939  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48002.1us
I20260709 13:20:33.023633  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:33.023895  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.006218  9238 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:33.026145  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:33.028030  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.011317  8652 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:33.018326  9196 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:33.018178  9137 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:33.055120  4187 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.036459  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:33.037488  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.039649  4287 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:33.025094  9211 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:33.042256  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.062214  4143 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:33.042701  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.063380  4142 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.044672  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.046315  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.047580  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.049189  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.041054  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.066161  4144 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.066259  4145 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:33.027120  9215 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:33.029562  9204 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:33.032171  9241 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.224s	user 0.016s	sys 0.003s
I20260709 13:20:33.033195  9062 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:33.068226  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.029495  9172 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:33.069998  4187 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.070181  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.068229  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.065531  4141 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:33.085341  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.022667  8885 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:33.058342  9278 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:33.058602  9238 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.087499  4138 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:33.085719  4147 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:33.089895  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.121814  4296 raft_consensus.cc:2376] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15. Re-sending same reply.
I20260709 13:20:33.096832  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.123025  4290 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:33.094592  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.135710  4140 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:33.127784  4143 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:33.090907  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.131732  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.136713  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.137290  4140 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:33.137522  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.137533  4142 raft_consensus.cc:2410] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:33.138075  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.143523  8885 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:33.143965  8885 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:33.144307  4217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:33.144924  8885 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:33.146274  8885 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:33.069793  9215 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:33.145011  4217 raft_consensus.cc:606] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.146948  4217 raft_consensus.cc:614] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:33.147001  4290 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:33.095054  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.151662  4893 leader_election.cc:400] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14.
I20260709 13:20:33.146767  9215 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.152810  4142 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:33.153637  8652 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:33.156610  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:33.153928  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.157379  4293 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:33.157660  4142 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:20:33.158303  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.158896  4142 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:33.160036  9216 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:33.160933  9330 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:20:33.161396  9215 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.167349  4143 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:33.068013  9332 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:33.169516  9175 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:33.197206  9313 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:33.198307  9333 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:20:33.199584  9063 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.031266  9331 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:20:33.200762  9246 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.209975  9183 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:33.256542  9175 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.083504  9204 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:33.217903  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 87876.3us
I20260709 13:20:33.222307  4146 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:33.238909  4112 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.239953  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.241325  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.280774  4138 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:33.243723  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.116765  9172 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.132889  8712 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:33.284819  9211 consensus_queue.cc:1059] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:33.247284  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.285925  4143 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.286317  9175 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.287461  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:33.059880  9137 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.289718  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:33.290349  9137 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:33.282506  9204 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.268729  9331 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:33.293658  9331 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:33.294427  9331 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.295531  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:33.297801  9211 raft_consensus.cc:3055] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:33.298395  9211 raft_consensus.cc:740] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:33.251510  9304 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:33.300675  9304 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.302722  9304 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.233923  9238 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.263660  9123 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:33.271572  4218 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:33.121673  9241 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.241859  9216 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:33.245471  9080 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.283072  4147 raft_consensus.cc:2410] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:20:33.281625  4112 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:33.283947  4140 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.319396  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:33.284158  9246 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.324393  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:33.324456  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:33.265520  4145 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 17: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:33.325248  4294 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:33.325346  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.326503  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:33.327240  4292 raft_consensus.cc:2393] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:33.323263  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.327939  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.328887  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.320454  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:33.288131  4221 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:33.320670  4139 raft_consensus.cc:2410] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:33.297888  9215 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.323662  4925 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:33.282449  9172 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.332922  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:33.333333  4186 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:33.333889  4296 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:33.334688  9332 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:33.335212  9332 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:33.335894  4296 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:33.313558  8712 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:33.336162  9332 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.337155  8712 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.299496  9211 consensus_queue.cc:260] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:33.320811  4112 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:33.344674  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:33.332094  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:33.336309  4296 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:33.340279  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.322659  9248 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:33.328962  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.349231  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.340931  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:33.341187  4142 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:33.312150  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 74725.8us
I20260709 13:20:33.264587  4144 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:33.324697  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:33.342293  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.352317  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.353209  4144 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:33.345860  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:33.348371  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.356133  4294 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:33.356657  4138 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:33.357823  4287 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:33.358178  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.343601  4143 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:33.369915  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:33.369347  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 248599us
I20260709 13:20:33.363210  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.373202  4143 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:33.374171  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.375381  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.370939  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.378145  4289 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 8: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:33.346771  4296 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.340531  9329 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:33.382371  4140 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
I20260709 13:20:33.391455  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.378530  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:33.382946  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.396247  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.397746  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:33.419873  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.396473  4143 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:33.370280  9205 consensus_meta.cc:287] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.709s	user 0.006s	sys 0.004s
I20260709 13:20:33.317696  9270 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:20:33.404510  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.403684  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:33.348989  9248 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.370955  9123 raft_consensus.cc:2764] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:33.359051  9215 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:33.318907  9216 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.370083  9237 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.320853  9080 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.370191  9174 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.420706  4296 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:33.359225  9307 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:33.428887  4147 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:33.394486  9182 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:33.403879  9063 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:33.431954  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.437335  4143 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:33.437372  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:33.410364  9251 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.443429  4138 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.424196  9175 raft_consensus.cc:2764] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:33.407510  9260 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:20:33.410866  9342 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:33.430359  9211 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:33.433089  9248 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:33.444027  9177 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:33.401861  9304 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:33.501470  8712 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:33.533493  9342 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:33.446077  9063 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.536197  9063 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.536723  9342 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:33.534521  9180 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:33.514242  9216 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:33.538283  9180 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:33.538480  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:33.500684  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.539213  4925 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:33.539186  9180 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.443218  9338 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:33.540611  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:33.540931  9180 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.444973  9215 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:33.485224  9251 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:33.510120  9336 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:20:33.542145  9215 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:33.511037  9334 log.cc:927] Time spent T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:20:33.543589  9251 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.442876  9237 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:33.529156  9322 log.cc:927] Time spent T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:20:33.545972  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 97474.8us
I20260709 13:20:33.442412  4144 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:33.548627  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.549296  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.572106  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.573208  4143 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:33.576678  4138 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:33.582808  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.583725  4138 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:20:33.583078  4296 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:20:33.585075  4296 pending_rounds.cc:85] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:33.585486  4296 pending_rounds.cc:107] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:20:33.586023  4296 raft_consensus.cc:2889] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:33.518364  9340 log.cc:927] Time spent T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:33.498026  9080 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.579567  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:33.590158  4261 leader_election.cc:400] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14.
I20260709 13:20:33.593719  9338 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:33.596056  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.597224  4141 raft_consensus.cc:2393] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:33.571749  9137 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:33.598673  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.577594  9342 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:33.581709  9329 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:33.607298  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:33.622658  9337 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:33.627125  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.615446  9339 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:20:33.607314  9342 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:33.628123  4138 raft_consensus.cc:1813] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Handling vote request from an unknown peer 34e6205f3c1d434193126fef20d73800
I20260709 13:20:33.631124  4138 raft_consensus.cc:2410] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:33.580039  9183 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:20:33.628754  9216 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:20:33.634035  9313 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:33.634553  9313 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:33.634156  4138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:33.640983  4138 raft_consensus.cc:606] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:20:33.642537  4138 raft_consensus.cc:614] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:33.642850  4144 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:20:33.635540  9313 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:33.643187  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 272317us
I20260709 13:20:33.644824  4144 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:33.646306  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:33.647816  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:33.648257  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.649786  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.650262  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.650848  4220 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:33.631747  9342 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.666960  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:33.685371  4220 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:33.686329  4144 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:33.592648  8712 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.690486  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:33.690380  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:33.627723  9260 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:20:33.648188  9337 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:33.703125  9183 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:33.705350  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:33.706000  9348 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:33.720422  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:33.722425  4220 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:33.727101  4144 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:33.728803  4138 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:33.730126  9337 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:33.743932  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:33.692093  9313 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:33.757046  4294 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:33.758333  4142 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:33.763088  4145 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:33.764880  4145 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:33.765827  4144 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:33.717144  9183 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:33.853875  9183 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.855047  9183 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.730388  9062 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:33.856528  9062 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.856947  9062 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.856709  9196 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.857765  9196 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:33.774067  9357 consensus_queue.cc:1059] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:33.766306  9175 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:20:33.775144  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:33.865582  4290 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:33.731432  9172 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.869948  9172 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:33.792752  4893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.521s (SENT) [suppressed 13 similar messages]
I20260709 13:20:33.871534  4217 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:33.878316  9335 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:33.878756  9335 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:33.879539  9335 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.883745  4140 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:33.782881  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40b291caa9a64e83948693294f96069d"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
W20260709 13:20:33.790777  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.780153  9237 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.784320  9351 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:33.797058  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 189837us
I20260709 13:20:33.820076  9241 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.886893  9351 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:33.814800  9331 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:33.889259  9351 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:33.893139  4147 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
W20260709 13:20:33.812491  9345 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.377s	user 0.004s	sys 0.007s
I20260709 13:20:33.895138  4147 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:33.782115  9344 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:20:33.809058  9337 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.828899  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:33.818698  4139 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:33.832759  9204 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.004s
I20260709 13:20:33.898638  9204 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.900096  4222 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:33.845772  4142 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:33.901275  9204 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.747762  9329 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.903080  9248 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.904299  4143 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:33.762234  9339 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:33.905933  9339 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:33.906865  9339 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.819379  8712 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.836762  9238 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.838371  4294 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:33.840660  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.841099  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:33.818121  9063 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:33.798460  9354 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:20:33.849220  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.849026  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:33.851728  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.852741  9177 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:33.891744  9335 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.908181  9339 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:33.945317  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.933007  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.914394  4146 raft_consensus.cc:606] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.949429  4146 raft_consensus.cc:614] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:33.950172  4295 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
W20260709 13:20:33.951889  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 111317us
I20260709 13:20:33.953163  4138 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:33.964166  8712 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:33.965116  4290 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:33.973968  4221 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:33.974829  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.975399  9062 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.976147  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.977878  4187 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.978366  9063 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:33.978912  9177 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:33.920291  4139 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:33.979703  9177 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:33.917294  4147 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:33.980660  9177 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:33.934010  4142 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:20:33.797390  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 70992.6us
I20260709 13:20:34.006910  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.003896  4213 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:33.978968  9063 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:34.022135  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:34.022876  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:34.024278  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.025561  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:34.025784  4111 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.026540  4220 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:34.029130  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 51313.5us
I20260709 13:20:34.030090  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.983484  9342 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:34.038002  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.036893  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 244164us
I20260709 13:20:34.072045  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:34.072875  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:33.943691  9248 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.038551  9331 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:34.092941  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.043412  9351 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.093250  9337 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:34.073395  9183 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.098249  9172 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.091988  9215 raft_consensus.cc:2764] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:34.106112  9174 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:34.109553  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.114390  9080 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:34.097563  9062 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.068773  9204 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:34.077296  8885 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.078048  9175 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:34.041268  9238 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:34.047529  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.082724  9242 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.127315  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:34.055450  4893 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:34.091663  9338 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.132416  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 244910us
I20260709 13:20:34.164640  9338 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.165002  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:34.165402  9342 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:34.129894  9183 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.166786  9338 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:34.167330  9338 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:34.167733  9183 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:34.167809  9338 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.077823  9237 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:20:34.169301  9080 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:34.145946  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 98534.2us
I20260709 13:20:34.170202  9080 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.170848  9260 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:34.170925  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.148202  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.170269  9137 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:34.172049  9137 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.153317  8885 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.173048  9137 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.173352  4187 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.174190  9137 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.174412  8885 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.134760  9174 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.176559  9063 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.171978  9313 raft_consensus.cc:3055] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:34.177309  9313 raft_consensus.cc:740] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:34.153566  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.154628  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 99304.2us
I20260709 13:20:34.178215  9313 consensus_queue.cc:260] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.179574  9313 raft_consensus.cc:3060] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:34.094935  9216 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:20:34.180773  9216 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:34.181154  9216 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.181329  9172 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.156642  9331 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:34.157032  9242 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.181849  9172 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.181954  9216 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.183293  9216 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.183553  9242 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.183790  9172 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.158180  4110 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:34.159653  9195 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:34.184664  9195 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.185016  9195 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:34.188387  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:20:34.189841  4040 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 175) took 22880 ms (client timeout 15000 ms). Trace:
I20260709 13:20:34.146309  4924 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:34.152725  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:34.176733  9342 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:34.193244  4216 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.193351  9342 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:34.194270  9342 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.194907  9215 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:34.151194  9211 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:34.127013  9337 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.198837  9337 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:34.192601  9238 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:20:34.201016  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.171339  9260 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.202586  9260 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.203907  9211 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:34.184211  4044 catalog_manager.cc:5697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.205123  4044 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 7 to 8, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.206171  9238 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.207715  4044 catalog_manager.cc:5697] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.208309  9329 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:34.210265  4044 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.228262  4926 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
W20260709 13:20:34.221964  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.190325  4040 rpcz_store.cc:269] 0709 13:20:11.309104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.309429 (+   325us) service_pool.cc:224] Handling call
0709 13:20:34.189604 (+22880175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:26.224037 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:26.366043 (+142006us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:26.366096 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:20:26.366138 (+    42us) tablet.cc:662] Decoding operations
0709 13:20:26.427799 (+ 61661us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:26.447813 (+ 20014us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:26.451005 (+  3192us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:20:26.613978 (+162973us) tablet.cc:701] Row locks acquired
0709 13:20:26.614046 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:20:26.614325 (+   279us) write_op.cc:270] Start()
0709 13:20:26.614665 (+   340us) write_op.cc:276] Timestamp: P: 1783603226614235 usec, L: 0
0709 13:20:26.614711 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:20:26.768381 (+153670us) log.cc:844] Serialized 9797 byte log entry
0709 13:20:27.245318 (+476937us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ecdde28 00007fee42718581 00007fee42717d58 00007fee4271c9f1 00007fee4271c9a9 00007fee4271c939 00007fee4271c901 00007fee4271bb2d 000000000038f354 000000000038f199
0709 13:20:27.369120 (+123802us) op_driver.cc:464] REPLICATION: finished
0709 13:20:27.669846 (+300726us) write_op.cc:301] APPLY: starting
0709 13:20:27.669957 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:28.398330 (+728373us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:28.398385 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:30.498179 (+2099794us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:30.652674 (+154495us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:20:30.652759 (+    85us) write_op.cc:312] APPLY: finished
0709 13:20:30.653427 (+   668us) log.cc:844] Serialized 220 byte log entry
0709 13:20:30.834481 (+181054us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:30.834901 (+   420us) write_op.cc:454] Released schema lock
0709 13:20:30.835015 (+   114us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:30.840505 (+  5490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:30.840542 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22295,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":281378,"apply.run_cpu_time_us":80674,"apply.run_wall_time_us":3170644,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108677,"num_ops":25,"prepare.queue_time_us":452876,"prepare.run_cpu_time_us":22537,"prepare.run_wall_time_us":1060488,"raft.queue_time_us":178217,"raft.run_cpu_time_us":64418,"raft.run_wall_time_us":266702,"replication_time_us":744145,"spinlock_wait_cycles":31636224,"thread_start_us":686323,"threads_started":5,"wal-append.queue_time_us":217726,"wal-append.run_cpu_time_us":36651,"wal-append.run_wall_time_us":2504342}]]}
I20260709 13:20:34.204166  9260 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:34.224670  9172 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.225109  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.224066  4216 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
W20260709 13:20:34.257262  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.257654  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81292.3us
I20260709 13:20:34.176889  9174 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.215775  9338 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:34.233037  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 63565us
I20260709 13:20:34.236123  9195 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.237527  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:34.238761  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:34.240631  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.222335  9337 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:34.242247  9216 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:34.242851  9137 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:34.243672  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:34.285946  4138 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:34.246224  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:34.246886  4143 raft_consensus.cc:1275] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:20:34.247159  4147 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:34.247802  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:34.248569  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:34.248711  4185 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:34.233852  4044 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 4 to 7, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 7 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.287123  4893 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:34.250067  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:34.258872  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.266089  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.269438  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.291234  4287 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:34.269860  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.271291  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:34.273138  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:34.292248  4294 raft_consensus.cc:2410] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:34.281226  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.281523  4141 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:34.285202  4112 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:34.280076  4146 raft_consensus.cc:2376] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b81584b21ed144698954548303f1e507 in term 15. Re-sending same reply.
I20260709 13:20:34.293473  4144 raft_consensus.cc:606] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.284178  9337 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.295357  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:34.297159  9337 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:34.297736  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:34.298858  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.299005  9251 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:34.299444  9251 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.300084  9251 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:34.302050  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:34.303226  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:34.303772  4295 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:34.304749  9137 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.289872  9368 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:34.306106  9368 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:34.306180  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.306529  9368 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:34.306859  4291 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 11.
I20260709 13:20:34.306933  9137 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:34.307580  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 58951.9us
I20260709 13:20:34.308616  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:34.308954  8712 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:34.309444  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:34.309629  9256 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:34.309881  9196 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:34.310149  4296 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:34.256867  9172 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.310503  9196 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:34.311414  9196 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.291076  9216 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.312222  9172 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.313179  4290 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:34.313709  9216 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:34.288784  4044 catalog_manager.cc:5697] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:34.315001  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:34.315599  4925 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:34.315344  4044 catalog_manager.cc:5697] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.279549  9370 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.316430  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.279717  9063 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:34.317682  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.318064  9063 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 17 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:34.319058  9063 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.319872  9215 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:34.320508  8652 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:34.321543  4187 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:34.323086  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.323772  9329 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:34.324285  9329 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:34.325145  9329 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.327014  4288 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:34.327422  4044 catalog_manager.cc:5697] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.328953  9331 raft_consensus.cc:2804] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:34.329519  9331 raft_consensus.cc:697] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:34.329131  4044 catalog_manager.cc:5697] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:34.330350  9331 consensus_queue.cc:237] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.332517  9353 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.309471  8712 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:34.309981  9256 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:34.336072  4259 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:34.299400  4289 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:34.326680  9368 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.331653  4044 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.340298  4214 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:20:34.342339  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 61186.8us
I20260709 13:20:34.344621  4926 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:34.350179  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.353037  4294 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:20:34.353425  4294 pending_rounds.cc:85] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:20:34.353647  4294 pending_rounds.cc:107] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:20:34.353878  4294 raft_consensus.cc:2889] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.345551  8712 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.363344  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.367723  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.368323  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:34.376719  4290 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:20:34.377147  4290 pending_rounds.cc:85] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:20:34.377470  4290 pending_rounds.cc:107] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:20:34.361649  4892 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:34.377736  4290 raft_consensus.cc:2889] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.378209  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.380439  4288 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:34.379953  4295 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:34.386078  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:34.343500  9256 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:34.288525  9177 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:20:34.391198  9311 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:34.391992  9243 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.393543  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:34.407269  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ca04a09529497898d86f573a0e1189"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:34.407493  4144 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:34.316776  9370 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.362566  9283 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.396153  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.388618  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.352727  9337 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.407863  4146 raft_consensus.cc:606] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.394153  9339 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:34.410413  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:34.380271  9183 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:34.385782  9356 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:34.396500  9187 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:34.365590  9179 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:20:34.431981  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 45975.2us
I20260709 13:20:34.367781  9204 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:20:34.423352  4144 raft_consensus.cc:2468] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 8.
I20260709 13:20:34.424688  9183 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:34.430500  9356 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:34.459980  9183 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:34.460434  9356 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:34.449697  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.396592  9174 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:20:34.433848  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.466310  4290 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:34.431025  9342 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:34.418180  9283 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.431501  9187 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.478044  9342 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.485773  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.434005  9339 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.450663  9195 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.462430  9337 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:34.411470  9243 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.451015  9177 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:34.492010  9187 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:34.492249  9216 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.497732  9342 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:34.480741  9353 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:20:34.516592  9370 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:34.506209  9369 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:34.506091  9337 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:34.531272  9183 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.508662  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:34.572952  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 64372.9us
I20260709 13:20:34.573832  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
W20260709 13:20:34.537007  9371 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:34.543257  9368 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:34.509424  4893 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.576864  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:34.577702  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 68377.5us
I20260709 13:20:34.578421  9183 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:34.578926  4893 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:34.579037  9183 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:34.557169  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.579767  9242 raft_consensus.cc:2804] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:34.580271  9242 raft_consensus.cc:697] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 15 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:34.580081  9339 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.580754  9174 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.581410  9174 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:34.581231  9242 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.582024  9080 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:34.582391  9080 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:34.583173  9080 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.584092  9283 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.576422  9216 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:34.589859  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:34.603684  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:34.571336  9204 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.598201  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.575131  9369 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:34.575310  9337 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.611886  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
W20260709 13:20:34.621183  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 210825us
I20260709 13:20:34.628904  4146 raft_consensus.cc:606] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.629323  4146 raft_consensus.cc:614] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:34.631902  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.633020  8712 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:20:34.633749  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 208397us
I20260709 13:20:34.571702  9260 consensus_queue.cc:1059] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:20:34.580776  9261 raft_consensus.cc:2804] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:34.638201  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:34.584302  9080 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.642426  8712 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:34.588115  9370 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:34.645871  4217 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:34.659571  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:34.631474  9369 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:34.642640  9368 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:34.585835  9251 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.680294  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.687677  4287 raft_consensus.cc:2410] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:34.638760  9216 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.594508  9187 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.655601  9256 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.628539  9204 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.674176  9370 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.643836  9313 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:20:34.681551  9063 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:34.681913  9261 raft_consensus.cc:697] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:20:34.652897  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.651026  4924 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:34.652920  8712 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:34.673542  9177 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:34.726333  8712 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:34.743389  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 111575us
I20260709 13:20:34.744894  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:34.752252  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.701493  9331 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.755751  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.732373  9063 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.766274  9063 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:34.762486  9331 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.768533  9243 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:34.783821  4924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c130eddd78204cee994818f0043bf88c"
dest_uuid: "b81584b21ed144698954548303f1e507"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:33560
I20260709 13:20:34.803232  4924 raft_consensus.cc:606] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:34.780203  9137 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:34.787691  9378 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:20:34.785619  9387 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:20:34.785102  9374 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:20:34.812736  4259 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:20:34.842410  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.835779  9368 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.885342  9204 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.779363  9338 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:20:34.837576  9137 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.836843  9380 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:34.893795  9385 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:34.894121  9137 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.895398  9338 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:34.895956  9383 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.879362  9256 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.896492  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
W20260709 13:20:34.905246  9381 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:34.905576  9383 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.777168  9216 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.781991  9261 consensus_queue.cc:237] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.915071  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:34.923293  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 200098us
I20260709 13:20:34.918144  9311 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.896492  9187 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.900156  9251 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:34.892432  9395 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:34.933678  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.935883  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 349380us
W20260709 13:20:34.938835  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 183153us
I20260709 13:20:34.946506  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:34.949512  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:34.950456  4924 raft_consensus.cc:2410] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:34.949533  4287 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:34.951078  4287 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:34.951853  4287 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:34.952692  4287 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:34.963040  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 328020us
I20260709 13:20:34.901696  9380 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:34.970711  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:34.973474  4296 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
W20260709 13:20:34.945569  9390 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:20:34.995525  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:34.997341  4221 raft_consensus.cc:1240] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:34.997538  4214 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:34.997753  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:34.999423  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:34.999616  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:35.000159  4216 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:35.000217  4222 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:35.000684  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:35.001807  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:35.002573  9391 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:20:35.002962  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:35.003324  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:34.999289  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:35.004139  4219 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:20:34.945465  9398 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:35.009841  9398 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:35.011058  9398 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.004724  4213 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:34.939328  9397 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:35.001336  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:35.003295  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:35.004629  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:35.007208  4287 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:20:35.015941  4287 pending_rounds.cc:85] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 8
I20260709 13:20:35.008736  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:35.016716  4287 pending_rounds.cc:107] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:20:35.017189  4287 raft_consensus.cc:2889] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.930495  9311 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.058625  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:34.964397  9260 consensus_queue.cc:1048] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:35.088937  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:35.090256  4218 raft_consensus.cc:2368] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 17. Current term is 18.
I20260709 13:20:34.958501  9368 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:35.120441  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 173952us
I20260709 13:20:35.123461  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:35.073226  9398 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.127265  4218 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:35.103173  9403 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:35.129385  9395 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:35.151430  4924 raft_consensus.cc:3060] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:35.096441  9369 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:35.145406  9389 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 13:20:35.191186  9337 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.003s
I20260709 13:20:35.194379  9311 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:35.199875  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:35.178704  9388 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:20:35.210805  4924 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:35.156061  9403 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:35.209007  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:35.166203  9215 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.164652  9383 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:35.226532  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 103479us
I20260709 13:20:35.159787  9397 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:35.166257  9370 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:35.220328  9337 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:35.245956  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.246263  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.246831  4144 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:35.247929  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.248870  4140 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:35.249663  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.250502  4143 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:35.251322  4145 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:35.226390  9418 raft_consensus.cc:993] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:35.252399  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:35.253357  4291 raft_consensus.cc:2410] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:20:35.256114  4143 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:35.247802  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.257136  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.257233  4142 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:35.257920  4141 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:35.257896  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.258723  4140 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:35.258925  4139 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:20:35.259137  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 200605us
I20260709 13:20:35.254940  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.260295  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:35.260493  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.267025  4296 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:35.270048  4261 leader_election.cc:400] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 17. Current term is 18.
I20260709 13:20:35.270641  4261 leader_election.cc:403] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:35.272629  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.273394  4147 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.266825  9368 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:35.280459  4141 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:35.253963  9370 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.283823  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:35.288481  9370 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.272326  9315 raft_consensus.cc:993] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:35.234931  9215 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.298408  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.313061  4141 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:35.313902  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.314572  4144 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:35.315380  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.315622  9370 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:35.316208  9370 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.316711  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.317747  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.318331  9414 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:35.318842  9414 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.321013  9430 raft_consensus.cc:1081] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:35.322101  9430 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:35.322527  9430 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.324921  9369 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:35.327112  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 55147us
I20260709 13:20:35.332420  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.309618  4147 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:35.348016  4144 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.350852  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:35.359700  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 124817us
I20260709 13:20:35.361202  4147 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:35.370725  4147 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:20:35.351604  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.373852  4139 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:35.346093  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.384754  4146 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:35.498579  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 107693us
I20260709 13:20:35.417160  9431 raft_consensus.cc:1081] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:35.386312  4143 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:35.417739  9427 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.510916  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:35.400084  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.444199  9179 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:35.514423  4924 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:35.310636  9380 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:35.346052  9398 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:35.458841  9215 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:35.414593  9356 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.954s	user 0.008s	sys 0.005s
I20260709 13:20:35.366745  9402 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:20:35.455372  9342 consensus_meta.cc:287] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.881s	user 0.009s	sys 0.002s
I20260709 13:20:35.352766  9397 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:35.415205  9428 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:35.351662  9430 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:35.460673  9414 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:35.416006  9399 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:20:35.413939  9408 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.291s	user 0.000s	sys 0.006s
I20260709 13:20:35.466749  4218 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:35.364218  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:35.394063  4147 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:20:35.539584  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 175548us
I20260709 13:20:35.540205  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.540701  9260 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:35.540572  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:35.541225  9260 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.375773  4141 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:35.541621  9260 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:35.411556  9080 consensus_meta.cc:287] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.001s
I20260709 13:20:35.542215  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:35.385401  8652 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.543027  8652 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.543784  9404 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:35.544507  9404 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:35.545222  8652 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:35.431980  4144 raft_consensus.cc:2468] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
I20260709 13:20:35.502297  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.512204  4139 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:35.546963  9432 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:35.440021  9331 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:35.516736  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:35.548730  4893 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:35.520663  4288 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:20:35.549721  4288 pending_rounds.cc:85] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 9
I20260709 13:20:35.550037  4288 pending_rounds.cc:107] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:20:35.550305  4288 raft_consensus.cc:2889] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:35.509013  9418 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.551514  9418 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.513538  9179 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:35.517433  9398 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.552793  9080 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:35.553181  9398 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:35.553578  9080 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:35.555133  9432 raft_consensus.cc:2804] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:35.555708  9432 raft_consensus.cc:697] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:35.421550  9311 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:35.556623  9432 consensus_queue.cc:237] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:35.556670  9311 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.517127  9382 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:35.559449  9311 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:35.561270  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:35.549815  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:35.563500  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:35.511693  9313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.000s	sys 0.016s
I20260709 13:20:35.522398  9353 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:35.578363  4296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c130eddd78204cee994818f0043bf88c"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:47710
I20260709 13:20:35.579061  4296 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:35.579494  4296 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:35.589100  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:35.519025  9383 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:20:35.569559  9313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.000s	sys 0.017s
I20260709 13:20:35.614171  9403 consensus_queue.cc:1059] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:20:35.620455  9424 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:20:35.621299  9425 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:35.614670  9410 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:35.527503  9342 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.624482  9426 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.517874  9427 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.624614  9441 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:35.576886  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:35.646601  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69833.9us
I20260709 13:20:35.646956  4221 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:35.651363  9419 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.384s	user 0.001s	sys 0.001s
I20260709 13:20:35.640985  9313 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:35.652819  9313 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:35.653345  9313 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.660183  9424 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.660362  9250 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:35.660826  9424 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.662962  9424 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:35.664243  9383 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:35.663388  9424 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.625886  9370 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 17. Current term is 18.
W20260709 13:20:35.626896  9063 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.001s
I20260709 13:20:35.581734  9353 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.546952  9404 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:35.612449  9382 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:35.579119  9331 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:35.566097  9369 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.526682  9356 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.665237  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:35.666381  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:35.673856  9353 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:35.667984  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.677114  9250 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:20:35.669834  4139 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:35.679404  4146 raft_consensus.cc:2393] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 10: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:35.680474  4139 raft_consensus.cc:1275] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:35.680833  9427 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:35.682893  9394 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.677s	user 0.003s	sys 0.003s
I20260709 13:20:35.675271  9063 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.684126  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2563) took 1083 ms. Trace:
I20260709 13:20:35.684989  9369 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.684489  4292 rpcz_store.cc:276] 0709 13:20:34.600308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.600792 (+   484us) service_pool.cc:224] Handling call
0709 13:20:34.601128 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.601466 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.601493 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.601917 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.805422 (+203505us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:34.805461 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.805524 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.682278 (+876754us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:35.683846 (+  1568us) raft_consensus.cc:1685] finished
0709 13:20:35.683866 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.684072 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17116,"raft.queue_time_us":1702,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":25012,"spinlock_wait_cycles":94721280,"thread_start_us":203197,"threads_started":1,"wal-append.queue_time_us":337729}
I20260709 13:20:35.670794  9426 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.671263  4144 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:35.672590  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:35.687186  9369 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:35.687266  4220 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:35.638209  9368 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:20:35.614802  9421 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.687740  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.687855  9426 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:35.688599  4145 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:35.670574  9383 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.694857  9211 raft_consensus.cc:993] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:35.699654  9311 raft_consensus.cc:1081] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:35.703037  4290 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:35.708163  4145 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:35.708678  4296 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:35.727185  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.727782  4144 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:35.726675  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:35.729080  4145 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:35.732549  9380 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:35.735899  4145 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:35.736444  4893 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:35.737102  4144 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:35.738173  9315 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:35.738940  9315 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:35.740164  9315 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:35.745690  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:35.746838  9080 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:35.746984  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:35.747377  9080 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:35.695636  9383 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.750331  8712 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:35.751850  4296 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:35.674877  9424 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.713094  9331 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:35.730445  9427 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:35.764393  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 175377us
I20260709 13:20:35.765818  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:35.748406  9196 consensus_queue.cc:1048] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:20:35.787602  9444 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:35.768778  9331 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.774194  9369 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:35.784042  9384 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:35.752738  9402 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:20:35.763638  9215 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.716279  9187 consensus_queue.cc:1059] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:20:35.869802  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 99499.6us
I20260709 13:20:35.727038  9404 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:20:35.872696  4296 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:20:35.916054  4296 pending_rounds.cc:85] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:20:35.916571  4296 pending_rounds.cc:107] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:20:35.916894  4296 raft_consensus.cc:2889] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:35.885639  4293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ca04a09529497898d86f573a0e1189"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:20:35.887614  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:35.918090  4293 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:35.899941  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:35.918692  4293 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:35.919847  4295 raft_consensus.cc:2410] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:35.869997  9256 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:35.843382  9172 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:35.874689  9426 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:35.911455  4259 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:35.914721  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:35.848918  9175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.002s	sys 0.016s
I20260709 13:20:35.923552  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:35.871604  9427 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.941474  4295 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:35.884270  9368 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:35.918262  4294 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:35.942939  9368 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.943552  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:35.944154  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:35.928978  4145 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:35.929167  4144 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:35.945297  9359 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:35.945598  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.946069  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.946693  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:35.946967  4144 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:35.947364  4145 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:20:35.933902  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:35.941987  9427 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:35.902522  9369 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.948642  9369 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:35.949148  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:35.944263  4294 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:35.922187  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:35.814363  9080 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.902597  4289 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:35.955415  4928 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:35.902355  9384 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:35.961009  4928 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:35.971626  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:35.972254  4218 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:35.954622  4295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:20:35.945744  9359 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:35.957677  4144 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:35.962487  9447 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.135s	user 0.006s	sys 0.003s
I20260709 13:20:35.962590  9356 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:35.959012  9426 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:35.906513  9439 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:35.957845  9172 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:35.967736  9402 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:35.977051  4295 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:36.176757  4295 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:35.956374  9175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.002s	sys 0.017s
W20260709 13:20:36.139060  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 205225us
I20260709 13:20:35.972028  4928 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:35.904356  9398 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.904099  9260 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:35.937139  9370 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:36.168331  4218 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:35.907032  9215 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.140213  9359 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.047483  9403 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:35.937477  9256 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.178371  9397 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:36.175832  9451 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:36.247843  4295 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.160380  9410 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
W20260709 13:20:36.255816  9313 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.002s
I20260709 13:20:36.239878  9404 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:35.974247  9384 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.457365  9404 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.199345  9402 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.340497  9370 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:20:36.244927  9403 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.187503  9439 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.481571  9172 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:36.446815  9313 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:36.499207  8712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.040s	sys 0.111s
W20260709 13:20:36.499671  8712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.040s	sys 0.111s
I20260709 13:20:36.500041  8712 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:36.501356  8712 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:36.504472  9452 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
W20260709 13:20:36.497534  9462 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:20:36.482676  9401 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.483096  9331 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.488122  9461 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:36.546957  9454 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:20:36.555374  9404 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:36.551282  9463 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:20:36.551936  9313 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:36.552021  9459 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:20:36.537065  9401 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.322518  9451 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.552958  9426 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:36.553270  9398 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:36.554394  9353 consensus_meta.cc:287] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.000s
W20260709 13:20:36.554862  9458 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:20:36.566131  9451 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:36.542097  9461 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.567397  9401 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.216007  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:36.214376  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:36.205950  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:36.549727  9256 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:36.568527  9402 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:36.675508  9409 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.559617  9353 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.677464  9409 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.681569  9409 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.682375  9409 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.683431  9409 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.686527  9451 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.565428  9403 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:36.687909  9451 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:36.615192  4185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.055s	sys 0.104s
W20260709 13:20:36.607553  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 630403us
W20260709 13:20:36.690310  4185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.055s	sys 0.104s
I20260709 13:20:36.693924  9451 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:36.695686  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.697382  9409 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:36.622924  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 439405us
I20260709 13:20:36.700912  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:36.703202  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:36.625036  4295 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:36.627923  4892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.009s	sys 0.009s
W20260709 13:20:36.706679  4892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.010s	sys 0.009s
I20260709 13:20:36.697969  9256 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:36.715099  4289 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:36.714005  9256 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.698272  9401 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:36.628525  4894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.010s	sys 0.025s
W20260709 13:20:36.701332  9455 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.364s	user 0.000s	sys 0.008s
W20260709 13:20:36.612655  4145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.019s	sys 0.023s
I20260709 13:20:36.613972  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2647) took 1357 ms. Trace:
W20260709 13:20:36.737668  4894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.010s	sys 0.027s
I20260709 13:20:36.670192  9243 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.637650  9215 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.692143  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:36.635422  9211 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:36.744813  4145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.019s	sys 0.025s
I20260709 13:20:36.631886  9175 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:36.749898  4291 raft_consensus.cc:2410] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:20:36.761591  9403 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:36.764986  9398 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:36.766412  9398 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.569156  9461 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:36.770030  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69497.1us
I20260709 13:20:36.771678  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:36.773353  9215 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.773669  9211 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:36.777693  4293 consensus_meta.cc:287] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.858s	user 0.015s	sys 0.019s
I20260709 13:20:36.778247  4293 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.779145  9211 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:36.780260  9353 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.780298  4293 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:36.780593  9243 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.749903  9451 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:20:36.774348  9215 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:36.786235  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 94471.5us
I20260709 13:20:36.787259  9256 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:36.786901  9401 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.788657  9418 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.789685  9471 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.789752  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 560) took 1121 ms. Trace:
I20260709 13:20:36.790953  9243 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.793547  9398 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:36.794134  4926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.006s	sys 0.009s
W20260709 13:20:36.823741  4926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.006s	sys 0.010s
I20260709 13:20:36.796778  9175 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.824169  9471 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.798252  9337 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:36.799299  4891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.016s
I20260709 13:20:36.800525  4295 raft_consensus.cc:3055] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:36.731711  4142 rpcz_store.cc:276] 0709 13:20:35.256136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.262303 (+  6167us) service_pool.cc:224] Handling call
0709 13:20:35.262627 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:35.516500 (+253873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.516539 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:35.521931 (+  5392us) log.cc:844] Serialized 52 byte log entry
0709 13:20:35.666359 (+144428us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:35.689414 (+ 23055us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.702897 (+ 13483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.702997 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.612641 (+909644us) raft_consensus.cc:1685] finished
0709 13:20:36.613180 (+   539us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.613750 (+   570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23007,"prepare.queue_time_us":10645,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":72559,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"thread_start_us":373439,"threads_started":2,"wal-append.queue_time_us":186972}
I20260709 13:20:36.826612  4295 raft_consensus.cc:740] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:36.808312  4141 rpcz_store.cc:276] 0709 13:20:35.668535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.669307 (+   772us) service_pool.cc:224] Handling call
0709 13:20:35.669601 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.699017 (+ 29416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.699057 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.699535 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.854474 (+154939us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:35.854545 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.854639 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.700072 (+845433us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:36.789087 (+ 89015us) raft_consensus.cc:1685] finished
0709 13:20:36.789122 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.789503 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29055,"raft.queue_time_us":29564,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":215063936,"thread_start_us":154562,"threads_started":1,"wal-append.queue_time_us":487367}
I20260709 13:20:36.813614  9403 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:36.827818  9403 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.828270  9403 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.828516  9175 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:36.828126  4295 consensus_queue.cc:260] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.829767  4295 raft_consensus.cc:3060] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:36.819350  9401 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.800284  9339 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:36.832455  9339 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:36.826089  9471 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:36.831828  4891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.000s	sys 0.017s
I20260709 13:20:36.834549  9339 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:36.797822  4187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.014s	sys 0.015s
W20260709 13:20:36.841703  4187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.015s	sys 0.015s
I20260709 13:20:36.842267  9215 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.843550  9465 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:36.837199  4221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2250) took 1838 ms (client timeout 2031 ms). Trace:
I20260709 13:20:36.821480  9426 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:36.848552  9426 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.850504  9423 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:36.851332  9211 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:36.848073  4221 rpcz_store.cc:269] 0709 13:20:34.998280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.998907 (+   627us) service_pool.cc:224] Handling call
0709 13:20:36.836659 (+1837752us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b540001ed54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:36.836967 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1473271168}
I20260709 13:20:36.852566  9418 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:36.853194  9424 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:36.853374  9418 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.840818  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:36.862236  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:36.864856  9465 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.868634  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:36.851868  9426 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:20:36.870115  9426 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:36.870950  9426 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.871747  9426 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:36.851639  9423 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.875211  4215 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:36.862536  9432 raft_consensus.cc:3055] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:36.876543  9432 raft_consensus.cc:740] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:36.880870  4922 raft_consensus.cc:1240] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:36.883025  4291 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:36.880774  9432 consensus_queue.cc:260] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:36.887250  9432 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.891204  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:36.896589  9465 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.898348  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:36.898588  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 880) took 1027 ms. Trace:
I20260709 13:20:36.900575  4288 rpcz_store.cc:276] 0709 13:20:35.870791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.870962 (+   171us) service_pool.cc:224] Handling call
0709 13:20:36.897260 (+1026298us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b5800082598. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:20:36.897605 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:36.897885 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:36.897912 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:36.897997 (+    85us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:36.898113 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.898206 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.898389 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9754496}
I20260709 13:20:36.867182  9418 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.876093  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 805) took 1217 ms. Trace:
I20260709 13:20:36.875952  9423 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:36.905400  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2582) took 1033 ms. Trace:
I20260709 13:20:36.906838  4215 rpcz_store.cc:276] 0709 13:20:35.658788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.660705 (+  1917us) service_pool.cc:224] Handling call
0709 13:20:36.873787 (+1213082us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:20:36.874368 (+   581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:36.875707 (+  1339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.875992 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11775360}
I20260709 13:20:36.908314  4287 rpcz_store.cc:276] 0709 13:20:35.872002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.872110 (+   108us) service_pool.cc:224] Handling call
0709 13:20:36.890219 (+1018109us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b5800082598. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:20:36.905331 (+ 15112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7527808}
W20260709 13:20:36.922435  4893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.007s	sys 0.005s
W20260709 13:20:36.900872  9359 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.657s	user 0.014s	sys 0.009s
W20260709 13:20:36.924566  4893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.008s	sys 0.006s
I20260709 13:20:36.929577  9448 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:36.930233  4926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 736) took 1233 ms. Trace:
W20260709 13:20:36.933862  4259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.031s
W20260709 13:20:36.942329  4259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.003s	sys 0.031s
I20260709 13:20:36.947213  9468 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.948256  9283 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.930987  4926 rpcz_store.cc:276] 0709 13:20:35.697235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.697731 (+   496us) service_pool.cc:224] Handling call
0709 13:20:35.698068 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.698320 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:35.761653 (+ 63333us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.929510 (+1167857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:36.929634 (+   124us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:36.929746 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.929859 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.930124 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16380,"prepare.queue_time_us":226629,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":19750,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":261,"thread_start_us":1192367,"threads_started":3,"wal-append.queue_time_us":1024177}
I20260709 13:20:36.953214  4924 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:20:36.948314  9468 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:36.979579  9383 consensus_meta.cc:287] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.189s	user 0.014s	sys 0.011s
I20260709 13:20:36.984227  9383 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.987762  9179 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.990057  9368 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:36.990662  9179 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:36.991324  9401 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.989813  9353 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:36.951783  9397 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.992317  9401 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.993582  9397 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:36.992611  4143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2648) took 1736 ms (client timeout 1933 ms). Trace:
W20260709 13:20:37.001302  9457 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.763s	user 0.007s	sys 0.009s
I20260709 13:20:37.003691  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 879) took 1268 ms. Trace:
W20260709 13:20:37.000845  4143 rpcz_store.cc:269] 0709 13:20:35.256424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.256912 (+   488us) service_pool.cc:224] Handling call
0709 13:20:36.992101 (+1735189us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540010fc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:36.992330 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295251200}
I20260709 13:20:36.996068  9397 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:36.996076  9401 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.011932  4215 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:37.013012  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:36.990790  9402 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:37.014099  9402 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.016538  8712 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:37.017349  8712 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:37.018751  9449 log.cc:927] Time spent T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: Append to log took a long time: real 1.117s	user 0.007s	sys 0.011s
I20260709 13:20:36.992571  9256 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.020182  9256 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.016673  4222 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:37.022217  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:36.992965  9470 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:37.023124  9175 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:37.023514  9470 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.024012  9175 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.004266  4292 rpcz_store.cc:276] 0709 13:20:35.735278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.735398 (+   120us) service_pool.cc:224] Handling call
0709 13:20:35.735704 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.736058 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.736087 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.736537 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.853230 (+116693us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:35.853302 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.853419 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.962073 (+1108654us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:37.003094 (+ 41021us) raft_consensus.cc:1685] finished
0709 13:20:37.003120 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.003463 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":161,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":10115968,"thread_start_us":116224,"threads_started":1,"wal-append.queue_time_us":232386}
W20260709 13:20:37.029511  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.024791  9080 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:37.034421  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.034616  9339 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:37.034821  9384 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:37.035419  9410 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.036360  8712 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.038653  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:36.936543  9359 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:37.041087  4140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2251) took 1726 ms (client timeout 2272 ms). Trace:
W20260709 13:20:37.043467  4140 rpcz_store.cc:269] 0709 13:20:35.314501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.033476 (+1718975us) service_pool.cc:224] Handling call
0709 13:20:37.040957 (+  7481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:36.996275  9260 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.050305  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.050511  9216 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.013286  9204 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.009871  9403 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:36.993096  9353 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.082805  9216 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.084649  9353 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:37.007534  9283 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.070075  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.069973  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.070806  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.070994  9204 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.074101  9467 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.072786  9175 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.055773  9402 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.074779  9342 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.075438  4217 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:37.051725  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.070801  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.078703  4287 raft_consensus.cc:3055] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:37.065923  9183 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:20:37.068943  4922 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:37.099534  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.036185  9410 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.101802  4287 raft_consensus.cc:740] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:37.088326  9216 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:37.097450  9396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.987s	user 0.024s	sys 0.034s
W20260709 13:20:37.109512  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45811us
I20260709 13:20:37.111503  4218 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:37.113924  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.114470  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.114704  4214 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:37.115108  4216 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:37.115584  9439 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:37.115897  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.116740  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.117295  4213 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:37.117488  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:37.118240  9260 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.119047  9063 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.116204  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:37.113924  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.120788  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2262) took 1208 ms. Trace:
I20260709 13:20:37.122196  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.115612  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:37.122882  9396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.157s	user 0.025s	sys 0.034s
I20260709 13:20:37.122835  4287 consensus_queue.cc:260] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.123592  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:37.129068  9410 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.130234  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.132079  4216 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
W20260709 13:20:37.133940  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 112009us
I20260709 13:20:37.093779  9368 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:37.147399  9368 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.148273  4295 pending_rounds.cc:85] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:37.148684  4295 pending_rounds.cc:107] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:20:37.098448  9467 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.148808  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.149000  4295 raft_consensus.cc:2889] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:37.149724  4214 raft_consensus.cc:2410] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:20:37.150048  9368 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:37.150571  9467 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.150667  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.136086  4222 rpcz_store.cc:276] 0709 13:20:35.912604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.912845 (+   241us) service_pool.cc:224] Handling call
0709 13:20:35.913251 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:37.022630 (+1109379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.120529 (+ 97899us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000253d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:37.120736 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514646784}
I20260709 13:20:37.135437  4218 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:37.106937  9448 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.109215  9256 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.141062  9260 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.136256  9261 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.157498  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.157655  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.161957  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.165627  9261 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.166105  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.171147  4214 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:37.172710  9283 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:37.173076  4214 raft_consensus.cc:1240] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:37.177815  4220 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:37.181243  9448 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.181654  9261 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.183046  9415 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:37.183816  9415 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.131242  9204 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.156137  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:37.184988  4287 raft_consensus.cc:3060] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:37.184755  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.187772  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:37.160920  9438 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.407s	user 0.021s	sys 0.023s
W20260709 13:20:37.209687  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45155.6us
I20260709 13:20:37.184109  9448 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:37.218999  9369 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 1.270s	user 0.015s	sys 0.010s
I20260709 13:20:37.219262  9415 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.203224  9368 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:37.220582  9468 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.227187  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:37.227497  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 90096.3us
I20260709 13:20:37.227725  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:37.228152  4140 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:37.228711  4143 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:37.229132  4924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42928 (request call id 371) took 1565 ms. Trace:
I20260709 13:20:37.229539  4924 rpcz_store.cc:276] 0709 13:20:35.663382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.663828 (+   446us) service_pool.cc:224] Handling call
0709 13:20:35.664121 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.992413 (+1328292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.228828 (+236415us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540062b454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:37.229077 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2957622144}
I20260709 13:20:37.231492  9359 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:37.232259  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.232378  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.236649  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:37.237313  4218 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:37.232297  4928 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:37.224402  9471 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.246387  9368 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:37.247143  9471 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.247931  9251 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:37.250470  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.250731  9426 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.250516  4290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 2986) took 2572 ms. Trace:
I20260709 13:20:37.251996  4290 rpcz_store.cc:276] 0709 13:20:34.677871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.677993 (+   122us) service_pool.cc:224] Handling call
0709 13:20:34.704022 (+ 26029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.703470 (+999448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.250045 (+1546575us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54002788d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:37.250330 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2297049472}
I20260709 13:20:37.255550  9183 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:37.256405  9183 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.257483  9425 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:37.262912  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2641) took 2015 ms. Trace:
I20260709 13:20:37.225662  9383 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.263492  9415 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.265726  9415 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.266500  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.266500  4140 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:37.268308  9415 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.269394  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:37.269904  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.270097  4140 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:37.270941  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.271248  4140 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:37.271592  4147 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:20:37.271744  4925 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:37.273250  9424 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:37.273967  9424 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.275553  4147 raft_consensus.cc:1240] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:20:37.276391  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.263396  4138 rpcz_store.cc:276] 0709 13:20:35.247477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.248692 (+  1215us) service_pool.cc:224] Handling call
0709 13:20:35.249149 (+   457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:35.267875 (+ 18726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.267919 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:35.277755 (+  9836us) log.cc:844] Serialized 52 byte log entry
0709 13:20:35.520408 (+242653us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:35.571414 (+ 51006us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.614066 (+ 42652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.614140 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.858592 (+1244452us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b180021ba40. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:20:36.947747 (+ 89155us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:37.262436 (+314689us) raft_consensus.cc:1685] finished
0709 13:20:37.262466 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.262727 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18207,"prepare.queue_time_us":60290,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":111191,"raft.run_cpu_time_us":644,"raft.run_wall_time_us":645,"spinlock_wait_cycles":56762624,"thread_start_us":235027,"threads_started":1,"wal-append.queue_time_us":336758}
I20260709 13:20:37.277047  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:37.247761  9368 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.280580  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.280937  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.281324  4292 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:37.282425  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.284073  9242 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:37.277936  4147 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:37.289337  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 66001.1us
I20260709 13:20:37.290352  4287 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:20:37.291215  4919 raft_consensus.cc:1813] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Handling vote request from an unknown peer 34e6205f3c1d434193126fef20d73800
I20260709 13:20:37.291074  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.293162  4292 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:37.291551  4221 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:37.294581  4919 raft_consensus.cc:2410] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:37.291109  4287 pending_rounds.cc:85] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 10
I20260709 13:20:37.299410  4287 pending_rounds.cc:107] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:20:37.299690  4287 raft_consensus.cc:2889] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:37.211843  9283 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:20:37.302032  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.305671  4926 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:37.307386  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.310173  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:37.314317  9480 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 13:20:37.314795  9260 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.315335  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.315855  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:37.289108  9410 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:37.316514  4215 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:37.220121  9369 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.317278  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.322276  4217 raft_consensus.cc:2393] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:37.325564  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.326329  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:37.330152  4928 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:37.332036  4216 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:37.332028  4214 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:37.335345  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:37.336192  4222 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:37.333521  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.332316  4140 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.336660  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.341179  4140 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:37.342386  4928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42928 (request call id 373) took 1416 ms (client timeout 1583 ms). Trace:
I20260709 13:20:37.343770  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:37.342895  4928 rpcz_store.cc:269] 0709 13:20:35.921480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.921834 (+   354us) service_pool.cc:224] Handling call
0709 13:20:37.231653 (+1309819us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b58003581d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec3e0aa 00007fee3ecc0447 00007fee3ecd8fe7 00007fee3ecda7de 00007fee3ece627c 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c
0709 13:20:37.337293 (+105640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170936192}
I20260709 13:20:37.344813  4287 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:20:37.341045  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.329442  9403 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.351840  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.350041  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:37.357452  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:37.361158  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.364677  4219 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:20:37.382314  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.383601  4138 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:37.374119  4141 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:37.379805  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:37.403808  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 92459.8us
I20260709 13:20:37.404450  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.405130  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.407893  4287 raft_consensus.cc:2410] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:37.405891  4219 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:37.364845  9410 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.414004  4296 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:37.441968  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.448460  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.455456  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.412761  9379 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.122s
I20260709 13:20:37.456634  4294 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:37.457938  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:37.455825  9369 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.451184  4145 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
W20260709 13:20:37.457317  9485 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:20:37.472638  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.473466  4219 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:20:37.477777  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:37.479560  9410 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.480427  4141 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:37.444604  9359 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:37.480830  4141 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:37.481235  9359 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.481783  4141 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.483783  9359 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:37.484629  4287 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:20:37.485008  4287 pending_rounds.cc:85] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 8
I20260709 13:20:37.485183  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.489003  9403 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:37.489677  9403 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.491988  9403 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.485280  4287 pending_rounds.cc:107] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 15.9
W20260709 13:20:37.501251  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.511775  4287 raft_consensus.cc:2889] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:37.469973  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.512811  4146 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
W20260709 13:20:37.518272  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 84011.3us
I20260709 13:20:37.519200  4143 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:37.523136  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.466797  9467 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:37.551350  4215 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:37.552583  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:37.557736  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.538265  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:37.559405  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 63195.4us
I20260709 13:20:37.561192  9174 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:37.566690  9471 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:37.567432  9471 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.569677  9471 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.570894  9470 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:37.575460  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.579276  9435 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:37.582269  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:37.583343  9435 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:37.584749  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:37.585664  9435 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:37.586179  9435 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.586651  9435 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:37.590412  9403 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.590442  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.591180  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.591325  9403 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.594537  9403 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.599112  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:37.599283  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.604645  4140 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
W20260709 13:20:37.605968  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.521845  9179 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.005s
I20260709 13:20:37.619865  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.623762  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.627133  4147 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
W20260709 13:20:37.630573  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.645395  4185 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:37.649057  4218 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:37.652362  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.652736  4294 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:37.656237  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.659693  4147 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
W20260709 13:20:37.671270  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 57925.7us
I20260709 13:20:37.678442  4143 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:37.679945  4290 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:37.692615  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 71648.1us
I20260709 13:20:37.683071  9403 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.702477  9403 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.664847  9467 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.706254  4296 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:37.706990  9467 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.714846  9177 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.715886  9177 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.718149  4141 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:37.720579  4213 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:37.733737  9424 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:37.739477  4142 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:37.743484  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:37.745846  4222 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:37.721149  9451 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:37.758646  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.759655  4142 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:37.760991  4112 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:37.771741  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.760694  9451 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:37.798367  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.801498  4222 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:37.773870  9204 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:37.814280  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:37.815847  9471 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.806870  9435 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.816617  9471 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.819088  9471 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:37.825019  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:37.825429  9496 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:20:37.785341  9415 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:37.808624  9204 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.845427  4141 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:37.852274  4147 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:20:37.819152  9435 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.842041  9403 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:37.872637  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 127786us
I20260709 13:20:37.873754  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:37.874800  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:37.880864  9451 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.882491  9451 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:37.851290  9204 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:37.886603  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:37.890528  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 300709us
I20260709 13:20:37.900664  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.890133  9415 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:37.893690  9403 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:37.911921  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.918388  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:37.920779  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.924249  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:37.904719  9435 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:37.903216  9415 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.928459  9383 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.928840  9256 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.929158  9383 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:37.929461  9256 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:37.931967  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55677.3us
I20260709 13:20:37.939957  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.926674  9368 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.937218  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.946535  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:37.948699  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.934343  9494 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.451s	user 0.002s	sys 0.004s
I20260709 13:20:37.947217  4290 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:37.951056  4295 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:37.947546  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.927688  9435 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.920486  9403 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:37.956430  4292 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:37.956740  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.957132  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.957715  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:37.956476  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.958428  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:37.962211  9498 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:20:37.931897  9256 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:37.968969  4141 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:37.932765  9415 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.974121  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:37.958454  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.986817  4294 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:37.977041  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:37.996502  4289 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:37.950613  9183 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:37.976748  9435 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:38.000699  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.001709  9359 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:38.003224  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:38.003901  9424 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.004500  9369 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.005232  9137 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:38.013875  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.006690  9368 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:38.022852  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 64544.8us
I20260709 13:20:38.024107  9424 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:38.026561  9177 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:38.030019  9426 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:38.037317  4147 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:38.050719  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:38.054391  9467 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:38.055626  9467 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:38.055871  9436 consensus_queue.cc:1059] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:38.056716  9383 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:38.057096  9436 raft_consensus.cc:3055] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:38.056993  9183 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:38.066605  4295 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:38.066507  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.070101  4141 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:38.073747  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.055677  9424 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:38.056272  9467 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:38.066468  9436 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:38.041996  9369 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.087904  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.092290  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.085188  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:38.093406  4141 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:38.069823  9183 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.091452  4290 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:38.106066  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:38.107344  4147 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:38.089216  9242 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.112143  9242 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:38.117437  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 320853us
I20260709 13:20:38.096443  9211 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:38.101287  9175 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:38.100878  9424 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:38.102692  9183 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:38.122809  4112 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:38.104018  9179 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:38.115687  9471 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.133574  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.114832  9426 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:20:38.127240  9175 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.142870  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:38.146973  4290 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:38.164940  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:38.162431  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.138330  9256 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:38.167392  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.165896  4147 raft_consensus.cc:2468] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 5.
I20260709 13:20:38.154968  9175 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:38.151870  9369 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:38.175221  4288 raft_consensus.cc:2393] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:38.184031  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:38.187799  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.191426  9400 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:38.192034  9400 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:38.192550  9400 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:38.166704  9403 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:38.201146  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 86024.3us
I20260709 13:20:38.203926  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.205137  4288 raft_consensus.cc:1813] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Handling vote request from an unknown peer 34e6205f3c1d434193126fef20d73800
I20260709 13:20:38.203320  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:38.207970  9242 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:38.218152  9211 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:38.218734  9211 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.219081  9211 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:38.221415  9179 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:38.222209  9179 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:38.204847  9425 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:38.224802  9425 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.148280  9436 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.229205  4288 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:38.198534  9424 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:38.163033  9471 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:38.182104  9256 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.237536  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.243892  4141 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:38.225394  9425 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:38.250326  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.252848  4295 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:38.219818  9204 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:38.189270  9467 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.245074  9368 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:38.288801  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:38.296939  4294 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:38.294113  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.292212  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.301348  4220 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:38.308122  4145 raft_consensus.cc:2410] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:38.302335  4288 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:38.280745  9436 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.310555  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:38.320569  4923 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:38.330648  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.331409  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:38.332523  4215 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:38.335136  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:38.332469  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.331562  4217 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:38.338536  4892 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:38.349614  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.311344  9467 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.341724  4290 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:20:38.352264  4145 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:38.375913  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:38.339329  9283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.020s
I20260709 13:20:38.385347  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:38.383944  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 200049us
W20260709 13:20:38.382346  9283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.014s	sys 0.020s
W20260709 13:20:38.392849  9506 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:20:38.393224  9508 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:20:38.398252  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.371526  9242 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:38.398972  4221 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
W20260709 13:20:38.402060  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 195328us
I20260709 13:20:38.420392  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.398438  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:38.426849  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.428603  4218 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:38.430828  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.432049  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:38.436987  4214 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.419178  4215 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:38.449687  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.451714  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.464811  4216 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:38.466323  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:38.463039  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.421897  9242 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.470101  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:38.435350  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:38.479561  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.436523  9424 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:38.488240  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 52998.6us
I20260709 13:20:38.493782  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:38.494550  4221 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.494953  4893 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:38.497280  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.472726  9415 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.482791  9242 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.470376  9256 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:38.516036  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:38.490936  9368 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.529150  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:38.501475  9424 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:38.560135  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:38.524549  9471 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:38.603943  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 174188us
I20260709 13:20:38.545938  9426 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:38.536909  9523 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:38.648407  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.500247  9512 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:20:38.595909  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:38.576459  9509 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 13:20:38.632725  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.565181  9424 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.600623  9369 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:38.696575  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 100768us
W20260709 13:20:38.668556  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.701795  4214 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
W20260709 13:20:38.652686  9510 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.361s	user 0.000s	sys 0.002s
I20260709 13:20:38.572702  9403 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:38.710048  4140 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:38.711056  4221 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
W20260709 13:20:38.748718  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:38.659309  9521 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:20:38.681424  9451 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.798s	user 0.019s	sys 0.000s
W20260709 13:20:38.712836  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.716369  9137 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:38.720729  9528 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:38.721983  9250 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:20:38.722630  9526 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:38.633190  9368 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.611656  9426 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.741755  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:38.746119  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.690598  9523 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.827962  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.828873  4140 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:38.645991  9283 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:20:38.549463  9520 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.169s
I20260709 13:20:38.754709  4146 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:20:38.804769  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 58156us
I20260709 13:20:38.702562  9471 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:38.743585  9513 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:20:38.808120  4293 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:20:38.815100  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:38.819504  9415 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:38.813447  9211 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.594s	user 0.012s	sys 0.003s
W20260709 13:20:38.820647  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 218856us
I20260709 13:20:38.815124  4291 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:38.821705  4296 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:38.823192  9368 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:38.824605  4138 raft_consensus.cc:1813] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Handling vote request from an unknown peer 34e6205f3c1d434193126fef20d73800
W20260709 13:20:38.835664  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.693478  9525 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:20:38.840709  4293 pending_rounds.cc:85] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 10
I20260709 13:20:38.909746  4293 pending_rounds.cc:107] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:20:38.910275  4293 raft_consensus.cc:2889] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:38.871768  4139 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:38.911453  4138 raft_consensus.cc:2410] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:38.872756  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:38.874200  9520 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:38.833541  9400 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.003s
I20260709 13:20:38.827896  9426 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:38.910001  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.912623  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:38.837520  9512 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:38.914248  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2662) took 1105 ms. Trace:
I20260709 13:20:38.932695  4143 rpcz_store.cc:276] 0709 13:20:37.809221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.809452 (+   231us) service_pool.cc:224] Handling call
0709 13:20:37.820221 (+ 10769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:37.820707 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:37.820740 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:37.821543 (+   803us) log.cc:844] Serialized 26 byte log entry
0709 13:20:38.096067 (+274524us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:38.096127 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.096251 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:38.914017 (+817766us) raft_consensus.cc:1685] finished
0709 13:20:38.914045 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.914177 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"thread_start_us":273387,"threads_started":1,"wal-append.queue_time_us":421674}
W20260709 13:20:38.831331  9183 consensus_meta.cc:287] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.003s
I20260709 13:20:38.919955  4140 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.830539  9137 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:38.838671  9517 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:20:38.831748  9523 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.909961  9393 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:38.831530  9424 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.930217  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:38.871258  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:38.921056  9520 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.935387  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:38.831043  9403 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:38.960747  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.836933  9250 consensus_queue.cc:1243] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:20:38.935379  9509 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:38.908861  9211 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:38.975862  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.951396  9415 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:38.969914  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:38.986007  4294 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.004s
I20260709 13:20:38.997994  4294 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:38.994390  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.993599  4139 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:38.969099  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:38.964185  9534 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
W20260709 13:20:38.967163  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 225485us
I20260709 13:20:39.002615  4291 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:38.971737  4893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.601s (SENT) [suppressed 10 similar messages]
I20260709 13:20:38.959990  9183 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.964586  9520 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:38.968892  9368 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.008525  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:38.964219  9369 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:38.930820  9471 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:38.839859  9528 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:38.969600  9250 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:39.022535  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:38.964511  9532 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:38.926608  9400 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.028646  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 815) took 1180 ms. Trace:
I20260709 13:20:39.028716  4294 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:20:39.030249  4139 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:39.033655  4222 rpcz_store.cc:276] 0709 13:20:37.854005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.854229 (+   224us) service_pool.cc:224] Handling call
0709 13:20:37.865684 (+ 11455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:37.867594 (+  1910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:37.867626 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:37.868391 (+   765us) log.cc:844] Serialized 26 byte log entry
0709 13:20:38.061365 (+192974us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:38.095691 (+ 34326us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.096659 (+   968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.096813 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:38.214216 (+117403us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b48000fe358. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:20:39.022898 (+808682us) raft_consensus.cc:1685] finished
0709 13:20:39.028400 (+  5502us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.028576 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33947,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":9694,"raft.queue_time_us":1713,"raft.run_cpu_time_us":3937,"raft.run_wall_time_us":116517,"spinlock_wait_cycles":16039296,"thread_start_us":192523,"threads_started":1,"wal-append.queue_time_us":329842}
I20260709 13:20:39.057828  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:38.994189  9403 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:38.964743  9512 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.062599  4141 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:39.033854  9532 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:39.065128  4140 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:39.063555  4143 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:39.073410  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 112323us
I20260709 13:20:39.077827  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:39.078097  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.078701  4143 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:39.078980  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2661) took 1300 ms. Trace:
I20260709 13:20:39.061689  9137 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.088310  9471 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:39.089069  9424 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:20:39.089753  9424 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:39.090163  9424 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.090530  9424 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.979569  9393 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:39.092895  9393 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.090684  9528 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:39.093788  9211 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:39.094013  9242 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 13:20:39.094434  9242 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:39.095744  4923 raft_consensus.cc:2393] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:39.035535  9368 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:39.099588  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 127885us
I20260709 13:20:39.060974  9541 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:39.081689  4142 rpcz_store.cc:276] 0709 13:20:37.779040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.783416 (+  4376us) service_pool.cc:224] Handling call
0709 13:20:37.792456 (+  9040us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:37.813136 (+ 20680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:37.813214 (+    78us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:38.028133 (+214919us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b2c00000c88. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:38.028673 (+   540us) log.cc:844] Serialized 52 byte log entry
0709 13:20:38.285646 (+256973us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:38.430358 (+144712us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.696297 (+265939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.696430 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.076258 (+379828us) raft_consensus.cc:1685] finished
0709 13:20:39.078760 (+  2502us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.078911 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":424,"prepare.queue_time_us":279938,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3340,"raft.queue_time_us":283169,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":14872,"spinlock_wait_cycles":5645184,"thread_start_us":639715,"threads_started":3,"wal-append.queue_time_us":433312}
I20260709 13:20:39.072196  9532 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:39.049651  9250 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.109153  4287 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:39.092895  9512 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.181458  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:39.132644  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:39.137235  9368 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.138008  9204 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:39.138593  9403 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.138446  9541 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.140530  9242 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:39.142297  9435 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.100s	user 0.013s	sys 0.000s
I20260709 13:20:39.186555  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:39.147084  9545 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.148149  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 885) took 2270 ms. Trace:
I20260709 13:20:39.149724  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:39.150542  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:39.150725  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:39.151060  9359 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:39.197800  9435 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.197942  9359 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:39.198596  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:39.152395  9179 consensus_meta.cc:287] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.929s	user 0.009s	sys 0.005s
I20260709 13:20:39.154371  9400 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.155962  9250 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.156579  9183 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:39.158619  9425 consensus_meta.cc:287] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.872s	user 0.012s	sys 0.000s
W20260709 13:20:39.158989  9467 consensus_meta.cc:287] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.783s	user 0.010s	sys 0.000s
W20260709 13:20:39.160319  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 85956.7us
I20260709 13:20:39.162521  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:39.169653  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:39.178388  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.195482  4293 rpcz_store.cc:276] 0709 13:20:36.878079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.878595 (+   516us) service_pool.cc:224] Handling call
0709 13:20:36.879033 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.911003 (+2031970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.147880 (+236877us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54003548d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:39.148084 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4427789696}
I20260709 13:20:39.213078  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:39.202539  4147 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:39.041231  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:39.182921  4143 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:39.187376  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:39.188829  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:39.189433  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:39.190713  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 182364us
W20260709 13:20:39.143705  9175 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.945s	user 0.009s	sys 0.000s
I20260709 13:20:39.196033  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.195729  4295 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:39.147933  9426 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.254603  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:39.258896  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2674) took 1072 ms. Trace:
I20260709 13:20:39.262789  4147 rpcz_store.cc:276] 0709 13:20:38.186312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.186470 (+   158us) service_pool.cc:224] Handling call
0709 13:20:39.258634 (+1072164us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400076f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:39.258809 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331052800}
I20260709 13:20:39.265328  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:39.266561  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:39.268699  4291 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:39.238935  9547 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:39.272059  4290 raft_consensus.cc:2410] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:20:39.222926  9531 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.409s	user 0.004s	sys 0.000s
I20260709 13:20:39.274147  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:39.274920  4143 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:39.236901  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:39.276996  4142 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:39.200084  9435 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.213781  9256 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:39.284477  4144 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:39.223415  9525 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:39.279609  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:39.280025  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:39.280435  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 268851us
I20260709 13:20:39.207358  9527 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:39.285014  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:39.294999  4213 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:39.286340  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:39.287130  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.288518  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:39.200165  9359 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.302331  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:39.293709  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:39.293042  4138 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:39.303463  4221 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:39.279639  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:39.149744  9532 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.214241  9541 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.152424  9369 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.309840  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:39.302104  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:39.310452  4215 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:39.275004  9529 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:39.310847  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 93811.7us
I20260709 13:20:39.306354  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.293008  9467 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:39.280809  9528 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:39.303170  9559 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:20:39.282577  9256 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:39.322006  4291 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:39.294799  9250 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:39.261534  9179 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:39.325531  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:39.325899  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.261999  9175 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.294663  9527 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:39.337494  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.339906  4214 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:39.372375  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.372896  4112 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:39.256814  9425 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.343065  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:39.373086  4218 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
W20260709 13:20:39.349539  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.356662  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:39.376699  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:39.358392  9436 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.024s	user 0.013s	sys 0.000s
I20260709 13:20:39.358878  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:39.365160  4221 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:20:39.365675  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.326217  9183 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:39.323268  9467 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.355146  9528 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:39.214500  9545 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.353047  9250 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.402570  9250 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:39.404498  9177 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:39.342027  9204 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:20:39.405894  9204 consensus_queue.cc:1243] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:39.405993  9420 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:20:39.406458  9204 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:39.406790  9204 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:39.407578  9204 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.409472  9179 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:39.413980  9242 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:39.414539  9242 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:39.416906  9242 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.425958  9551 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:39.426473  9551 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.426821  9551 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.428560  9560 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:39.429621  9527 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.430698  9527 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:39.388180  4217 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:39.388716  4221 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:39.307018  9525 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.355931  9522 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:39.310480  9520 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:39.363210  4261 connection.cc:256] RPC call timeout handler was delayed by -1.369770249000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 13:20:39.405356  9183 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:39.382081  4215 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:39.359815  9256 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:39.433393  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 60577.4us
I20260709 13:20:39.460248  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:39.441893  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.462821  4290 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:39.449056  4213 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:39.462095  4218 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:20:39.461059  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2851702489999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 13:20:39.392114  9467 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:39.455753  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:39.461331  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:39.435480  4295 raft_consensus.cc:2468] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
W20260709 13:20:39.449978  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.468636  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:39.522800  4293 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:39.469831  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:39.468955  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:39.469412  9556 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:20:39.470094  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:39.530025  4288 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:39.530994  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:39.534453  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 191465us
I20260709 13:20:39.534899  4215 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 16: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:39.529150  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 60258.2us
I20260709 13:20:39.528100  4919 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:39.540431  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.454567  9424 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.546463  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:39.541277  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:39.541555  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:39.543114  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3024) took 1015 ms. Trace:
I20260709 13:20:39.531752  4892 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:20:39.540858  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1053091300000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 13:20:39.547972  4292 rpcz_store.cc:276] 0709 13:20:38.527695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.527866 (+   171us) service_pool.cc:224] Handling call
0709 13:20:38.528221 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:38.557179 (+ 28958us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:38.607001 (+ 49822us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.966428 (+359427us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.995014 (+ 28586us) log.cc:844] Serialized 26 byte log entry
0709 13:20:38.995221 (+   207us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:38.995269 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.995363 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.223639 (+228276us) spinlock_profiling.cc:243] Waited 7.99 ms on lock 0x7b18002747e0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:20:39.530818 (+307179us) raft_consensus.cc:1685] finished
0709 13:20:39.542947 (+ 12129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.543066 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56028,"prepare.queue_time_us":93489,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":136231,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":20038,"spinlock_wait_cycles":18373504,"thread_start_us":284246,"threads_started":1,"wal-append.queue_time_us":411653}
I20260709 13:20:39.549685  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:39.550294  9543 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:39.550855  9543 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.551987  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.552793  4292 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:39.553220  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:39.549264  4261 connection.cc:256] RPC call timeout handler was delayed by -1.0963091300000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:20:39.554353  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.550323  4291 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:39.557318  4287 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:39.558663  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:39.559249  4295 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:39.461760  9211 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:39.563855  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:39.564627  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.565470  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.566159  4215 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:39.566272  9426 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.560822  9137 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.567028  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:39.567379  9137 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:39.568477  9520 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.568598  9420 raft_consensus.cc:2804] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:39.528261  9283 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:39.569185  9420 raft_consensus.cc:697] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:39.569480  9137 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:39.570133  9420 consensus_queue.cc:237] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:39.570798  9525 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.528277  9204 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:39.574007  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.578341  4213 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:20:39.578651  4111 connection.cc:256] RPC call timeout handler was delayed by -2.0303701920001913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:20:39.527565  9529 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:39.580570  4291 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:20:39.467984  9179 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:20:39.593446  4289 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:20:39.467409  9383 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:20:39.598111  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:39.608057  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.607887  4919 raft_consensus.cc:2468] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:39.610635  4185 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:39.553618  9543 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.569403  9283 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:20:39.632192  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 68430us
I20260709 13:20:39.470871  9522 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.581328  9211 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:39.599905  9177 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:39.641523  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:39.642460  4293 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
W20260709 13:20:39.645011  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44681.6us
I20260709 13:20:39.645705  9425 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.645861  9177 raft_consensus.cc:2804] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:39.646449  9177 raft_consensus.cc:697] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:39.647140  9177 consensus_queue.cc:237] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:39.648818  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:39.650339  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:39.571972  9550 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:20:39.639338  9368 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:39.651400  9526 consensus_meta.cc:287] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.004s
I20260709 13:20:39.658353  4287 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:39.665844  4186 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:39.666719  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:39.644250  9532 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.668552  9526 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:39.675190  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:39.663265  9383 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:39.678344  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:39.682732  9563 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:39.684566  9518 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:20:39.687819  9555 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:39.605479  9183 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.652099  9528 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.693997  4925 raft_consensus.cc:2410] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:20:39.694382  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:39.695272  4186 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:39.673537  9175 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.699177  9557 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:39.699543  9522 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.704169  9545 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:39.697395  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:39.704918  9545 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:39.705499  9470 raft_consensus.cc:2764] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:39.705713  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:39.663707  9211 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.696823  9568 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:39.708889  9568 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:39.709053  9424 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:39.709249  9568 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:39.686519  9567 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:39.673332  9529 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.698606  9572 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:39.723210  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:39.728930  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:39.730542  4111 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:39.724128  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:39.736130  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:39.737882  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:39.711402  9550 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:39.674968  9512 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:20:39.712039  9563 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:39.742858  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:39.743228  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 198400us
W20260709 13:20:39.787415  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44639.9us
W20260709 13:20:39.787379  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49578.9us
I20260709 13:20:39.717195  9175 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:39.713187  9572 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:39.793809  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:39.795169  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 184629us
I20260709 13:20:39.796581  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:39.798221  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.740084  9536 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:39.801795  4919 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:39.717023  9383 raft_consensus.cc:2764] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:39.748520  9550 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:39.847321  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50853.2us
I20260709 13:20:39.854822  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:39.856176  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:39.858343  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:39.859485  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:39.790874  9177 consensus_queue.cc:1059] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:20:39.742210  9532 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:39.737054  9567 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:39.862046  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.862648  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:39.790900  9415 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:39.792873  9424 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:39.869377  9425 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:39.869971  9541 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:39.869990  9557 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:39.871063  9563 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:39.799508  9572 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:39.724817  9470 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
W20260709 13:20:39.873662  9523 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.878s	user 0.013s	sys 0.005s
I20260709 13:20:39.864467  9550 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:39.805517  9451 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:39.933207  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 209151us
W20260709 13:20:39.943339  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 80748.8us
I20260709 13:20:39.950178  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:39.928520  9527 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:39.929308  9543 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:39.883137  9425 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:39.981233  4294 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:39.933332  9557 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:39.954609  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 160863us
I20260709 13:20:39.873889  9250 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.936985  9563 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.876690  9467 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:39.870743  9569 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 13:20:39.874716  9520 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:39.958124  9527 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:39.951077  9541 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:39.957647  9424 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:40.007295  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 206756us
I20260709 13:20:39.984447  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:40.007347  9177 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:20:40.013967  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:39.982846  9425 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:39.985510  9557 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:39.993470  9543 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:40.027720  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 71270.5us
I20260709 13:20:40.029107  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:40.033761  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:40.024200  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:40.000386  9563 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:39.951243  9523 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:40.009008  9520 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:40.023803  9551 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.002s
I20260709 13:20:40.045810  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:40.051789  9204 raft_consensus.cc:2764] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:40.054672  9179 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:40.055127  9512 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:40.021054  9435 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:40.056993  9541 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.035140  9415 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:40.017675  9527 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:40.062408  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.067607  9424 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:40.077862  4220 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:40.145304  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:40.156064  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 110380us
W20260709 13:20:40.157994  9576 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:20:40.158571  9575 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
W20260709 13:20:40.159391  9579 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:20:40.068866  9520 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:40.159891  9581 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:20:40.154152  9512 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:40.208181  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:40.211273  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.153950  9369 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:20:40.237881  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.239449  4146 raft_consensus.cc:2410] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:40.240309  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:40.179802  9183 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:40.245894  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:40.246327  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:40.253050  4140 raft_consensus.cc:1275] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:40.258520  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.083313  9551 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:40.263916  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 218977us
I20260709 13:20:40.258764  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:40.198410  9589 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:40.269506  4187 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:40.275503  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:40.281005  4296 raft_consensus.cc:2368] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13.
I20260709 13:20:40.282840  4289 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 18: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:40.293021  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.295738  4145 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:40.246694  9393 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:40.307312  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.337064  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.311725  9589 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.264402  9183 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.259637  9548 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:20:40.365499  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:40.353742  9467 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:40.345311  9211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.015s	sys 0.010s
I20260709 13:20:40.367588  9591 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:40.356048  9383 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:20:40.375890  9585 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:20:40.376456  9586 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:40.381031  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.382536  4147 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:40.384588  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.262297  9543 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.344162  9589 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:40.322841  9393 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:40.394011  4142 raft_consensus.cc:2410] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:40.394510  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.357095  9250 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:40.395761  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.403406  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.403822  9572 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.383595  9435 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:40.410321  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.399653  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:40.421066  4139 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.319136  9512 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.423237  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.381507  9523 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:40.424610  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:40.390290  9211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.016s	sys 0.010s
I20260709 13:20:40.434738  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.382808  9596 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:40.440234  4142 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.399682  9467 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:40.440532  4146 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:40.457201  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.449051  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.449702  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.458187  4146 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:40.420217  9435 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:40.464954  4140 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:40.476696  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.476624  9435 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.464184  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:40.466075  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.478380  9435 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.479809  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.478422  4146 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:40.481451  9256 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.482928  9551 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:40.485229  4925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42908 (request call id 634) took 1380 ms. Trace:
I20260709 13:20:40.485877  4925 rpcz_store.cc:276] 0709 13:20:39.105147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.108506 (+  3359us) service_pool.cc:224] Handling call
0709 13:20:40.484952 (+1376446us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400039b54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:40.485154 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015335296}
I20260709 13:20:40.487182  4923 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:40.474473  4142 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:40.445871  9572 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:40.462095  9211 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.489588  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.489820  9211 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.491194  4147 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:40.491861  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:40.492434  9580 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.387s	user 0.002s	sys 0.000s
I20260709 13:20:40.492591  4142 raft_consensus.cc:2376] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11. Re-sending same reply.
I20260709 13:20:40.495870  9183 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:40.438898  9424 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.456466  9467 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:40.465534  9590 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.389s	user 0.001s	sys 0.001s
W20260709 13:20:40.501628  9568 consensus_meta.cc:287] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.792s	user 0.015s	sys 0.000s
I20260709 13:20:40.522547  4146 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:40.408381  9586 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.543467  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:40.544598  4142 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:40.497545  9183 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:40.548666  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:40.587575  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:40.509397  9211 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:40.395388  9591 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:40.557066  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.592130  4142 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:40.554420  9368 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.006s
I20260709 13:20:40.496299  9520 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:40.542428  9451 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
W20260709 13:20:40.561468  9532 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.003s
I20260709 13:20:40.569532  9467 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.514904  9424 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.626286  4923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42928 (request call id 382) took 1156 ms. Trace:
W20260709 13:20:40.596221  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 327070us
I20260709 13:20:40.605335  4288 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:40.608094  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.608239  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:40.632907  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:40.609547  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:40.613587  9425 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.009s
I20260709 13:20:40.615782  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:40.637811  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:40.617096  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:40.617697  4289 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:20:40.638845  4288 raft_consensus.cc:2393] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:40.619402  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:40.623275  4290 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:40.501362  9557 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.635028  4293 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:40.626740  4923 rpcz_store.cc:276] 0709 13:20:39.470139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.470262 (+   123us) service_pool.cc:224] Handling call
0709 13:20:40.486978 (+1016716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.487791 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.626033 (+138242us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b5400039b50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:40.626213 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187786624}
I20260709 13:20:40.616623  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:40.548398  9568 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.642524  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.613283  9368 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:40.557236  9183 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.625694  9451 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:40.641947  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:40.624871  9532 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:40.655293  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:40.662721  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 394496us
I20260709 13:20:40.668705  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:40.671433  9545 consensus_meta.cc:287] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.966s	user 0.011s	sys 0.002s
I20260709 13:20:40.634202  9520 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:40.691802  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:40.664433  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:40.721294  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.721787  4287 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:40.722684  4141 raft_consensus.cc:1240] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:40.718320  4292 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:40.683064  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:40.640095  9211 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.725494  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:40.738150  4295 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:40.694953  9467 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:40.738538  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 55658.5us
I20260709 13:20:40.739499  4187 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:40.643661  9425 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:40.657371  9599 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:20:40.723023  9545 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:40.724500  4288 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:40.765452  9606 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:40.742280  9211 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.006846  4289 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:40.875320  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.696013  9415 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:40.793087  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:40.769169  9393 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:41.005995  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:41.004834  4139 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.002s
W20260709 13:20:40.990165  9528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.050s	sys 0.107s
W20260709 13:20:41.013680  4261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.023s	sys 0.032s
W20260709 13:20:41.031977  4261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.023s	sys 0.032s
I20260709 13:20:41.027680  4142 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:41.030259  4139 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:41.047509  4292 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
W20260709 13:20:41.034085  9550 consensus_meta.cc:287] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.074s	user 0.020s	sys 0.002s
W20260709 13:20:41.032143  9604 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.373s	user 0.000s	sys 0.009s
I20260709 13:20:41.140493  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:41.035259  9528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.051s	sys 0.109s
W20260709 13:20:41.125471  9600 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.398s	user 0.001s	sys 0.013s
I20260709 13:20:41.153750  4139 raft_consensus.cc:2393] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 18: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:41.166239  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 444968us
W20260709 13:20:41.127774  9407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.008s	sys 0.041s
W20260709 13:20:41.169478  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.012504  9605 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:41.141247  9526 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.178040  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:41.192710  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.198557  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:41.036058  9415 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:41.206624  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.128602  9393 consensus_queue.cc:1048] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:20:41.216225  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:41.174870  9407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.009s	sys 0.042s
I20260709 13:20:41.208613  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:41.211220  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.194294  9586 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:41.217237  4291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.015s	sys 0.031s
W20260709 13:20:41.232879  4291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.016s	sys 0.031s
I20260709 13:20:41.199352  9606 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:41.217156  4142 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:41.142045  9609 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:41.157264  9550 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.239982  4142 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:41.234392  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 201880us
I20260709 13:20:41.211092  9535 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:41.217706  9250 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.220137  9610 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:41.230105  9256 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.748s	user 0.016s	sys 0.000s
I20260709 13:20:41.207882  9526 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:41.223304  9420 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:41.267105  4142 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:41.316358  4216 raft_consensus.cc:2410] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:41.242825  4139 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:20:41.225039  9591 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:41.263782  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:20:41.230432  9435 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.011s
I20260709 13:20:41.277390  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.265772  9529 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.326152  4140 raft_consensus.cc:2368] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 17. Current term is 19.
I20260709 13:20:41.240582  9613 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:41.244225  9424 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:41.331828  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 325898us
I20260709 13:20:41.264535  9557 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:41.264921  9183 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:41.332355  4923 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:41.303772  9568 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:41.372215  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 566) took 1136 ms. Trace:
I20260709 13:20:41.372838  4138 rpcz_store.cc:276] 0709 13:20:40.236168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.245505 (+  9337us) service_pool.cc:224] Handling call
0709 13:20:40.245957 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.246238 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.246265 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:40.322079 (+ 75814us) log.cc:844] Serialized 26 byte log entry
0709 13:20:40.660691 (+338612us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:40.660738 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.660840 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.371816 (+710976us) raft_consensus.cc:1685] finished
0709 13:20:41.371857 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.372108 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":269513,"threads_started":1,"wal-append.queue_time_us":919507}
I20260709 13:20:41.368149  9526 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:41.359938  9563 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.277s	user 0.012s	sys 0.008s
I20260709 13:20:41.385274  9563 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.387276  9425 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:41.388979  9563 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:41.390192  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59435.8us
W20260709 13:20:41.341948  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 105168us
I20260709 13:20:41.318184  9250 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.395848  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.398658  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.399083  9250 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:41.348047  9617 log.cc:927] Time spent T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:20:41.350365  9467 consensus_meta.cc:287] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.000s
W20260709 13:20:41.353865  9614 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:41.400496  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.401345  4143 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:41.357201  9550 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:41.358541  9527 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.178s	user 0.014s	sys 0.007s
I20260709 13:20:41.402303  9527 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:41.360029  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.006940  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:41.324049  9551 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.407670  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:41.361117  9211 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:41.362308  9589 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.923s	user 0.017s	sys 0.000s
I20260709 13:20:41.364617  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 565) took 1131 ms. Trace:
I20260709 13:20:41.365365  9415 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:41.365813  9536 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.554s	user 0.014s	sys 0.010s
I20260709 13:20:41.425972  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:41.426692  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:41.429167  4295 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:20:41.430893  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.268469  9609 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:41.392851  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:41.393664  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 58204.7us
I20260709 13:20:41.395812  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.407847  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:41.435883  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.414737  4141 rpcz_store.cc:276] 0709 13:20:40.232835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.240824 (+  7989us) service_pool.cc:224] Handling call
0709 13:20:40.241223 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.724821 (+483598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.364250 (+639429us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400069854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:41.364544 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106711424}
I20260709 13:20:41.436237  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.437508  4289 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:41.408562  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.421860  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:41.411371  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:41.438104  4143 raft_consensus.cc:2376] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14. Re-sending same reply.
W20260709 13:20:41.434405  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.436173  4288 raft_consensus.cc:2410] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:41.437361  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.439191  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.440021  4141 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:41.332865  9529 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.438104  4294 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:41.419579  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:41.440027  4143 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:41.446888  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.447325  4928 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:41.447682  4294 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:41.449587  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:41.450343  4294 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:41.449765  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.452826  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:41.454931  4291 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:41.466141  4138 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:41.470173  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.438335  9563 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:41.470932  4289 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:41.471567  4111 leader_election.cc:400] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13.
W20260709 13:20:41.502977  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 49297.2us
I20260709 13:20:41.505721  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:41.507282  4219 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:41.463119  9211 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:41.508894  9568 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:41.509987  9568 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:41.510401  9568 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:41.511267  9568 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.451527  9250 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:20:41.512825  4222 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:41.514796  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:41.515893  9619 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:20:41.434736  9536 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:41.522221  4146 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:41.522706  9568 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:41.525241  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2307) took 1039 ms. Trace:
I20260709 13:20:41.525703  4146 rpcz_store.cc:276] 0709 13:20:40.485591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.640248 (+154657us) service_pool.cc:224] Handling call
0709 13:20:41.525019 (+884771us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54003f8254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:41.525155 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924595072}
I20260709 13:20:41.526432  9470 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:41.527004  9470 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:41.462332  9183 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:41.532478  9183 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:41.535358  9183 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:41.535809  4923 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:41.536389  9471 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:41.478248  9630 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:41.536811  9471 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:41.537366  9630 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:41.537765  9630 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:41.538039  4922 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:20:41.537827  9471 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.538841  9630 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.480329  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:41.540784  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 60557.9us
I20260709 13:20:41.541278  4296 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:41.482977  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47174.5us
I20260709 13:20:41.543201  4187 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.544735  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.546100  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.547465  9383 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:41.483208  9529 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:41.547957  9383 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.416075  9551 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.548425  9383 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.483621  9283 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:41.549263  9512 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:41.549873  9283 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:41.550336  9283 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:41.550761  9283 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.551059  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.553090  9250 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:41.553805  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2305) took 1130 ms. Trace:
I20260709 13:20:41.554052  9250 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:41.554296  4147 rpcz_store.cc:276] 0709 13:20:40.423937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.479396 (+ 55459us) service_pool.cc:224] Handling call
0709 13:20:41.553609 (+1074213us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54003d8954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:41.553730 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24293760}
I20260709 13:20:41.484982  9204 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:41.499461  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2300) took 2174 ms. Trace:
I20260709 13:20:41.558662  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 564) took 1326 ms. Trace:
I20260709 13:20:41.559041  4145 rpcz_store.cc:276] 0709 13:20:40.232164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.232363 (+   199us) service_pool.cc:224] Handling call
0709 13:20:40.268218 (+ 35855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.310123 (+ 41905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.558364 (+1248241us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b5400069354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:41.558596 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14492416}
I20260709 13:20:41.528254  9470 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.486936  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.492005  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:41.466097  9424 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:41.462685  9557 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:41.451645  9613 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:20:41.571951  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:41.553164  4216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2302) took 2204 ms (client timeout 2015 ms). Trace:
W20260709 13:20:41.573048  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81142.3us
I20260709 13:20:41.591005  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.579309  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:41.500876  9597 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.049s	user 0.014s	sys 0.000s
I20260709 13:20:41.501053  9527 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:41.502097  9563 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:41.540202  9630 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.559106  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.557093  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.560326  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.561025  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2302) took 1170 ms. Trace:
W20260709 13:20:41.584420  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.555835  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.562368  4146 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:41.430507  9589 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:41.581044  4221 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:41.553802  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:41.573041  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 86213.2us
I20260709 13:20:41.595623  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.679881  4142 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:41.597157  4294 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:41.577150  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:41.594205  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:41.590355  4216 rpcz_store.cc:269] 0709 13:20:39.348901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.350099 (+  1198us) service_pool.cc:224] Handling call
0709 13:20:41.552860 (+2202761us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400025dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:41.553042 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4459296512}
I20260709 13:20:41.604636  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2627) took 1349 ms. Trace:
I20260709 13:20:41.684701  4222 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.605597  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:41.558187  4220 rpcz_store.cc:276] 0709 13:20:39.325250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.325365 (+   115us) service_pool.cc:224] Handling call
0709 13:20:39.325676 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.165240 (+839564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.499064 (+1333824us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54002ef754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:41.499346 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708909312}
I20260709 13:20:41.685454  4288 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:41.685107  4292 rpcz_store.cc:276] 0709 13:20:40.239445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.245631 (+  6186us) service_pool.cc:224] Handling call
0709 13:20:41.588708 (+1343077us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400289454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:41.588833 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033269120}
W20260709 13:20:41.688709  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 94594.8us
I20260709 13:20:41.691133  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.669879  4140 rpcz_store.cc:276] 0709 13:20:40.390867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.476326 (+ 85459us) service_pool.cc:224] Handling call
0709 13:20:41.560825 (+1084499us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b5400286254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:41.560961 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950682496}
W20260709 13:20:41.670704  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 113686us
I20260709 13:20:41.563675  9470 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:41.620322  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:41.629391  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.573287  9535 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:41.696301  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:41.693998  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:41.566450  9546 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:41.701035  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.695137  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:41.607340  9415 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:41.714794  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.715263  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.703354  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.716595  4146 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:41.606974  9567 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:41.689513  9594 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:41.607839  9560 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:41.699072  9569 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:41.714831  4144 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 13. Ops: [11.11-11.11]
W20260709 13:20:41.705739  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 100230us
I20260709 13:20:41.732007  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.702587  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.709780  4138 raft_consensus.cc:2376] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18. Re-sending same reply.
I20260709 13:20:41.734184  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:41.717775  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.573563  9424 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:41.721921  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:41.733821  4145 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:41.738140  4142 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:41.718624  9179 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:41.739257  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:41.708880  9548 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:41.740227  4146 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.725592  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:41.698634  9634 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.734871  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:41.600911  9611 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:41.705652  9557 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:41.617501  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:41.757558  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.733345  4143 raft_consensus.cc:2468] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:41.742659  4138 raft_consensus.cc:2376] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11. Re-sending same reply.
I20260709 13:20:41.721128  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.744288  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:41.708652  9546 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:41.746969  4147 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:41.718624  9527 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:41.698905  9568 consensus_queue.cc:1059] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:20:41.763136  4145 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:41.727227  9204 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:41.723448  9529 consensus_queue.cc:1059] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:20:41.767851  4222 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:41.768843  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:41.769716  9611 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:41.772135  4147 raft_consensus.cc:3060] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:41.772617  9179 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:41.823623  9179 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:41.773658  9550 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.828753  9550 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.834347  9415 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:41.856885  9415 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.858580  9424 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:41.859397  9424 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:41.860415  9550 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:41.861995  4294 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:41.864776  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:41.842464  9383 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.865978  4294 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:41.866427  9609 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:41.867400  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.868705  4219 raft_consensus.cc:2368] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:41.869639  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:41.871268  4291 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:41.872285  9283 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.873766  4294 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:20:41.874284  4294 pending_rounds.cc:85] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:20:41.874918  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2300) took 1489 ms. Trace:
I20260709 13:20:41.875727  4144 rpcz_store.cc:276] 0709 13:20:40.385663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.210051 (+824388us) service_pool.cc:224] Handling call
0709 13:20:41.566568 (+356517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.732130 (+165562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.873769 (+141639us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400069354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:41.874688 (+   919us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400069350. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:41.874847 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107205248}
I20260709 13:20:41.874993  9283 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:41.878715  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.874905  4294 pending_rounds.cc:107] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:20:41.880652  4294 raft_consensus.cc:2889] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:41.881771  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:41.882875  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:41.774860  9588 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:41.775846  9584 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.735612  9602 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.800526  9563 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.747407  9569 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:41.808576  4140 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
W20260709 13:20:41.773780  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52725.5us
I20260709 13:20:41.901767  4147 raft_consensus.cc:1275] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:41.836448  9471 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:41.920558  4186 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:41.758846  9183 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:41.730787  9567 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:41.739874  9591 consensus_queue.cc:1059] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:20:41.855880  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.955281  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:41.856143  9551 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:41.868081  9383 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:41.894984  4146 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:41.917845  9560 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:41.864137  9589 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:41.966866  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.932809  4293 raft_consensus.cc:1240] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:41.883350  9594 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:41.955281  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:41.883920  9283 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:41.957863  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:41.956691  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:41.971489  4294 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.972558  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:41.972858  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:41.973814  4296 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:20:41.903448  9588 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:42.013007  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 55209.1us
I20260709 13:20:42.018716  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:42.029963  4294 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
W20260709 13:20:42.031693  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 52903.9us
I20260709 13:20:41.968688  9609 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
W20260709 13:20:42.033080  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 288903us
I20260709 13:20:42.035415  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:42.042868  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:42.081598  4290 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 19: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:42.044026  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:42.082876  4287 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:20:41.980930  9283 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.973731  9557 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:41.922317  9525 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:20:42.051883  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:42.053791  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:41.926097  9527 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:20:41.972949  9594 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:42.036496  9629 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:41.957491  9572 raft_consensus.cc:2804] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:42.066848  9618 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:20:42.084473  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:42.089627  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:41.736024  9610 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.346s
I20260709 13:20:42.082242  9523 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.766578  9634 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:41.903048  9584 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:42.148299  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 63965.5us
I20260709 13:20:42.151007  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:41.902843  9602 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:42.140748  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 88976us
I20260709 13:20:41.860502  9611 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:42.086840  9283 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:42.108716  9583 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.165077  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.109951  9631 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:42.168473  9649 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:42.169117  9512 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.003s
I20260709 13:20:42.110042  9560 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:41.770902  9546 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:42.143293  9383 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.105229  9594 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:42.182895  9645 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:20:42.191265  9584 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:42.175690  9583 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.193127  9602 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:42.193776  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.194710  9583 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:42.196504  9630 consensus_meta.cc:287] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.003s
I20260709 13:20:42.164935  9545 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:42.081900  9569 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.164000  9550 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:42.174038  9595 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.255877  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 99998.4us
I20260709 13:20:42.149506  9523 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.185699  9179 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:42.265447  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.177667  9250 consensus_queue.cc:1059] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:20:42.200887  9649 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:42.226063  9512 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.247993  9545 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.276379  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:42.276422  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.277415  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:42.278577  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:42.265772  9628 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:20:42.280802  4218 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:42.089243  9567 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.261799  9630 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.180730  9631 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.397521  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:42.398751  4214 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 19: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:42.385545  4294 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:42.204583  9383 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.262140  9572 raft_consensus.cc:697] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:42.395500  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.402196  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:42.402307  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:42.149909  9588 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.406208  4213 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:42.406580  4217 raft_consensus.cc:2393] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:42.267745  9179 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:42.411248  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:42.222108  9646 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.206s
I20260709 13:20:42.417313  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:42.418016  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.419080  4218 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:20:42.424512  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.384675  9545 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:42.436703  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 272903us
I20260709 13:20:42.283136  9609 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:42.438633  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:42.439738  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:42.440280  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:42.262588  9550 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:42.263156  9595 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.264976  9557 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.485226  4222 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:42.439877  9204 consensus_meta.cc:287] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.004s
I20260709 13:20:42.491108  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.492098  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.388320  9512 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:42.493459  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53253us
I20260709 13:20:42.406581  9630 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.510015  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:42.504798  9644 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
I20260709 13:20:42.500974  9204 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:20:42.555748  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:42.526711  9647 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
I20260709 13:20:42.438954  9179 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.725994  9523 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:42.734226  9179 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:42.737725  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 1.00108e+06us
I20260709 13:20:42.721951  9611 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:42.723608  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:42.499068  9451 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:42.731901  4218 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:42.724546  9512 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:42.543952  9572 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.727536  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:42.527395  9649 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.728814  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:42.744946  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:42.748908  4294 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:42.755340  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.757766  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2336) took 1168 ms. Trace:
I20260709 13:20:42.758581  4215 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:42.764066  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:42.763955  4142 rpcz_store.cc:276] 0709 13:20:41.589085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.743184 (+154099us) service_pool.cc:224] Handling call
0709 13:20:41.814799 (+ 71615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.757377 (+942578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.757412 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.757476 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:42.757513 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.757583 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.757707 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":942008,"raft.queue_time_us":942166}
I20260709 13:20:42.760996  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.766968  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.774194  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.775185  4222 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 17: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:42.777823  9662 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:42.747886  9435 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.781890  9435 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.724573  9634 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:42.776085  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:42.793349  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65994.4us
I20260709 13:20:42.768787  9518 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:42.783567  9611 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:42.821277  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:42.823657  9183 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:42.824975  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 840) took 1055 ms. Trace:
I20260709 13:20:42.825408  9383 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:42.825040  9526 consensus_queue.cc:1048] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:42.836273  4924 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:42.835654  4923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 641) took 1156 ms. Trace:
I20260709 13:20:42.837183  4214 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:42.837764  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:42.836884  4923 rpcz_store.cc:276] 0709 13:20:41.678855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.679022 (+   167us) service_pool.cc:224] Handling call
0709 13:20:41.679807 (+   785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.693423 (+ 13616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.693476 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.706943 (+ 13467us) log.cc:844] Serialized 26 byte log entry
0709 13:20:41.903548 (+196605us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:41.903591 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.903662 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.835390 (+931728us) raft_consensus.cc:1685] finished
0709 13:20:42.835415 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.835581 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15,"raft.queue_time_us":13409,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11072,"spinlock_wait_cycles":89472,"thread_start_us":196237,"threads_started":1,"wal-append.queue_time_us":402075}
I20260709 13:20:42.796749  9451 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:42.833813  4216 rpcz_store.cc:276] 0709 13:20:41.769917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.772479 (+  2562us) service_pool.cc:224] Handling call
0709 13:20:41.772831 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.836658 (+ 63827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.836696 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:41.836751 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:41.836785 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.824681 (+987896us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b5400215554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:42.824739 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.824903 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146081024}
I20260709 13:20:42.842646  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:42.838609  4295 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:42.833845  9611 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:42.802862  9648 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.825312  9602 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:42.850448  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47710 (request call id 936) took 1056 ms. Trace:
I20260709 13:20:42.828203  9630 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:42.853819  4289 rpcz_store.cc:276] 0709 13:20:41.794396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.794691 (+   295us) service_pool.cc:224] Handling call
0709 13:20:41.795111 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.200309 (+405198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.200387 (+    78us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.200437 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:42.200471 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.850098 (+649627us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400259ed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:42.850178 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.850366 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931264896}
I20260709 13:20:42.858498  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:42.861114  4217 raft_consensus.cc:2410] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:20:42.860874  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 96927.2us
I20260709 13:20:42.865065  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:42.846763  9611 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:42.851838  9415 consensus_meta.cc:287] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.994s	user 0.018s	sys 0.002s
I20260709 13:20:42.844408  9183 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:42.872951  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 125339us
I20260709 13:20:42.796226  9655 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:20:42.850737  9602 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:42.875154  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.850384  9436 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.869088  4261 leader_election.cc:400] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 17. Current term is 19.
I20260709 13:20:42.872148  9425 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:42.884775  9183 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:42.879012  9560 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:42.878914  9629 consensus_meta.cc:287] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.742s	user 0.014s	sys 0.000s
I20260709 13:20:42.884213  9436 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.887980  9560 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.884810  9602 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.888320  9183 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:42.882349  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:42.890477  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 452482us
I20260709 13:20:42.841018  9518 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:42.900048  9629 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:42.917097  4147 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:42.921020  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:42.905826  9602 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:42.919716  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:42.855576  9648 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.930824  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:42.931638  9648 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:42.876809  9415 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.931929  9672 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.932600  9672 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.933569  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:42.933934  9415 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:42.935542  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.936237  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:42.938346  4141 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:20:42.940151  4141 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:42.945303  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.945780  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:42.951222  4139 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:42.956771  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:42.957891  4142 raft_consensus.cc:2393] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:42.946758  4145 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:42.960151  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:42.960990  4145 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:42.963371  4140 raft_consensus.cc:3055] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:42.963773  4140 raft_consensus.cc:740] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:42.924358  9470 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.217s	user 0.017s	sys 0.005s
I20260709 13:20:42.912315  9589 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.909897  9211 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.970742  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 101788us
I20260709 13:20:42.969290  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:42.924633  9568 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.943001  9594 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.683s	user 0.015s	sys 0.000s
I20260709 13:20:42.973340  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:42.924856  9668 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:42.957340  9471 consensus_meta.cc:287] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.031s	user 0.016s	sys 0.003s
I20260709 13:20:42.983923  4140 consensus_queue.cc:260] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:42.979064  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:42.968309  9283 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.796s	user 0.009s	sys 0.009s
W20260709 13:20:43.002990  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 207143us
I20260709 13:20:42.988948  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:42.991736  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:42.985849  4220 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
W20260709 13:20:43.001140  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48268.4us
I20260709 13:20:43.005096  4142 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:43.006242  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.008656  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.009058  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:42.975745  9435 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.014485  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:43.017299  4143 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:20:42.995862  9425 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:42.963110  9545 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.019507  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:43.028667  4143 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.029170  4186 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.019963  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:43.002948  9672 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.032936  4186 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.002369  9669 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:43.012740  9649 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:42.989112  9568 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.037699  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:43.038983  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.977126  9589 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.049196  4186 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.062386  4221 raft_consensus.cc:2368] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19.
I20260709 13:20:43.021997  9541 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:42.976956  9211 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:42.989374  9594 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:43.056843  4219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 3037) took 1478 ms (client timeout 1677 ms). Trace:
I20260709 13:20:43.037127  9588 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:43.018635  9655 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:43.021695  9425 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.004855  9283 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.061316  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 580) took 1365 ms. Trace:
W20260709 13:20:43.079548  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.081180  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.098644  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.013758  9611 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:43.087885  4219 rpcz_store.cc:269] 0709 13:20:41.578882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.579021 (+   139us) service_pool.cc:224] Handling call
0709 13:20:43.056607 (+1477586us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002f4754. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:43.056775 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636293376}
I20260709 13:20:43.046362  9436 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.166275  4142 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:43.030329  9451 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:20:43.098336  9435 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:20:43.066653  9541 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:43.146711  4143 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:43.044701  9630 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:43.143348  9425 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.151799  4138 rpcz_store.cc:276] 0709 13:20:41.696282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.761722 (+ 65440us) service_pool.cc:224] Handling call
0709 13:20:41.763857 (+  2135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.742190 (+978333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.742247 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.748214 (+  5967us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.968971 (+220757us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:43.018352 (+ 49381us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.033906 (+ 15554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.033998 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.061055 (+ 27057us) raft_consensus.cc:1685] finished
0709 13:20:43.061081 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.061249 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1067707,"raft.queue_time_us":997026,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":18648,"thread_start_us":220479,"threads_started":2,"wal-append.queue_time_us":262444}
I20260709 13:20:43.188768  4296 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:43.163231  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 82153.7us
I20260709 13:20:43.189399  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.190644  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.190834  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.191772  9546 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:43.193482  9204 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:43.193946  9204 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:43.194367  9204 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:43.167057  4112 connection.cc:256] RPC call timeout handler was delayed by -1.7656524149999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:20:43.010402  9668 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.098071  9470 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:43.146533  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46007.5us
I20260709 13:20:43.168074  9179 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:43.045749  9467 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:43.184896  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.209800  4143 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:20:43.163194  9543 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:43.183944  9541 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:43.192143  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.240499  4145 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:43.198433  9669 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:43.162804  9588 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:43.158691  9407 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:43.168622  9527 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:43.171299  9567 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:43.207513  9470 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.180832  9630 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.307543  9630 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:43.197911  4112 connection.cc:256] RPC call timeout handler was delayed by -1.0969524149998051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.242s for a response
I20260709 13:20:43.173597  9675 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:43.309242  9675 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.309798  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:43.309638  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:43.221238  9671 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:43.324728  4112 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:43.225729  9283 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.165606  9415 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:20:43.165783  9529 consensus_queue.cc:1059] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:20:43.170567  9528 consensus_queue.cc:1059] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:20:43.328754  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:43.236546  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.241883  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:43.345214  4296 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.188900  9560 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.210769  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:43.207135  9179 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.217092  9467 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:43.249141  9543 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:43.261866  9611 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:43.268923  9668 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.270503  9588 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.271903  9655 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.273454  9567 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.351521  9179 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:43.357712  9467 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.329874  9435 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:43.362468  9560 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:43.275264  9211 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.276187  9589 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.280643  9568 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.248797  9527 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:43.280906  4923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.288020  9545 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.328253  9675 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.326983  9669 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.289386  9594 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.291077  9631 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.246914  9629 consensus_queue.cc:1059] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:20:43.266248  9407 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.306524  9470 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.309604  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:43.424733  4295 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:43.222295  9674 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:43.310482  4288 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:43.311159  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.426862  4294 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:43.427788  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.314901  4291 raft_consensus.cc:1240] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:43.334724  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.337459  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.346722  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.329676  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:43.349901  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 139249us
W20260709 13:20:43.435016  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 105452us
I20260709 13:20:43.435845  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:43.327682  9471 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:43.388057  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 350424us
I20260709 13:20:43.439675  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:43.378060  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2323) took 1046 ms. Trace:
I20260709 13:20:43.330682  9550 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.340510  9584 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:43.398272  9543 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.392936  9655 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.365855  9687 raft_consensus.cc:3055] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:43.403126  9595 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.405472  9528 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.405964  9629 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:43.409967  9645 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:43.410208  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2317) took 1136 ms. Trace:
I20260709 13:20:43.561908  4220 rpcz_store.cc:276] 0709 13:20:42.275398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.276090 (+   692us) service_pool.cc:224] Handling call
0709 13:20:43.409949 (+1133859us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54002efc54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:43.410110 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379847040}
W20260709 13:20:43.416147  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.330715  9518 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.296082  4924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 767) took 1226 ms. Trace:
I20260709 13:20:43.359439  9283 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:43.440886  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:43.440608  4215 rpcz_store.cc:276] 0709 13:20:42.331734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.332159 (+   425us) service_pool.cc:224] Handling call
0709 13:20:42.332918 (+   759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.764558 (+431640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.377627 (+613069us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54002f4254. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:43.377958 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977897856}
I20260709 13:20:43.442694  4112 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:43.443699  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:43.582947  4216 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:43.471470  4928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02"
dest_uuid: "b81584b21ed144698954548303f1e507"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:33560
I20260709 13:20:43.583997  4928 raft_consensus.cc:606] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:43.584364  4928 raft_consensus.cc:614] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:43.475400  4295 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:43.380252  9527 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.470252  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:43.478657  4288 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:20:43.473904  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.478343  4147 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:20:43.476492  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:43.620414  4217 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:43.475865  4213 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:43.370747  9567 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.477206  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:43.499595  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2318) took 1222 ms. Trace:
I20260709 13:20:43.510185  9525 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:43.505759  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:43.488322  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.506757  9584 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.492419  4920 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:43.423517  9631 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:43.490814  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.568490  4924 rpcz_store.cc:276] 0709 13:20:42.070090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.070327 (+   237us) service_pool.cc:224] Handling call
0709 13:20:42.836063 (+765736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.839936 (+  3873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.295781 (+455845us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b540062dc50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:43.295988 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731124992}
I20260709 13:20:43.569556  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.641387  4292 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:43.642791  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:43.484153  9183 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.005s
I20260709 13:20:43.585822  4287 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:43.617839  9518 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:43.606252  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 163655us
I20260709 13:20:43.561134  9528 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.498997  9591 raft_consensus.cc:3055] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:43.488931  9568 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.509255  9471 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:43.618477  4220 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:20:43.627485  4221 rpcz_store.cc:276] 0709 13:20:42.277503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.278324 (+   821us) service_pool.cc:224] Handling call
0709 13:20:43.499349 (+1221025us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400026cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:43.499524 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556775808}
I20260709 13:20:43.499948  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2330) took 1073 ms. Trace:
I20260709 13:20:43.560698  9550 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.520963  9629 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:43.496721  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.636310  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:43.658236  4214 rpcz_store.cc:276] 0709 13:20:42.426465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.430253 (+  3788us) service_pool.cc:224] Handling call
0709 13:20:43.499757 (+1069504us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54003c37d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:43.499887 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860124032}
I20260709 13:20:43.702076  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.702878  4142 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:20:43.644232  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:43.703840  4292 raft_consensus.cc:2376] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11. Re-sending same reply.
I20260709 13:20:43.705008  4142 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:43.601887  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.706054  4295 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:20:43.706784  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.707219  4295 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:43.506415  9687 raft_consensus.cc:740] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:43.647380  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 184052us
I20260709 13:20:43.500777  9625 raft_consensus.cc:3055] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:43.651677  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:43.582224  9645 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.658241  4291 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:20:43.639791  9562 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.581661  9589 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:43.661550  9211 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:43.668491  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 98614us
I20260709 13:20:43.646579  9631 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.696465  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.720986  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.627714  9425 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.637512  9551 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:43.730479  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:43.637806  9594 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:43.700783  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:43.705145  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.733490  4289 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:43.734671  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.733500  4138 raft_consensus.cc:2410] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:43.711073  9625 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:43.750259  9425 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:43.751745  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.697484  9550 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.714720  4291 pending_rounds.cc:85] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 11
I20260709 13:20:43.760247  4291 pending_rounds.cc:107] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:20:43.760637  4291 raft_consensus.cc:2889] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:43.715556  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 64034us
I20260709 13:20:43.655294  9591 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:43.717216  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.608330  9283 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.638499  9525 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.696203  9518 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.781831  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:43.720610  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:43.721889  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.640139  9660 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:43.698135  9183 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:43.724470  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.787106  4143 raft_consensus.cc:2393] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 19: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:20:43.732492  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.740051  4261 connection.cc:256] RPC call timeout handler was delayed by -1.1332254080000439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2615s for a response
W20260709 13:20:43.720886  9658 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:43.708596  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.802415  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.802937  9545 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:43.803860  9545 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:43.798159  9183 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.805873  9525 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.806638  9183 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:43.806481  9471 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.806991  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:43.808705  9679 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:43.809924  9679 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:43.790517  9660 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.811342  9679 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:43.811728  9679 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:43.790195  9518 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.812434  9591 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.813685  9591 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:43.814522  4138 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:43.814767  9518 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.815616  4287 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:43.815801  9407 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:43.816808  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.817314  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:43.818116  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.818329  9688 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:43.818818  4138 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:43.818842  9688 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.819765  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:43.820015  9688 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:43.820734  9660 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:43.822777  9541 consensus_meta.cc:287] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.001s
I20260709 13:20:43.823397  9541 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.824661  4290 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:43.826077  4287 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:43.826808  9541 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:43.830832  9528 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.833671  9660 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:43.834349  9660 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.834970  9283 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.829689  9679 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.745059  4187 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:43.719519  9567 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:43.751679  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 116212us
I20260709 13:20:43.837697  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.712695  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.746140  9594 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.840287  4185 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:43.847111  9594 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.720836  9692 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:43.847515  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.848869  9692 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.848964  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.850466  4293 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
I20260709 13:20:43.850723  9626 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:43.851284  9626 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.851610  9692 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.851732  9626 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:43.728992  9606 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:43.852484  9606 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:43.853904  9204 consensus_meta.cc:287] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.659s	user 0.014s	sys 0.000s
I20260709 13:20:43.771713  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.854350  9204 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.854992  9606 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:43.774497  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.855917  4295 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:20:43.729175  9562 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.840847  9601 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:20:43.861145  4295 pending_rounds.cc:85] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 8
I20260709 13:20:43.835645  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:43.849748  9700 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:43.739080  9551 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:43.851167  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.732553  9611 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:43.776329  9595 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:43.764775  9694 log.cc:927] Time spent T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:20:43.841675  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:43.842924  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 97951.5us
I20260709 13:20:43.842949  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:43.843307  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:43.777619  9629 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.843899  9525 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:43.845395  9527 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:43.845383  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:43.923938  4142 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.840693  9660 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.859521  9631 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:43.745059  9669 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:43.762658  4112 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:43.743328  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.839111  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.883183  4295 pending_rounds.cc:107] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:20:43.938216  4295 raft_consensus.cc:2889] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:43.866430  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:43.884721  4261 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.2.243.126:38007, user_credentials={real_user=slave}} blocked reactor thread for 84015.8us
W20260709 13:20:43.784261  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.888899  4296 consensus_meta.cc:287] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.000s
I20260709 13:20:43.940677  4296 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:43.941869  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:43.942824  9541 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:43.943300  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.944546  9541 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.944053  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:43.946970  9541 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:43.947511  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.884496  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:43.948617  4138 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
W20260709 13:20:43.898818  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 63244.3us
I20260709 13:20:43.950045  4186 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.949455  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:43.779421  9687 consensus_queue.cc:260] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.957247  9687 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:43.804211  9545 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:43.965255  9545 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.966923  9545 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:43.968732  9669 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.969141  9626 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.971568  9626 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.971868  9606 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:43.972769  9606 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:43.974053  9606 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.975728  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.862715  9630 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.976632  9631 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:43.977311  9631 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:43.978466  9630 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.978411  9631 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.979681  9204 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.885378  9625 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:43.981132  9467 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.004s
I20260709 13:20:43.864794  9645 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:43.847774  9594 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:43.981647  9467 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:43.982663  9629 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.986444  4186 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:43.992074  4218 raft_consensus.cc:2368] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19.
W20260709 13:20:43.992996  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.995033  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46015.8us
I20260709 13:20:43.919567  4214 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 12.
I20260709 13:20:43.932588  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:43.965838  9550 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:43.982812  4294 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:44.006529  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:43.918905  4217 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 16.
W20260709 13:20:44.013796  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 147475us
W20260709 13:20:44.016799  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 254173us
I20260709 13:20:44.017906  4112 leader_election.cc:400] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:44.018282  4112 leader_election.cc:403] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:44.018563  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:44.018150  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.917883  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:43.987504  9204 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:44.035244  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.046409  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:44.046989  4221 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:44.036748  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.037637  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.050658  4215 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:44.051172  4146 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
W20260709 13:20:44.038250  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.052206  4146 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:43.971549  9669 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:44.028846  4295 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:44.059090  4141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:44.059478  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:44.059999  4141 raft_consensus.cc:606] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.060529  4141 raft_consensus.cc:614] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:44.015331  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:44.043344  4292 raft_consensus.cc:1240] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:44.061993  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:44.062969  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:44.065096  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:44.066490  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51199.9us
W20260709 13:20:44.057025  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 139292us
I20260709 13:20:44.059099  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:44.071286  4187 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.049382  4222 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:20:44.073307  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.074934  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:44.005728  9179 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.000s
I20260709 13:20:44.078799  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:44.056169  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.083738  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:44.027127  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:44.087340  4296 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:43.994273  9679 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:44.090260  4187 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.124310  4142 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:44.095760  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.028995  9648 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.004134  9645 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:44.162412  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 78773.9us
I20260709 13:20:44.057822  9692 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:20:44.041307  9594 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:44.040956  9204 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.055616  9541 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:44.028137  9526 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:44.166410  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.055291  9528 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:44.078250  9425 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:44.186264  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:44.187098  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:43.936669  9611 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:44.091181  9621 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:44.055437  9211 consensus_queue.cc:1059] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.153s
W20260709 13:20:44.164314  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 74171.3us
I20260709 13:20:44.089020  9467 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:44.026059  9660 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.150s
I20260709 13:20:44.193311  9204 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:44.161274  9415 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:20:44.162698  9525 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:44.213860  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:44.077852  9656 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:44.220501  4293 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:44.177110  9583 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:44.173452  9435 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.057886  9543 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.148s
I20260709 13:20:44.210331  9584 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:44.058347  9560 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:44.161422  9669 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:44.235697  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.225056  9541 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:44.161049  9179 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.246378  4292 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:44.234750  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2727) took 1319 ms. Trace:
I20260709 13:20:44.250630  4213 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:44.248499  9470 consensus_meta.cc:287] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.804s	user 0.013s	sys 0.000s
W20260709 13:20:44.255755  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.209980  9594 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:44.265790  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:44.218753  9621 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:44.229048  9548 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.274201  9525 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:44.316083  9551 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:44.317382  9551 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:44.317948  9551 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.318399  9551 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:44.320107  9594 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.214685  9589 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:20:44.252301  9656 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.330574  4139 rpcz_store.cc:276] 0709 13:20:42.915718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.922362 (+  6644us) service_pool.cc:224] Handling call
0709 13:20:42.922744 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.951999 (+ 29255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.234170 (+1282171us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b540022f6d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:44.234649 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64748928}
I20260709 13:20:44.214576  9526 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:44.314589  9697 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.563s	user 0.000s	sys 0.001s
I20260709 13:20:44.366734  4221 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:44.312858  9675 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:44.327936  9621 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:44.377547  4289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.029s	sys 0.043s
W20260709 13:20:44.378084  4289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.029s	sys 0.043s
I20260709 13:20:44.370532  4219 raft_consensus.cc:1240] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:44.367606  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.393431  4213 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:44.394634  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.395347  4213 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:44.372056  4139 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:44.268512  9655 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:44.396550  9660 consensus_queue.cc:1243] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:44.334578  9541 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:44.342906  9656 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:44.437530  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 267270us
I20260709 13:20:44.314975  9470 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:44.370596  4147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.036s	sys 0.034s
W20260709 13:20:44.449242  4147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.036s	sys 0.034s
I20260709 13:20:44.333066  9548 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:44.440303  9698 log.cc:927] Time spent T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.337s	user 0.004s	sys 0.001s
I20260709 13:20:44.370105  9675 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:44.429289  9529 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:44.485607  4213 raft_consensus.cc:1240] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:44.491259  4216 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:44.502184  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 423473us
W20260709 13:20:44.513203  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 201274us
W20260709 13:20:44.514434  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.520489  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:44.523990  4213 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: [16.7-16.7]
I20260709 13:20:44.535601  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:44.537569  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.511492  9706 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.419s	user 0.000s	sys 0.002s
I20260709 13:20:44.539213  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:44.540592  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:44.542466  4294 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:44.541767  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.547955  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:44.552030  4288 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.546705  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.544983  9541 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.556988  4290 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:44.557516  9548 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:44.567212  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:44.493659  9529 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.523397  9583 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:44.601485  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:44.606597  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 86242us
I20260709 13:20:44.608086  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:44.552335  9572 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:44.540442  9655 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:44.593158  4294 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:44.617426  4261 leader_election.cc:400] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19.
I20260709 13:20:44.627166  4261 leader_election.cc:403] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:20:44.627487  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.497330  9525 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:44.610628  9629 consensus_meta.cc:287] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.001s
I20260709 13:20:44.543963  9719 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:20:44.638753  4213 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:44.626581  9692 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.639916  9467 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19.
I20260709 13:20:44.633351  9714 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:44.653465  9714 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.642931  4220 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:44.653884  9714 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.654954  9716 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:44.655613  9716 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:44.656047  9710 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:44.656443  9723 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:20:44.641845  9707 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:20:44.659238  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:44.660517  9716 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:44.661716  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:44.663873  9719 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:44.664316  9719 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.549057  9675 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.664721  9719 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:44.665410  9675 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:44.667029  9716 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:44.668305  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:44.675046  9692 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:44.675572  9718 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:44.677132  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:44.677606  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:44.678527  4217 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:44.679535  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.679762  9692 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:44.681216  9688 consensus_meta.cc:287] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.005s
I20260709 13:20:44.681493  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:44.681886  9688 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:44.683303  4928 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:44.685537  9692 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:44.687872  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:44.691066  9719 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.692899  9179 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:44.648841  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.695670  4213 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:44.695478  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:44.613806  9704 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:44.701890  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:44.696993  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.715734  4213 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:44.717167  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.703969  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.717707  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:44.623474  9611 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:44.669258  9711 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:20:44.711108  4288 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 20.
I20260709 13:20:44.724778  4222 raft_consensus.cc:1240] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:44.721846  4217 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:44.626698  9645 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:20:44.735349  9645 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:44.735747  9645 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:44.736698  9645 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.737980  9645 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:44.738929  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.739694  4221 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:44.720702  9425 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.644372  9655 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:44.743156  9655 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:44.727973  9719 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:44.693730  9692 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:20:44.748546  9669 consensus_queue.cc:1175] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" responder_term: 16 status { last_received { term: 15 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 15 index: 7 } }
I20260709 13:20:44.752079  9470 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:44.756752  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2667) took 1043 ms. Trace:
I20260709 13:20:44.756565  9583 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.757238  4289 rpcz_store.cc:276] 0709 13:20:43.713884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.826374 (+112490us) service_pool.cc:224] Handling call
0709 13:20:43.826787 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:43.827220 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.827254 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.827816 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:20:44.388155 (+560339us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:44.388226 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.388306 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.756432 (+368126us) raft_consensus.cc:1685] finished
0709 13:20:44.756459 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.756661 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":550159,"threads_started":1,"wal-append.queue_time_us":659379}
I20260709 13:20:44.727671  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:44.713083  9568 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 1.052s	user 0.012s	sys 0.002s
I20260709 13:20:44.712622  9704 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.768277  9704 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:44.730688  9611 raft_consensus.cc:2764] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:44.732932  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:44.733206  9526 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:44.734584  9591 consensus_meta.cc:287] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.920s	user 0.003s	sys 0.010s
I20260709 13:20:44.760869  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.713903  9543 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:44.732800  9527 consensus_meta.cc:287] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.004s
I20260709 13:20:44.728679  9660 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.714067  9467 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:20:44.764173  4112 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:44.772830  9545 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.805s	user 0.013s	sys 0.001s
I20260709 13:20:44.785580  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.769451  9688 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:44.771387  9568 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:44.778564  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:44.797557  4213 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:44.786882  9591 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:44.798583  9591 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:44.799054  9591 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:44.800971  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:44.802635  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:44.803218  4221 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:44.772612  9687 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.005s
I20260709 13:20:44.806365  9714 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.786899  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.810995  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:44.811199  9584 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:44.811637  9584 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:44.812578  9687 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.813452  9687 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:44.786998  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:44.784539  9543 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:44.821223  9543 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.822834  9283 consensus_queue.cc:1059] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:44.824066  9629 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:44.825523  9629 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:44.826556  4140 raft_consensus.cc:3060] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.829649  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:44.830632  4296 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:44.833092  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:44.834000  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.834702  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.837679  9548 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.826556  9629 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.841231  9560 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:44.842077  9560 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.845427  9625 raft_consensus.cc:3060] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:44.847081  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.792847  9720 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:44.793143  9726 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:44.849279  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.859998  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 142458us
I20260709 13:20:44.861517  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:44.868060  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:44.868934  4292 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:44.873096  4219 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:44.867483  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:44.877758  4218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2335) took 1437 ms. Trace:
I20260709 13:20:44.878168  4218 rpcz_store.cc:276] 0709 13:20:43.440455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.440588 (+   133us) service_pool.cc:224] Handling call
0709 13:20:44.877519 (+1436931us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400025dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:44.877682 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941681920}
W20260709 13:20:44.884696  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 72366.2us
I20260709 13:20:44.886121  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:44.887989  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:44.884294  9541 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:44.893229  9541 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.893687  9541 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:44.894003  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.870978  9560 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:44.890763  4296 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:44.900944  4221 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:44.907612  4296 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:44.908684  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:44.909466  4142 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:44.909411  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:44.864775  9720 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.905555  4893 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:44.838415  9548 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.864390  9611 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.912802  9629 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:44.917394  4186 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:44.872491  9526 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:44.888168  9692 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:44.929520  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:44.933274  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:44.929104  4147 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:44.793963  9660 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.888513  9415 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.891146  9584 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.876946  9726 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:44.990355  4146 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.936233  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:44.964273  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47024.9us
I20260709 13:20:44.913470  9569 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:44.989006  9548 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:44.970562  9527 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:45.023082  9733 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.026949  9527 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.027333  9733 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.023356  9415 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:44.968835  9594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.010s	sys 0.010s
W20260709 13:20:45.028604  9594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.020s	sys 0.012s
I20260709 13:20:45.029840  9733 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:45.030233  9527 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.034832  9726 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.035313  4146 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:45.036929  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.036844  9645 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:45.038173  9645 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:44.969537  9714 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:45.024940  9204 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.004s
I20260709 13:20:45.044762  9204 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.047269  9204 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:44.933990  9688 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:45.048748  9688 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:44.984894  9528 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:45.049840  9688 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.050452  9528 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:45.051398  9528 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.052613  9528 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:44.976536  9715 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.593s	user 0.000s	sys 0.004s
I20260709 13:20:45.056843  4925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42908 (request call id 652) took 1115 ms. Trace:
W20260709 13:20:45.057775  9731 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:20:45.057384  4925 rpcz_store.cc:276] 0709 13:20:43.942596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.944455 (+  1859us) service_pool.cc:224] Handling call
0709 13:20:43.944861 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:44.013576 (+ 68715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.013628 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:44.014400 (+   772us) log.cc:844] Serialized 26 byte log entry
0709 13:20:44.384676 (+370276us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:44.384747 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.384877 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.975820 (+590943us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:45.056437 (+ 80617us) raft_consensus.cc:1685] finished
0709 13:20:45.056468 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.056754 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68125,"raft.queue_time_us":69382,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":25874,"spinlock_wait_cycles":109310720,"thread_start_us":221434,"threads_started":1,"wal-append.queue_time_us":323643}
W20260709 13:20:45.061210  9730 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:20:45.066640  9656 consensus_meta.cc:287] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
I20260709 13:20:45.067198  9656 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.029937  9415 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.025063  4139 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:45.024706  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:45.072618  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.074290  4139 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:44.980921  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:44.932632  9679 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.009s
I20260709 13:20:45.081142  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.082631  4147 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.082497  4219 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 11: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:45.090144  4140 raft_consensus.cc:1275] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:44.935402  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:44.924897  9720 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:45.066685  9551 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.748s	user 0.014s	sys 0.001s
I20260709 13:20:44.992404  9588 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.094261  4144 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:44.929716  9560 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:45.095647  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 71066.2us
I20260709 13:20:45.044029  9660 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.097059  4919 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:45.044018  9645 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:44.913358  9717 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:45.125207  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.100621  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2723) took 2176 ms. Trace:
I20260709 13:20:44.919555  9687 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:45.093007  4142 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
W20260709 13:20:44.974808  9725 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.588s	user 0.002s	sys 0.000s
I20260709 13:20:45.019574  9526 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:45.056860  9621 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.006s
I20260709 13:20:45.116266  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:45.119694  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 184398us
W20260709 13:20:45.101645  9536 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:20:45.115338  9548 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:45.132064  4213 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:45.135008  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 247089us
I20260709 13:20:45.135282  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:45.138208  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.111153  9595 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.938271  9611 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.142840  4139 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:20:45.141932  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:45.137121  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.127813  4140 rpcz_store.cc:276] 0709 13:20:42.914257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.919183 (+  4926us) service_pool.cc:224] Handling call
0709 13:20:42.944678 (+ 25495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.408183 (+463505us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b18002080e0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ed1d646 00007fee3ec5758e 00007fee3ecd8f9e 00007fee3ecda7de 00007fee3ece4b49 00007fee3ece5416 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4
0709 13:20:44.826298 (+1418115us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5800894bd0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec3e0aa 00007fee3ecc0447 00007fee3ecd8fe7 00007fee3ecda7de 00007fee3ece4b49 00007fee3ece5416 00007fee3ece1d8f 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4
0709 13:20:45.090631 (+264333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.090879 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949105152}
I20260709 13:20:45.139246  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:45.147900  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 213484us
I20260709 13:20:45.150382  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:45.146152  4186 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:45.124315  9204 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:45.158051  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6091d765c73842c992d8c60523872ccc"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:45.130158  9560 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.080744  9692 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.146045  9548 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:45.146142  9606 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:45.159423  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:45.164897  4147 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:45.116138  9551 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:45.182298  9675 consensus_meta.cc:287] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
W20260709 13:20:45.213672  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54379.6us
I20260709 13:20:45.149060  9525 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:20:45.228470  4221 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:45.146538  9621 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.260237  4221 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:45.218969  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:45.221834  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:45.162189  9595 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.222868  9656 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.216192  9672 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:45.223692  9560 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:45.223907  9734 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:20:45.224184  9739 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:45.163776  9204 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:45.165891  9569 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:45.166075  9471 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:20:45.246093  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.187305  9250 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:45.210111  9548 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:45.297322  9704 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 13:20:45.297880  9704 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:45.262370  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:45.301484  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.274367  9675 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:45.304764  9675 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:45.305441  9589 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.305806  9675 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.263736  9622 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:45.308660  9622 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.263034  4216 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:20:45.311005  9622 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:45.318883  9572 consensus_meta.cc:287] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.001s
I20260709 13:20:45.319458  9572 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:45.278236  9672 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.139328  9717 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.265395  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:45.193015  4186 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:45.168326  9660 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:20:45.289256  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:45.167711  9687 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:20:45.155457  9703 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:20:45.296480  9250 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:45.306057  9589 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.291085  4927 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:45.320331  4218 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:20:45.334326  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 141494us
W20260709 13:20:45.332564  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 67255.2us
I20260709 13:20:45.354481  4221 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:20:45.343562  9250 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:45.365855  4296 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:20:45.331367  9717 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:45.332964  9415 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:45.367187  9415 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.367652  9415 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:45.368697  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.357205  4220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 3053) took 1323 ms. Trace:
I20260709 13:20:45.369750  4220 rpcz_store.cc:276] 0709 13:20:44.033920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.035699 (+  1779us) service_pool.cc:224] Handling call
0709 13:20:44.036129 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.669532 (+633403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.336315 (+666783us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540041a5d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:45.357102 (+ 20787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394931072}
I20260709 13:20:45.343463  9703 consensus_queue.cc:1243] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:45.332916  4146 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:45.334525  9525 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:45.374006  9525 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:45.322897  9551 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.324106  9611 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:45.349720  9526 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.375942  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.332756  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:45.320399  9548 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.377713  4288 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:45.333866  9660 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:45.352329  9591 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.002s
I20260709 13:20:45.378659  9660 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:45.379154  9591 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.379509  9548 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:45.379727  9660 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.381099  9660 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.381435  9591 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.381640  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.382036  9692 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:45.365662  9655 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:45.383028  9655 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.320973  9672 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.384232  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:45.385417  9655 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:45.385577  9572 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:45.340816  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.389564  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 3059) took 1352 ms. Trace:
I20260709 13:20:45.389940  4215 rpcz_store.cc:276] 0709 13:20:44.037510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.051529 (+ 14019us) service_pool.cc:224] Handling call
0709 13:20:45.340553 (+1289024us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:20:45.389489 (+ 48936us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57360128}
I20260709 13:20:45.375353  9525 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.393352  4144 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:20:45.394309  9695 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.583s	user 0.004s	sys 0.000s
I20260709 13:20:45.293433  9471 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.398778  4293 pending_rounds.cc:85] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 8
I20260709 13:20:45.399269  4293 pending_rounds.cc:107] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:20:45.399575  4293 raft_consensus.cc:2889] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:45.400815  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:45.383064  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:45.405128  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:45.412181  4288 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:45.404033  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:45.288879  9204 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:45.417752  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:45.422503  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.424075  4141 raft_consensus.cc:2410] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:45.334687  9704 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:45.435348  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.436820  4295 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:45.440393  4295 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:45.396538  9471 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:45.444214  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:45.415555  9709 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.899s	user 0.002s	sys 0.003s
I20260709 13:20:45.447057  4261 leader_election.cc:400] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19.
I20260709 13:20:45.410633  9629 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:45.450393  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:45.450042  9250 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.458571  9595 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.458804  9611 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:45.459403  9467 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:45.459605  9611 consensus_queue.cc:1243] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:45.459905  9467 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:45.455235  9655 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:20:45.460321  9250 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:45.460366  9467 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:45.455607  9629 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.462977  9629 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:45.460559  9740 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:20:45.464910  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.465405  9740 consensus_queue.cc:1243] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:45.460762  9738 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:45.466322  4147 raft_consensus.cc:2410] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:45.466472  9738 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:45.460824  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.468904  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.470160  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.471371  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.471232  9736 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:45.474848  9736 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:45.475242  9736 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:45.475180  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.403564  9687 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:20:45.476975  9560 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:45.477392  9560 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:45.478309  9560 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.479580  9560 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:45.476429  9736 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.481693  9621 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:45.473845  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:45.467962  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.483855  4295 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.485311  4295 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.402997  9672 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.484867  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.476250  4139 raft_consensus.cc:2410] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:45.504882  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.483727  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.506641  4288 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
W20260709 13:20:45.492302  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 213164us
I20260709 13:20:45.503436  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.508630  4186 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:45.511250  4138 raft_consensus.cc:2376] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16. Re-sending same reply.
I20260709 13:20:45.523865  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.529704  4138 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:45.533468  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.539230  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:45.540002  4218 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.541225  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.548358  4141 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:45.552214  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:45.552547  4214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 3065) took 1504 ms (client timeout 1819 ms). Trace:
W20260709 13:20:45.553010  4214 rpcz_store.cc:269] 0709 13:20:44.048597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.049285 (+   688us) service_pool.cc:224] Handling call
0709 13:20:45.541059 (+1491774us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5800185198. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43ca80a0 00007fee43ca7984 00007fee3d2226d4 00007fee3d222662
0709 13:20:45.552468 (+ 11409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255784320}
I20260709 13:20:45.546209  4295 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:45.556320  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.557039  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.557734  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:45.558101  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.559628  4215 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:45.559855  4220 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:45.561337  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.562352  4214 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 17: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:45.553234  4141 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:45.569211  4147 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:45.574515  4289 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:45.534919  9736 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:45.583388  4218 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:45.536065  9595 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.587463  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:45.589140  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.600401  4922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:45.602288  9415 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.579273  9583 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.606010  9583 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.585054  9656 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:45.609244  9656 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.612746  9595 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.614085  9704 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:45.615487  9595 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.550067  9250 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:45.617065  9250 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.617533  9250 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:45.620028  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46588.1us
I20260709 13:20:45.568161  9663 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:20:45.626545  4140 raft_consensus.cc:606] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:45.627359  4140 raft_consensus.cc:614] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:45.629196  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.629657  4222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 3070) took 1362 ms. Trace:
I20260709 13:20:45.630179  4295 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:45.630125  4222 rpcz_store.cc:276] 0709 13:20:44.267456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.267652 (+   196us) service_pool.cc:224] Handling call
0709 13:20:44.268127 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.725544 (+457417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.629356 (+903812us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400026cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:45.629587 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049637248}
I20260709 13:20:45.632263  4289 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:45.632486  9183 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:20:45.637418  9704 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:45.634426  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:45.639038  9704 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:45.639384  4214 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.639490  9704 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:45.640506  9704 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.639042  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.642489  4219 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:20:45.642736  9583 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:45.643402  9708 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.131s	user 0.004s	sys 0.004s
I20260709 13:20:45.645408  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2353) took 1940 ms. Trace:
I20260709 13:20:45.646199  9738 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.647094  9656 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:45.653430  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.659490  4222 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:20:45.661550  9744 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.364s	user 0.003s	sys 0.000s
W20260709 13:20:45.665047  9625 consensus_meta.cc:287] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.819s	user 0.007s	sys 0.007s
W20260709 13:20:45.671877  9541 consensus_meta.cc:287] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.778s	user 0.013s	sys 0.000s
I20260709 13:20:45.666174  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:45.680279  9562 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.689940  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.645841  4143 rpcz_store.cc:276] 0709 13:20:43.705294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.787983 (+ 82689us) service_pool.cc:224] Handling call
0709 13:20:43.807784 (+ 19801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:43.808149 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.808183 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.808740 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:20:44.044292 (+235552us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:44.044419 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.044498 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.642705 (+1598207us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:45.645027 (+  2322us) raft_consensus.cc:1685] finished
0709 13:20:45.645055 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.645312 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7271,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":17615104,"thread_start_us":235101,"threads_started":1,"wal-append.queue_time_us":636562}
I20260709 13:20:45.695864  4296 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:45.714603  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.696736  9629 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.703644  4214 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 17.
I20260709 13:20:45.716831  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.729830  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:45.735767  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.534284  9720 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:45.745165  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.745606  9660 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:45.736188  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:20:45.754557  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.695897  9584 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.762666  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.747018  9471 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.734712  9383 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:45.766382  4142 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:45.726347  9568 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:20:45.784571  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.759006  9738 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:45.793531  4295 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:20:45.775766  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.765118  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:45.761559  9562 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:45.797125  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:45.800530  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.802115  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.803946  4143 raft_consensus.cc:2393] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:45.738080  9541 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.806275  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.808674  4185 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:45.809739  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:45.766002  9526 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:20:45.814442  9720 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.812633  9737 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:45.807137  9745 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:20:45.817444  4290 raft_consensus.cc:2393] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:45.818286  9471 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.818977  4138 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 12: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:45.820394  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.821288  4138 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:45.822422  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:45.823212  4138 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:45.825115  9467 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.826404  9551 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:45.809939  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:45.827889  9467 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:45.829048  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.862856  9672 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.830543  9737 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.834144  9629 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.805276  9204 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:45.835870  9528 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.783s	user 0.014s	sys 0.000s
I20260709 13:20:45.879366  4141 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:45.838001  9541 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:45.838865  4292 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:45.801862  9621 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:45.885744  9621 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 17 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:45.887107  9621 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:45.894178  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:45.841148  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 662436us
I20260709 13:20:45.912590  9672 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:45.840961  9250 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:45.844403  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.845065  4139 raft_consensus.cc:2410] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:45.800391  9562 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:45.850792  9415 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.898197  9204 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:45.914638  9672 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:45.956274  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.954504  9528 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:45.962428  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:45.954950  9383 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.960187  4290 raft_consensus.cc:2393] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:20:45.961055  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.962881  4138 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:45.968870  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:45.975114  4138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:45.955117  9551 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.951025  9562 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:45.976329  9383 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:45.980983  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:45.975960  4112 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:45.984025  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:45.977370  9560 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:45.993701  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.993939  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.958145  9720 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:20:45.994261  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:45.992359  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:45.997587  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.001699  4221 raft_consensus.cc:2368] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:45.998382  4213 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:45.999922  4218 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:45.989867  4138 raft_consensus.cc:606] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.004985  4138 raft_consensus.cc:614] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:46.010102  4259 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:46.017735  4259 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:46.028064  4217 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:46.026376  4187 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.029343  4213 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:46.030928  4219 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:46.035564  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:46.035960  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.036301  4293 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.039448  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.040799  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:46.041558  4215 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.042738  4187 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.046204  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:46.046954  4219 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:46.047600  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.058391  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:46.062798  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:46.064014  4291 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:46.006383  9528 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:46.067757  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:45.985242  9551 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.032856  9415 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.028965  9541 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:46.073565  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.074404  4216 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:46.075862  4221 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:46.048884  9525 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:46.049377  9606 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.049010  9467 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:46.058931  9560 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.038892  9726 consensus_queue.cc:1048] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:20:46.058265  9675 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.087764  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:46.058655  9250 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:46.097061  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:46.120728  4216 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:46.085538  4215 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:46.069993  9716 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:46.086174  9701 log.cc:927] Time spent T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 2.274s	user 0.003s	sys 0.009s
I20260709 13:20:46.128986  4214 raft_consensus.cc:2410] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:46.121671  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.135048  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.097013  4293 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:46.064280  9407 consensus_queue.cc:1059] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:20:46.125644  9716 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.126293  9383 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:46.166164  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.218142  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:46.089386  9467 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:46.225991  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.241865  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:46.122402  9560 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.247196  9560 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:46.131878  9675 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.248943  9551 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:46.249518  9716 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:46.251150  9675 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:46.251837  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 587) took 2754 ms. Trace:
I20260709 13:20:46.256824  9720 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:46.257562  9467 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.244237  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:46.252274  4145 rpcz_store.cc:276] 0709 13:20:43.497720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.500503 (+  2783us) service_pool.cc:224] Handling call
0709 13:20:43.500997 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:43.501414 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.501442 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.502027 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.701745 (+199718us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:43.746281 (+ 44536us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.746529 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.746607 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.974858 (+228251us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b180004bd00. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:20:43.977112 (+  2254us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b180004bd00. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:20:43.980132 (+  3020us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b48002a0558. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee43c0baa1 00007fee43c02b37 00007fee43c029ca 00007fee43cfa26f 00007fee43cf9f37 00007fee43d0e55c 00007fee43d0e508 00007fee43d0e488 00007fee43d0e443 00007fee43d0d6ec 00007fee42c37a96
0709 13:20:45.958756 (+1978624us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:46.251533 (+292777us) raft_consensus.cc:1685] finished
0709 13:20:46.251563 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.251755 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135334,"prepare.queue_time_us":47991,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":2020,"raft.run_cpu_time_us":3615,"raft.run_wall_time_us":470840,"spinlock_wait_cycles":122639360,"thread_start_us":137266,"threads_started":1,"wal-append.queue_time_us":243227}
I20260709 13:20:46.200945  9584 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:46.277424  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:46.274358  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.083412  9415 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.292459  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.293278  4216 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:46.283299  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.297413  4145 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:46.237375  9625 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:20:46.301862  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 256029us
I20260709 13:20:46.298751  9407 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:46.285676  9528 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:46.316291  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.323307  4143 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:46.317929  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.324079  4146 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:46.333896  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:46.340323  4219 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
W20260709 13:20:46.350602  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 321242us
I20260709 13:20:46.357110  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:46.358290  4146 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.365440  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2366) took 1455 ms. Trace:
I20260709 13:20:46.365999  4142 rpcz_store.cc:276] 0709 13:20:44.909717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.159043 (+249326us) service_pool.cc:224] Handling call
0709 13:20:45.339537 (+180494us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b5800001298. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:20:45.339976 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.783920 (+443944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.365107 (+581187us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b540044b954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:46.365360 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997567232}
I20260709 13:20:46.367452  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.368142  4142 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:46.370958  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:46.371740  4142 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:46.344664  9625 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:46.379262  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:46.392163  9738 consensus_meta.cc:287] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
I20260709 13:20:46.385670  9716 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.386379  9720 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:46.391894  4142 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:46.498723  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:46.378233  9595 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:46.404130  9672 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:46.373454  9754 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:20:46.393415  9675 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:46.432276  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.446291  4146 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
W20260709 13:20:46.495167  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.500308  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:46.393957  9591 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:46.429757  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 95961.9us
I20260709 13:20:46.393153  9528 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:46.422246  9541 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:46.526768  4142 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
W20260709 13:20:46.544628  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.547312  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:46.550276  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.380695  9625 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.565016  9591 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.518872  9720 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.517802  9672 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:46.547343  9765 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.610289  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2785) took 1020 ms. Trace:
I20260709 13:20:46.612656  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:46.622866  4146 raft_consensus.cc:606] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.623406  4146 raft_consensus.cc:614] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:46.546133  9560 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:46.616777  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 69607.6us
I20260709 13:20:46.626782  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.628254  4142 rpcz_store.cc:276] 0709 13:20:45.590243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.572795 (+982552us) service_pool.cc:224] Handling call
0709 13:20:46.609492 (+ 36697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.609759 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.609801 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.609866 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:46.609919 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.610002 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.610202 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:46.615751  9548 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.636052  9720 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:46.569705  9528 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.571465  9541 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.637777  4295 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:46.620096  9595 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:46.608011  9738 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.679397  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3126) took 1050 ms. Trace:
I20260709 13:20:46.680323  4296 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:46.679865  9738 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.630210  9765 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.683300  9765 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:46.684660  9568 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:46.685146  9568 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:46.679991  4288 rpcz_store.cc:276] 0709 13:20:45.629131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.629619 (+   488us) service_pool.cc:224] Handling call
0709 13:20:45.629946 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.630358 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.630391 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:45.630898 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:20:46.027436 (+396538us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:46.027483 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.027571 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:46.679126 (+651555us) raft_consensus.cc:1685] finished
0709 13:20:46.679156 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.679322 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7283,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":396013,"threads_started":1,"wal-append.queue_time_us":581754}
I20260709 13:20:46.686389  9568 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.687530  9568 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:46.687990  9606 consensus_meta.cc:287] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.000s
I20260709 13:20:46.662024  4142 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:20:46.516537  9716 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.557245  9675 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.668474  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2787) took 1063 ms. Trace:
I20260709 13:20:46.709702  4146 rpcz_store.cc:276] 0709 13:20:45.590885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.652691 (+1061806us) service_pool.cc:224] Handling call
0709 13:20:46.653160 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.653439 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.653500 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.653566 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:46.653628 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.653707 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.653888 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:46.665022  9415 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:46.645998  9560 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.673822  9672 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.675295  9541 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:46.676674  9528 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:46.666137  9760 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:20:46.677973  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:46.689528  9738 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:46.668047  9551 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:46.656961  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:46.692931  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:46.722222  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65396.3us
I20260709 13:20:46.670045  9548 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.711154  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:46.726542  4146 raft_consensus.cc:606] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.726974  4146 raft_consensus.cc:614] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:46.638167  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47710 (request call id 961) took 1368 ms. Trace:
I20260709 13:20:46.728222  9716 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:46.728529  4292 rpcz_store.cc:276] 0709 13:20:45.267622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.273031 (+  5409us) service_pool.cc:224] Handling call
0709 13:20:46.636089 (+1363058us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54000c94d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:46.636305 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160115968}
I20260709 13:20:46.708632  4142 pending_rounds.cc:85] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 9
I20260709 13:20:46.711747  9606 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:46.735618  4142 pending_rounds.cc:107] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:20:46.724718  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:46.735729  4146 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 7. Current term is 8. Ops: []
W20260709 13:20:46.714913  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 115017us
W20260709 13:20:46.741354  9751 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.944s	user 0.007s	sys 0.008s
I20260709 13:20:46.743570  9551 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:46.744853  9591 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:46.746311  4222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:46.747133  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:46.747967  9673 raft_consensus.cc:3055] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:46.748435  9673 raft_consensus.cc:740] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:46.748934  9560 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:46.747182  4222 raft_consensus.cc:606] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.749784  4222 raft_consensus.cc:614] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:46.751345  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:20:46.753898  4294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3115) took 1362 ms. Trace:
I20260709 13:20:46.754128  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2778) took 1166 ms. Trace:
I20260709 13:20:46.754876  4140 rpcz_store.cc:276] 0709 13:20:45.587926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.847061 (+259135us) service_pool.cc:224] Handling call
0709 13:20:46.753351 (+906290us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5800001298. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:20:46.753591 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.753802 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.753826 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.753868 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:46.753902 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.753956 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.754067 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256779648}
I20260709 13:20:46.758229  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.758951  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.759225  4218 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:46.736164  4142 raft_consensus.cc:2889] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:46.760603  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2791) took 1168 ms. Trace:
I20260709 13:20:46.760663  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.761039  4142 rpcz_store.cc:276] 0709 13:20:45.592190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.660989 (+1068799us) service_pool.cc:224] Handling call
0709 13:20:46.661476 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.760073 (+ 98597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.760509 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:46.761509  4216 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:46.762528  4142 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:20:46.764477  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.721488  9541 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:46.754393  4294 rpcz_store.cc:276] 0709 13:20:45.391227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.394769 (+  3542us) service_pool.cc:224] Handling call
0709 13:20:45.395210 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.395630 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.395662 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:45.396187 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:20:45.570034 (+173847us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:45.570092 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.570162 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:46.740666 (+1170504us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:46.753587 (+ 12921us) raft_consensus.cc:1685] finished
0709 13:20:46.753612 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.753830 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2231,"raft.queue_time_us":7646,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":6216,"spinlock_wait_cycles":47337216,"thread_start_us":169658,"threads_started":1,"wal-append.queue_time_us":357267}
I20260709 13:20:46.723903  9595 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:46.795217  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.792807  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.797777  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.800931  4140 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.768061  4112 leader_election.cc:400] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:46.770732  4218 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: [16.7-16.7]
I20260709 13:20:46.797132  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.803687  4218 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:46.771675  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.773367  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:46.768002  4222 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:46.805925  4146 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:46.808812  4187 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.809139  4146 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:46.767004  9560 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.725536  9470 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:20:46.810920  4146 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:46.821839  4146 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:46.793635  9606 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:46.811611  4112 leader_election.cc:403] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:46.826670  4140 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:46.804981  9768 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:46.835801  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67978.4us
I20260709 13:20:46.839241  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.810454  9583 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:46.842319  9567 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:46.812136  9595 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:46.790772  9467 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.850143  4218 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:46.808446  9551 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:20:46.852617  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.841648  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.854324  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.801402  9541 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.840849  9606 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:46.839423  9591 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16.
I20260709 13:20:46.836709  9525 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:46.866639  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.850973  9777 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:46.872241  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.827428  9560 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.888162  4112 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:46.867434  9768 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:46.868608  9415 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:46.899305  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:46.901178  9782 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:46.902963  9748 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.100s	user 0.004s	sys 0.009s
I20260709 13:20:46.906164  9672 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.908869  9595 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:46.909373  9595 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:46.909806  9595 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:46.920552  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.895988  9775 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:46.885012  9525 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:46.893718  9777 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.923063  9777 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:46.923177  9525 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.925319  9548 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:46.884960  9562 consensus_meta.cc:287] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.896s	user 0.012s	sys 0.004s
I20260709 13:20:46.926158  9562 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.928743  9720 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:46.929399  9720 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:46.930397  9720 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:46.930717  9773 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:46.931015  9583 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:46.835443  9673 consensus_queue.cc:260] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.931793  9583 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:46.934073  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2680) took 1145 ms. Trace:
I20260709 13:20:46.876264  9717 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:20:46.934621  4296 rpcz_store.cc:276] 0709 13:20:45.788406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.788600 (+   194us) service_pool.cc:224] Handling call
0709 13:20:46.680081 (+891481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.680835 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.933746 (+252911us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54003543d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:46.933966 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049073920}
I20260709 13:20:46.921808  9467 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:46.921829  9780 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:20:47.000258  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 99344us
I20260709 13:20:46.980882  9673 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:46.990208  9525 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.009958  4187 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:47.012558  9768 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:47.012857  4927 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 17 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:47.013161  9768 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.013793  9768 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.016661  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:46.942116  9737 consensus_queue.cc:1175] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 13 index: 11 } }
I20260709 13:20:47.000540  9675 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:47.008939  9610 raft_consensus.cc:3055] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:47.022828  9610 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:47.024164  9610 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:47.026087  9610 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:47.029306  9560 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.029870  9529 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.019704  9782 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:47.032234  9541 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:47.018658  9606 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.040149  9562 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:47.031253  9583 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:47.053234  9536 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:47.053777  9536 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:47.054829  9536 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:47.056733  9761 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.697s	user 0.008s	sys 0.008s
W20260709 13:20:47.081044  9756 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 1.126s	user 0.000s	sys 0.010s
I20260709 13:20:47.117188  9625 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:47.133628  9770 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.424s	user 0.001s	sys 0.004s
I20260709 13:20:47.132438  9536 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:47.132755  9786 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.096s	user 0.001s	sys 0.003s
I20260709 13:20:47.132148  9704 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:47.119979  9777 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.153681  9589 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:47.191450  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.008028  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:47.194715  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2376) took 1095 ms. Trace:
I20260709 13:20:47.196677  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:47.195381  4142 rpcz_store.cc:276] 0709 13:20:46.100267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.765746 (+665479us) service_pool.cc:224] Handling call
0709 13:20:46.767699 (+  1953us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:46.793957 (+ 26258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.794000 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:46.804579 (+ 10579us) log.cc:844] Serialized 52 byte log entry
0709 13:20:47.006338 (+201759us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:47.006409 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.006529 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:47.193629 (+187100us) raft_consensus.cc:1685] finished
0709 13:20:47.193721 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.194392 (+   671us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":677,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":13319,"thread_start_us":168731,"threads_started":1,"wal-append.queue_time_us":193414}
I20260709 13:20:47.209756  4187 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:47.215353  9471 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:47.219427  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:47.220638  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.223191  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:47.225024  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 326434us
I20260709 13:20:47.225694  9541 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:47.227020  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:47.217139  9562 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.227169  9541 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.225054  9764 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:47.230511  9471 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:47.243675  9720 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:47.245306  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.244712  9720 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.239866  9764 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.237427  9589 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:47.257015  9589 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:47.258874  9589 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.238502  9625 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:47.255893  9672 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:47.256049  9777 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.251107  9528 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.258085  4040 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 16, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 16 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.254153  9677 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:47.244582  9703 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:47.266192  9543 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.270195  9528 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.270529  9543 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.274006  9543 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:47.278101  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:47.297987  9541 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:47.280859  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:47.283474  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:47.300654  4928 raft_consensus.cc:2410] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:47.278339  9528 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.304386  9625 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:47.260293  9764 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.314534  4292 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:20:47.315106  4292 pending_rounds.cc:85] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:47.315387  4292 pending_rounds.cc:107] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:47.315743  4292 raft_consensus.cc:2889] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:47.317087  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.317380  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.318115  4292 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:47.319087  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.296020  9672 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:47.321570  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:47.322038  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.322803  4293 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:47.323501  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:47.321468  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:47.325023  9703 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:47.325655  4291 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:47.325570  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:47.327049  4290 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:47.326704  9703 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.269471  9562 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:47.331580  4294 raft_consensus.cc:2393] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:47.265245  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:47.334338  9541 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:47.335296  9541 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:47.337630  4894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.339654  9560 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.344977  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:47.345875  4147 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:47.345584  9560 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.346606  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2779) took 1758 ms. Trace:
I20260709 13:20:47.347055  4147 rpcz_store.cc:276] 0709 13:20:45.588281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.853205 (+264924us) service_pool.cc:224] Handling call
0709 13:20:47.344995 (+1491790us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5800001298. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:20:47.345460 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.346338 (+   878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.346549 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243103104}
W20260709 13:20:47.347877  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:47.340773  9772 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.645s	user 0.003s	sys 0.001s
I20260709 13:20:47.340873  9548 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:47.349601  9548 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:47.351349  9720 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.352851  9548 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:47.342615  9625 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.353919  9471 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.340931  9568 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:47.356405  9471 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:47.357331  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3127) took 1727 ms. Trace:
I20260709 13:20:47.356998  9568 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.358654  9595 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:47.359896  4139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2771) took 1895 ms (client timeout 1909 ms). Trace:
I20260709 13:20:47.309816  4112 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:47.360394  9568 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.363508  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:47.333472  9672 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:47.335773  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2784) took 1745 ms. Trace:
I20260709 13:20:47.381706  4291 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
W20260709 13:20:47.378432  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 135671us
W20260709 13:20:47.360302  4139 rpcz_store.cc:269] 0709 13:20:45.463916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.504515 (+ 40599us) service_pool.cc:224] Handling call
0709 13:20:47.359402 (+1854887us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540036db54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:47.359673 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779225856}
I20260709 13:20:47.304186  9768 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.394404  9768 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.395709  9595 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.396589  9548 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:47.397240  9548 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.397698  9548 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:47.399047  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.399264  9568 consensus_queue.cc:1059] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:47.400738  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:47.401702  9568 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:47.402383  9568 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:47.404044  9568 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.406061  4290 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:47.406734  9568 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:47.399433  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:47.390017  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 45332.7us
I20260709 13:20:47.374809  4144 rpcz_store.cc:276] 0709 13:20:45.589951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.869506 (+279555us) service_pool.cc:224] Handling call
0709 13:20:47.278668 (+1409162us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b5800001298. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:20:47.279134 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.335052 (+ 55918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:47.335100 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:47.335195 (+    95us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:47.335242 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.335327 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.335530 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30083,"raft.queue_time_us":59196,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":240,"spinlock_wait_cycles":205432064}
I20260709 13:20:47.424753  9545 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:47.425809  9545 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:47.439612  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 187520us
I20260709 13:20:47.440934  4187 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:47.444207  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.444940  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2776) took 1857 ms. Trace:
I20260709 13:20:47.445465  4141 rpcz_store.cc:276] 0709 13:20:45.587334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.588693 (+  1359us) service_pool.cc:224] Handling call
0709 13:20:45.589039 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.880051 (+291012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.386466 (+1506415us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b540022fbd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:47.444714 (+ 58248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666391296}
I20260709 13:20:47.446077  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.447507  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.448467  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.448926  4288 raft_consensus.cc:2410] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:47.450230  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.451653  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.357841  4287 rpcz_store.cc:276] 0709 13:20:45.629461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.632457 (+  2996us) service_pool.cc:224] Handling call
0709 13:20:45.632815 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.638111 (+  5296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.638150 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:45.638748 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:20:45.973087 (+334339us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:45.973150 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.048915 (+1075765us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:47.356514 (+307599us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b5400276fd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:47.356617 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:47.356731 (+   114us) raft_consensus.cc:1685] finished
0709 13:20:47.356755 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.357087 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169,"raft.queue_time_us":1754,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":79005824,"thread_start_us":333860,"threads_started":1,"wal-append.queue_time_us":315303}
I20260709 13:20:47.470533  4927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 783) took 1410 ms. Trace:
I20260709 13:20:47.471084  4927 rpcz_store.cc:276] 0709 13:20:46.059489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.059617 (+   128us) service_pool.cc:224] Handling call
0709 13:20:46.059970 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.013415 (+953445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.469779 (+456364us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54004ec5d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:47.470228 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190871808}
I20260709 13:20:47.453119  9726 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:47.473300  9726 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:47.474480  9669 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:47.475430  9669 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.391250  9777 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:47.477201  9777 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:47.477897  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:47.456523  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.474501  9764 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.481021  9764 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.458132  4145 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:47.458942  9543 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.484982  4219 raft_consensus.cc:1240] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:47.485677  9543 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.463685  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44160 (request call id 3080) took 1470 ms. Trace:
I20260709 13:20:47.458349  4292 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:47.465481  9545 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:47.468704  9541 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:47.478121  9669 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:47.478790  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2117772189999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 13:20:47.541887  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:47.468451  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 69145.7us
I20260709 13:20:47.486248  4293 raft_consensus.cc:2410] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:47.544636  9471 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.486999  4214 rpcz_store.cc:276] 0709 13:20:45.993164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.993338 (+   174us) service_pool.cc:224] Handling call
0709 13:20:47.463089 (+1469751us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000253d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:47.463402 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297074048}
I20260709 13:20:47.545586  9669 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:47.545506  9471 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.546878  9669 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:47.547511  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:47.544157  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:47.545045  4112 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:47.551085  9777 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:47.532011  4290 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:47.502748  9543 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:47.506408  9726 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:47.507021  9768 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:47.517014  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:47.519169  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:47.562036  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:47.525676  9536 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.526412  9589 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.531726  9747 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:47.532202  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.533381  4294 raft_consensus.cc:2410] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:47.534166  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:47.536799  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 96069.1us
I20260709 13:20:47.538149  9766 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:47.467994  9560 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.486258  9703 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:20:47.557279  9669 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:47.559947  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:47.591950  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:47.598750  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:47.601374  9669 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:47.609252  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:47.606889  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:47.611306  4288 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:47.611119  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:47.593676  9471 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.620405  4145 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:47.611768  9766 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:47.638221  4139 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:47.641614  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:47.642249  9467 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:47.643028  9467 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.645695  9562 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.646133  9669 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.648520  9589 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.649026  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:47.649647  4141 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:20:47.651032  9589 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.655055  4218 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:47.639833  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:47.662876  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 76726.9us
W20260709 13:20:47.663699  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 101924us
I20260709 13:20:47.628535  9543 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:47.666687  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:47.639153  4221 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:20:47.630987  9560 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:47.667519  4221 pending_rounds.cc:85] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 10
I20260709 13:20:47.669576  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:47.617895  9536 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:47.676680  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.680737  4221 pending_rounds.cc:107] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:20:47.681106  4221 raft_consensus.cc:2889] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:47.682899  4927 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:47.667919  9543 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:47.686789  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46609.6us
I20260709 13:20:47.690501  4291 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 13.
I20260709 13:20:47.696728  9548 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.699437  9548 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.702932  9536 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:47.705308  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 86256.4us
I20260709 13:20:47.704795  9562 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:47.707552  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:47.708504  9726 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:47.708848  9768 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:47.711460  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3132) took 1944 ms. Trace:
W20260709 13:20:47.715354  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.717736  4147 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:47.703939  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:47.725005  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 165640us
I20260709 13:20:47.688620  9703 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.688864  9543 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:47.729954  9766 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.733716  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:47.735328  9568 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:47.737375  9568 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:47.731710  9541 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:47.745249  9541 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.747545  9541 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:47.755131  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 51433.7us
I20260709 13:20:47.756852  9767 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:47.730273  9747 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:47.766664  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:47.722178  4289 rpcz_store.cc:276] 0709 13:20:45.766604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.766754 (+   150us) service_pool.cc:224] Handling call
0709 13:20:45.767117 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.767616 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.767678 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:45.768306 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:20:47.369399 (+1601093us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b180043eac0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e8820d1 00007fee3ec9da0f
0709 13:20:47.609420 (+240021us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:47.609494 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.609566 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:47.710976 (+101410us) raft_consensus.cc:1685] finished
0709 13:20:47.711001 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.711259 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13696,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":12724,"spinlock_wait_cycles":10560256,"thread_start_us":205680,"threads_started":1,"wal-append.queue_time_us":1869919}
I20260709 13:20:47.778297  4111 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:47.779801  9775 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:47.780680  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.788646  4927 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:47.792202  9775 consensus_queue.cc:1059] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:47.793897  9568 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:47.794428  9568 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:47.796365  4040 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 12, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 12 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:47.795707  9568 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:47.800107  9568 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:47.801011  9703 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:47.803846  9703 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:47.807374  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 3097) took 1051 ms. Trace:
I20260709 13:20:47.807940  4221 rpcz_store.cc:276] 0709 13:20:46.756298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.791529 (+ 35231us) service_pool.cc:224] Handling call
0709 13:20:46.795630 (+  4101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.717905 (+922275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.806970 (+ 89065us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003e4c54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:47.807270 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878992768}
I20260709 13:20:47.819183  4040 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 12, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 12 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.822278  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.823163  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.824414  4219 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:47.824434  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:47.825577  4213 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:47.826722  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.826336  4040 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 13, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 13 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:47.830108  4040 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:47.828006  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.832609  4214 raft_consensus.cc:2410] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:47.834978  9589 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.835685  9589 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:47.837884  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.839246  9589 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:47.846320  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:47.847783  9688 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:47.848258  9688 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.848659  9688 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:47.849514  9467 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:47.850194  9467 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:47.850711  9467 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.748245  9541 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:47.852854  9541 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:47.854187  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:47.854518  9541 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.855116  4925 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
W20260709 13:20:47.857224  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76989us
I20260709 13:20:47.859501  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:47.860406  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:47.869005  4040 catalog_manager.cc:5697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 7, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 7 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:47.874310  9688 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:47.877234  4044 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 178) took 51370 ms (client timeout 15000 ms). Trace:
I20260709 13:20:47.878237  9589 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.884449  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.890218  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:47.909101  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 48818.2us
I20260709 13:20:47.919337  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.912031  9726 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:47.914148  9768 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.931823  9688 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:47.932885  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 225596us
I20260709 13:20:47.933991  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:47.935820  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:47.917203  9703 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.943754  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.929740  9764 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.930135  9726 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:47.964728  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 105361us
I20260709 13:20:47.945562  4213 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:47.974857  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:47.939884  9625 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:47.927637  9589 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.981935  4214 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:47.971172  4040 catalog_manager.cc:5697] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 9, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 9 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.969169  9726 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:47.988521  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:47.966874  9703 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:47.977366  9768 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.005359  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:48.006325  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.006979  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:48.007576  9768 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.008381  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:48.009157  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:47.995299  9764 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.009997  4296 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:48.010505  4147 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:20:48.006364  4214 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:48.011075  4147 pending_rounds.cc:85] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 6
I20260709 13:20:48.011401  4147 pending_rounds.cc:107] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:20:48.011648  4147 raft_consensus.cc:2889] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:48.014369  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:48.015200  4147 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:20:48.016214  9656 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.017130  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:48.016939  9656 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.019590  4214 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:48.019621  9656 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.020689  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:48.020973  4147 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:48.021385  4214 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:20:48.022755  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:48.023396  4145 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:48.026661  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:48.026995  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:48.028720  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.029111  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:48.029754  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:48.030805  4219 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:48.027485  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:48.031795  4145 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.031915  4138 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:48.033094  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:48.034466  9802 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:48.038105  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.042717  4145 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:47.991997  9467 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:48.045523  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:48.047793  4112 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:48.048571  9568 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:48.049407  9568 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:48.051203  9568 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:48.052042  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:48.005379  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:48.054174  4145 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:48.028775  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:48.029908  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:48.056653  4143 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:48.057642  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:48.009171  4289 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.057355  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:48.061242  4145 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:20:48.054270  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.029788  4291 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:20:48.066499  9656 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.067351  9656 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.068387  4218 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 10: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:47.980618  9775 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.069267  4216 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:48.069024  9775 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.070189  9656 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.070847  9656 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:48.071650  9775 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.072018  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:48.075940  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:48.006419  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:48.055568  4222 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:48.079723  4145 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:48.080281  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.012007  9764 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.083323  4219 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:47.909143  4044 rpcz_store.cc:269] 0709 13:19:56.506540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.506811 (+   271us) service_pool.cc:224] Handling call
0709 13:20:47.876876 (+51370065us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:34.908416 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:34.909084 (+   668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:34.909125 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:20:34.909148 (+    23us) tablet.cc:662] Decoding operations
0709 13:20:34.910237 (+  1089us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:34.910327 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:34.910362 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:20:34.911266 (+   904us) tablet.cc:701] Row locks acquired
0709 13:20:34.911288 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:20:34.911580 (+   292us) write_op.cc:270] Start()
0709 13:20:34.911713 (+   133us) write_op.cc:276] Timestamp: P: 1783603234911520 usec, L: 0
0709 13:20:34.911742 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:20:34.932024 (+ 20282us) log.cc:844] Serialized 4004 byte log entry
0709 13:20:36.941603 (+2009579us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3bbd80ac 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b
0709 13:20:38.035067 (+1093464us) op_driver.cc:464] REPLICATION: finished
0709 13:20:38.473826 (+438759us) write_op.cc:301] APPLY: starting
0709 13:20:38.500880 (+ 27054us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:39.201238 (+700358us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b18003745c0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3ea210ec 00007fee3ea23af7 00007fee3ea24fb0 00007fee427391bb 00007fee42739532 00007fee42780b93 00007fee4262dde3 00007fee4262d6ab 00007fee4262ee77
0709 13:20:39.203356 (+  2118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:39.203420 (+    64us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:39.925967 (+722547us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:40.043217 (+117250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:20:40.078584 (+ 35367us) write_op.cc:312] APPLY: finished
0709 13:20:40.175086 (+ 96502us) log.cc:844] Serialized 97 byte log entry
0709 13:20:40.539237 (+364151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:40.553331 (+ 14094us) write_op.cc:454] Released schema lock
0709 13:20:40.553428 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:40.559291 (+  5863us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:40.559344 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":137268,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":347268,"apply.run_cpu_time_us":131471,"apply.run_wall_time_us":2130397,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":230063,"prepare.run_cpu_time_us":64875,"prepare.run_wall_time_us":2281385,"raft.queue_time_us":633366,"raft.run_cpu_time_us":22642,"raft.run_wall_time_us":304956,"replication_time_us":3086502,"spinlock_wait_cycles":156529792,"thread_start_us":3260165,"threads_started":5,"wal-append.queue_time_us":2675526,"wal-append.run_cpu_time_us":228355,"wal-append.run_wall_time_us":3210637}]]}
I20260709 13:20:48.039747  9543 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:48.094256  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46530.5us
I20260709 13:20:48.097218  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:48.051930  9568 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.092571  4040 catalog_manager.cc:5697] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.113272  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:48.117045  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.112093  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.100593  9625 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:48.000775  9669 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:48.122081  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:48.105216  9768 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:48.135505  4187 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:48.132249  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 196592us
I20260709 13:20:48.141927  9767 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:48.142529  9767 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:48.142999  9767 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:48.135424  9768 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.144287  9768 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:48.145527  4186 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.67:40585 timed out after 1.753s (SENT) [suppressed 31 similar messages]
I20260709 13:20:48.152933  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.154515  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.155566  4293 raft_consensus.cc:2410] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:20:48.157961  9568 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.160741  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:48.161554  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:48.143989  4145 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
I20260709 13:20:48.165437  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.169203  4289 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:48.170814  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:48.172803  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50815.7us
I20260709 13:20:48.166561  4293 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:20:48.174594  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:48.180761  4040 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 11 to 14, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 14 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:48.182294  4296 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 14.
I20260709 13:20:48.132884  9625 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.189625  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:48.210446  4294 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:48.182813  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:48.212646  4040 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.214893  4112 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:48.208509  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:48.222448  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:48.226502  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 89883.6us
I20260709 13:20:48.227885  4187 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:48.230860  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.190548  9548 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:48.239920  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57219.9us
I20260709 13:20:48.183969  9536 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:48.203552  9625 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:48.251650  9803 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.252247  9803 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.237499  4187 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:48.250993  9802 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:48.203758  9568 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.269284  4289 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:48.271274  9610 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.272045  9610 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:48.272738  9548 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:48.273298  9548 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:48.274386  9548 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.267378  4040 catalog_manager.cc:5697] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 10, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:48.276790  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:48.254854  9775 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:48.247279  9703 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:48.300907  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 187095us
I20260709 13:20:48.309887  4259 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:48.298031  9656 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:48.319339  9656 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:48.320689  9656 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.316887  9541 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:48.324584  9568 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:48.312544  9764 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:48.313205  9536 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.325047  9606 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:48.332894  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 77545.6us
I20260709 13:20:48.300562  9775 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:48.352689  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 53773.3us
W20260709 13:20:48.356302  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 215920us
I20260709 13:20:48.344169  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:48.376648  9703 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:48.380270  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.363025  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:48.380270  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.367769  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:48.357573  4213 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
W20260709 13:20:48.357241  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 142414us
I20260709 13:20:48.383210  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.329083  9204 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:48.353672  4040 catalog_manager.cc:5697] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:48.327647  9568 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:48.392227  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.394158  4290 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:48.360677  9775 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:48.329253  9737 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:48.399544  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.409852  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.411134  4291 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:20:48.366725  9543 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:48.370743  9654 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:48.417882  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:48.434965  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 245452us
I20260709 13:20:48.328279  9764 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:48.369900  9541 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:48.425676  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:48.426599  9810 raft_consensus.cc:2764] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:20:48.329170  9704 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:20:48.399892  9204 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.432690  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.463837  4925 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 8.
I20260709 13:20:48.440653  4290 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:48.469412  4290 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:48.332221  9726 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:48.421051  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.434006  9737 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:48.443845  9536 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:48.449016  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 211606us
I20260709 13:20:48.483273  4296 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:48.487295  4187 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:48.433764  9568 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.498536  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:48.475170  9204 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.503726  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:48.510906  4295 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:48.481645  9467 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:48.516377  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.496934  9606 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:48.517745  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.522607  4040 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 9, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 9 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:48.528861  4290 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.497180  9768 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.555428  4040 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:48.559520  9813 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:20:48.528005  9606 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.498364  9625 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.525772  9669 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:48.562708  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.519433  9802 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:48.573417  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 197280us
W20260709 13:20:48.601492  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 124533us
I20260709 13:20:48.602377  4290 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:48.602933  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:48.609428  9816 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:48.513656  9568 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:48.619015  9820 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:20:48.619741  9815 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:20:48.563772  9467 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:48.623720  9467 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:48.558435  9656 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:48.631551  4296 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:48.599004  4040 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 9, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 9 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.567437  9606 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.650866  4295 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
W20260709 13:20:48.618872  9812 log.cc:927] Time spent T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:20:48.653271  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:48.618921  9821 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:20:48.654088  4925 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:48.666814  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:48.658654  9669 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.668843  9802 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.670724  9669 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:48.673085  4040 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.630971  9656 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.679924  4259 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:48.677045  9803 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:48.694670  4290 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:20:48.695214  4290 pending_rounds.cc:85] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:48.695600  4290 pending_rounds.cc:107] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:48.695989  4290 raft_consensus.cc:2889] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:48.698463  4296 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:48.703274  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:48.704053  4925 raft_consensus.cc:2393] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 11: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:48.693248  4040 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 11, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 11 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.677160  9764 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:48.601538  9541 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.693605  9656 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:48.698475  9808 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:48.837006  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 170301us
I20260709 13:20:48.842314  4186 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:48.832906  4040 catalog_manager.cc:5697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:48.826116  9764 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:48.841527  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:48.819718  9808 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:48.844990  4147 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.038s	sys 0.093s
W20260709 13:20:48.860571  4147 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.041s	sys 0.093s
I20260709 13:20:48.862089  4919 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:48.831796  9726 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:48.866541  4261 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:48.870749  9767 consensus_meta.cc:287] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.007s
I20260709 13:20:48.880002  4040 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:48.867304  9808 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:48.888394  4040 catalog_manager.cc:5697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 15, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.892638  9849 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:48.893893  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59879.2us
I20260709 13:20:48.893539  9849 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.894826  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:48.895720  9467 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:48.895825  9737 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.893551  9568 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.898641  9858 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:48.879773  9768 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.903105  9610 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.908980  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:48.909098  9841 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:20:48.910284  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.910979  4296 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 7.
I20260709 13:20:48.915246  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.916498  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.917044  4291 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 7.
W20260709 13:20:48.917292  9834 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:20:48.918058  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:48.923024  9856 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.002s
W20260709 13:20:48.924206  9830 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:20:48.892861  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50729.6us
I20260709 13:20:48.891232  9625 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.955611  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:48.936870  9726 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:48.944447  9817 log.cc:927] Time spent T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:20:48.949553  9836 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:20:48.957275  4040 catalog_manager.cc:5697] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 3 to 8, term changed from 7 to 12, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 12 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:48.890182  9767 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.929957  4892 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:48.882433  9669 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:48.976117  9839 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.976943  9839 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.977648  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:48.979598  9842 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:48.979900  9839 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.965835  9726 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:48.987334  9726 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.967407  9589 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.968554  9545 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:48.988777  9545 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.988966  9849 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.989318  9545 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.974699  9767 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:48.980134  9842 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.003964  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.004419  9842 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:48.982357  4110 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:48.984037  9548 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.958650  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:49.050668  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:49.036187  4112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.022s	sys 0.012s
I20260709 13:20:48.979645  4040 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 10, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:20:49.074940  4112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.024s	sys 0.015s
W20260709 13:20:49.075480  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 691512us
W20260709 13:20:49.082705  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 100471us
W20260709 13:20:49.082929  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.084137  4040 catalog_manager.cc:5697] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 4 to 5, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 5 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:49.076210  4919 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:49.089756  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:20:49.093263  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 134658us
I20260709 13:20:49.081240  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:49.097461  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 79596.6us
I20260709 13:20:49.101404  9625 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:49.080366  9548 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.101910  9625 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.102392  9625 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:49.103694  9548 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.098237  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.106424  4287 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
W20260709 13:20:49.109720  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 44891.4us
I20260709 13:20:49.112596  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.097406  9767 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.122448  9767 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.089294  9589 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:49.099715  9849 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:49.178850  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.180899  9767 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.181130  9855 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:49.181998  9844 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:20:49.183876  9837 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:20:49.180852  9621 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:49.188679  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 107520us
W20260709 13:20:49.198602  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 71733.4us
I20260709 13:20:49.200517  4185 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:49.201834  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.205565  9831 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:49.200254  9654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.032s
I20260709 13:20:49.163030  9764 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.209820  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:49.210896  4145 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:49.212188  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:49.214470  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:49.201517  9853 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.219452  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:49.220623  4112 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:49.221086  4145 raft_consensus.cc:2410] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:20:49.223424  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:49.228471  9855 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:49.236886  4143 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:49.230517  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:49.238754  4141 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:49.206156  9568 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.201753  9548 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:49.229651  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:49.240797  4138 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:49.185691  9545 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:49.213802  9654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.013s	sys 0.032s
W20260709 13:20:49.250135  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.206326  9849 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.261723  4296 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:49.262107  4296 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:49.263605  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:49.264161  4291 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:49.267469  4142 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:49.243784  9767 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:49.252004  9837 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:20:49.256860  9822 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:49.257266  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:49.254822  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46355.3us
I20260709 13:20:49.242398  9548 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.210738  9589 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.281716  4295 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:49.282270  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:49.227522  9764 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.262768  4296 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.251791  9654 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:49.249142  9855 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:49.268957  9775 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.820s	user 0.014s	sys 0.001s
I20260709 13:20:49.287297  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.254102  9859 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:49.254658  9848 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.294715  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.281935  9548 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:49.214865  9831 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.296511  4292 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:49.270576  9767 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.244725  9568 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.281387  9560 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:49.288604  9703 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.283674  9835 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:20:49.309900  4295 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
W20260709 13:20:49.347137  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 120123us
W20260709 13:20:49.340282  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 91719us
I20260709 13:20:49.359179  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.360140  4292 raft_consensus.cc:2410] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:20:49.304605  9669 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:20:49.365674  4141 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:49.367509  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.368134  4287 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:49.342247  9560 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.370004  9560 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:49.356943  9703 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.375103  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:49.378492  9560 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.336642  9767 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:49.246851  9853 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:49.396965  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 112397us
W20260709 13:20:49.372159  9606 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.000s
I20260709 13:20:49.291275  9656 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.408562  9560 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:49.409451  9864 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:20:49.342123  9848 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:49.411262  4296 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:49.411789  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 125044us
I20260709 13:20:49.306280  9775 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.434851  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2815) took 1395 ms. Trace:
I20260709 13:20:49.435302  4146 rpcz_store.cc:276] 0709 13:20:48.040217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.040698 (+   481us) service_pool.cc:224] Handling call
0709 13:20:48.041190 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:48.041853 (+   663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:48.041885 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:48.678625 (+636740us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b2c00000c88. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:48.707341 (+ 28716us) log.cc:844] Serialized 26 byte log entry
0709 13:20:49.214079 (+506738us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:49.214262 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:49.214323 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:49.411172 (+196849us) raft_consensus.cc:1685] finished
0709 13:20:49.411189 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:49.434652 (+ 23463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70,"raft.queue_time_us":706,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":183,"spinlock_wait_cycles":86260992,"thread_start_us":382872,"threads_started":1,"wal-append.queue_time_us":503152}
W20260709 13:20:49.436486  9204 consensus_meta.cc:287] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.004s
I20260709 13:20:49.437191  9204 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.439884  9204 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.356810  9803 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:49.440678  9803 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.443069  9803 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:49.443493  9764 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.445324  9849 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.446604  9831 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.447388  9853 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.454011  9568 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:49.455710  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 49724.5us
I20260709 13:20:49.462558  4296 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:20:49.463738  4296 pending_rounds.cc:85] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 9
I20260709 13:20:49.475569  4291 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:20:49.479871  4296 pending_rounds.cc:107] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:20:49.481279  4296 raft_consensus.cc:2889] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:49.481848  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:49.484853  4919 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:49.408670  9589 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.489306  4144 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
W20260709 13:20:49.489773  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 89289.1us
I20260709 13:20:49.495116  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.502194  9849 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.503007  9849 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:49.412395  9606 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.482170  9859 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:49.513945  9859 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.483403  9848 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:49.376310  9855 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:49.538498  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:49.539969  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 327283us
I20260709 13:20:49.546830  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:49.551358  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.553133  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.554288  4291 raft_consensus.cc:2410] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 18 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:20:49.555997  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:49.561019  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.561347  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.562055  4213 raft_consensus.cc:2393] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:49.561851  4222 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:49.488236  9764 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:49.565893  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:49.572309  4222 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:49.566149  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.573081  4213 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:49.568598  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.567484  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:49.569084  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.528893  9568 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:49.575119  4295 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:49.576037  4220 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:49.574219  4287 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:49.542912  9848 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:49.577697  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.577970  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.570729  4186 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:49.582062  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.583217  4219 raft_consensus.cc:2393] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:49.581959  4218 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:49.564775  9768 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:49.591373  9838 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:49.592482  9842 consensus_meta.cc:287] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.584s	user 0.014s	sys 0.000s
I20260709 13:20:49.592407  9838 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.593043  9842 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:49.575203  9589 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:49.589032  4216 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:49.454890  9654 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:49.597539  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.584990  9560 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:49.598568  9560 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:49.581238  9808 consensus_meta.cc:287] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.004s
I20260709 13:20:49.604794  9839 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:49.559216  9536 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:20:49.604857  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:49.620782  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64938.7us
I20260709 13:20:49.623965  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:49.624924  4220 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:49.613191  4186 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:49.575186  9704 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:20:49.575413  9831 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:20:49.634920  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 65359.3us
I20260709 13:20:49.592437  9835 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:49.652976  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.653913  4216 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 10.
I20260709 13:20:49.591389  9768 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.589177  9764 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.663133  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:49.665660  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:49.669523  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.670058  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:49.672109  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:49.612421  9848 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:49.680446  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.636512  9844 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:20:49.634155  9839 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.679659  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:49.613909  9808 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:49.686442  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 81675.6us
I20260709 13:20:49.671581  9822 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:49.680884  9589 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:49.699644  9874 raft_consensus.cc:2764] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:49.686053  9853 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:49.704869  4290 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:49.699761  9875 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:49.696969  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.687755  9560 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:49.719090  4222 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:49.699975  9872 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:49.711254  9870 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:49.717751  4215 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:49.695350  9822 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.683444  9568 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:49.698383  9775 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.705717  9589 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.670363  9835 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.731003  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:49.740764  9625 consensus_meta.cc:287] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.003s
I20260709 13:20:49.718714  9826 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:49.700209  9868 consensus_queue.cc:1059] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:20:49.745949  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.757629  9768 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.759500  9826 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.760080  9826 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:49.721311  9872 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.761644  9872 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:49.766064  9848 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:49.729262  9870 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.772651  9870 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:49.774087  9536 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:49.774890  9536 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:49.747689  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:49.750666  9767 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.753213  9849 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:49.754346  9775 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:49.755360  9862 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.393s	user 0.004s	sys 0.004s
I20260709 13:20:49.731611  9568 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.730350  9822 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:49.735666  9589 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:49.806583  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 61120.6us
I20260709 13:20:49.829682  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.833297  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:49.834199  4296 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 9.
I20260709 13:20:49.838867  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:49.846959  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:49.849190  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.849341  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.852953  4217 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 18: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:49.853658  4215 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:49.853916  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.855309  4112 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:49.856465  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:49.810868  9536 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:49.863022  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:49.823422  9568 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:49.822540  9853 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:49.865123  4290 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:49.787657  9625 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:49.848161  9766 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:49.876916  9560 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:20:49.896497  9766 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.896960  9766 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:49.876765  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145833us
W20260709 13:20:49.901719  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 181206us
I20260709 13:20:49.798106  9548 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.906587  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:49.875216  9868 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:49.801276  9872 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.912686  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:49.915761  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:49.871771  9853 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:49.874033  9536 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:49.872901  9839 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.910344  9868 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:49.924882  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:49.926116  9873 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:20:49.936852  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 61996.3us
I20260709 13:20:49.948432  4220 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:49.951211  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:49.953693  4919 raft_consensus.cc:2368] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:20:49.953683  4186 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:49.951576  9867 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:20:49.963963  9548 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.965206  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.966015  9548 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:49.966081  9855 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:49.966807  9855 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:49.967185  9855 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:49.969551  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.969667  9606 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.971139  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.976368  9548 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:49.978000  9548 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:49.980552  9536 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:49.977058  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:49.982060  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.981977  9536 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:49.980791  9548 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:49.984668  9548 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:49.985064  9548 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:49.985157  9835 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.985500  9548 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:49.985729  9625 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:49.985962  9835 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:49.957719  9764 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:49.988555  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:49.874209  9826 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:49.991310  9839 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:49.991601  9826 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:49.952684  9808 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:49.948534  9875 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:49.990329  4111 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.994800  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:49.995765  9802 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:49.989194  9767 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.002909  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:49.952404  9868 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:50.009372  4259 leader_election.cc:400] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:20:50.011942  4259 leader_election.cc:403] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:20:50.012542  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 57751.8us
I20260709 13:20:49.950745  9848 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.018566  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.019341  4295 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:50.009829  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 97216.2us
I20260709 13:20:50.003587  9839 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:50.002357  9875 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:50.026208  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.028276  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.010502  9867 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:50.030539  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:50.006193  9625 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:20:50.006531  9826 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:20:50.003332  9855 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.043545  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:50.013046  9874 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
W20260709 13:20:50.046545  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43714.3us
I20260709 13:20:50.023524  9835 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:20:50.063285  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.012328  9870 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:50.045614  9877 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.312s	user 0.000s	sys 0.002s
I20260709 13:20:50.078828  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:50.024896  9848 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.079721  4925 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 9: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:50.062673  9839 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:50.086035  4111 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:50.089778  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 59437.1us
I20260709 13:20:50.087458  4295 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:50.094022  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:50.042672  9808 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:50.098680  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.090950  9888 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.106698  4216 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:50.118602  9560 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.120316  9802 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:50.120730  9802 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:50.095898  9889 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:50.121605  9802 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.096176  9766 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.123208  9802 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:50.125206  9766 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.105976  9895 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:50.127427  9895 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.128006  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:50.128790  4925 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:50.129731  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:50.130179  9895 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.137244  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.137818  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.138131  9589 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.138870  4218 raft_consensus.cc:2393] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:50.067086  9568 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.146549  9568 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.146920  9872 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:50.147131  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.149242  9808 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:50.149847  9808 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:50.150775  9808 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.138008  4214 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:50.156633  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:50.135375  4112 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:50.161338  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.162922  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.164309  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.164372  4295 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:20:50.165081  4213 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:50.166090  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.166496  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.167230  4290 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:50.169274  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.170495  4217 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:50.172243  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.173072  4288 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:50.172240  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.177059  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.180878  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.152143  9589 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.183873  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.187294  4218 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:50.187834  9831 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:20:50.188925  4287 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:50.190148  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.190791  4287 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:20:50.195343  9853 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.200989  4214 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:50.187319  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.146554  9870 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.196906  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.205615  4216 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:50.207170  4221 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:50.206918  4187 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.206830  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:50.211006  9568 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:50.211669  9568 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:50.213899  9568 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:50.213928  9766 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:50.214923  9822 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.170272  9895 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:50.217140  9822 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.217806  9895 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.218999  9895 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.176119  9803 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.220969  9803 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.221298  9842 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.221727  9855 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.208130  9869 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:50.223027  9803 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:20:50.224777  9703 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.225471  9848 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.216151  9766 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:50.226596  9766 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:50.157447  9548 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.227821  9766 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.228895  9548 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.229527  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.229689  9656 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.233673  4216 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:20:50.242576  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:50.249943  4217 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:50.253969  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.243059  4213 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:50.243191  4925 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
W20260709 13:20:50.257118  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50304.6us
I20260709 13:20:50.246481  4222 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:50.241133  4288 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:50.268790  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.269436  4290 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:20:50.270830  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 170349us
I20260709 13:20:50.271585  4110 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:50.273092  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.274389  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:50.280840  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:50.286240  4143 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 9: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:50.282119  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.250747  9822 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.286733  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:50.287734  4145 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.289572  4147 raft_consensus.cc:2410] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:50.293789  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.294689  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.257560  9803 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:50.259123  9849 raft_consensus.cc:2764] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:20:50.280493  9837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.004s	sys 0.028s
I20260709 13:20:50.266136  9893 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:50.307570  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.308646  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.308713  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.309801  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:50.311776  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.321604  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.322501  4293 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:50.323415  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.324327  4292 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:50.327423  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.317350  4294 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:50.319736  4144 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:50.319633  4142 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:50.328295  4138 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:50.301419  9835 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.338990  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:50.338836  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.302683  9204 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:50.357976  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:50.335166  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:20:50.363795  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 121295us
I20260709 13:20:50.366613  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:50.366747  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.287382  9548 consensus_queue.cc:1059] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:20:50.316833  9837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.004s	sys 0.029s
I20260709 13:20:50.371018  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:50.373778  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 53637.9us
I20260709 13:20:50.375006  4144 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:50.375316  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:50.332428  9848 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:50.315049  9898 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:50.371968  9891 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:20:50.373011  9878 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.066s	user 0.004s	sys 0.000s
I20260709 13:20:50.389333  9890 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.389685  9589 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:50.390650  9901 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:50.393440  9839 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:50.383284  9872 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:50.431496  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.431957  9872 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.433351  9872 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.435285  9868 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.437814  9868 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.395753  9859 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.396104  9669 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:50.396679  9875 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:50.397069  9898 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.397805  4147 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:50.397590  9848 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.315418  9822 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.400418  9900 raft_consensus.cc:3055] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:50.401654  9853 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.379534  4290 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:50.411731  4294 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:50.422114  4293 raft_consensus.cc:2410] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:20:50.429004  9893 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:50.430637  9589 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.439764  4145 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:50.442301  4140 raft_consensus.cc:2410] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:20:50.442934  4287 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 9.
I20260709 13:20:50.451514  9888 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.464884  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.447782  9545 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.426301  9890 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.473517  9898 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.456506  9900 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.460158  9775 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:50.478690  9775 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.479214  9900 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.479646  9775 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.477358  9848 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:50.477371  9589 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.474239  9822 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.485469  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:50.485693  9909 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:20:50.486846  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 120342us
I20260709 13:20:50.487370  9874 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:50.487807  9808 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.488811  4185 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:50.480497  9900 raft_consensus.cc:3060] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:50.495594  4144 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:20:50.496615  9545 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:50.493075  9775 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.497936  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.499294  9808 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:50.500149  9838 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.503305  9808 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:50.504235  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.505198  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.505312  4216 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:50.505666  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.506337  4222 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:20:50.507196  9548 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:50.508267  9560 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:50.508693  9560 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.509578  9560 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.510828  9560 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:50.511523  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.512077  4221 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:50.512514  4218 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:50.494675  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:50.513967  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:50.515100  9874 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:50.515913  9874 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.516554  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:50.516732  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.517442  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:50.517750  9895 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:50.518242  4112 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:50.518445  9895 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:50.518998  9839 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:50.519416  9839 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.519827  9839 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:50.514941  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.527343  4220 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:50.534078  4146 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:50.534914  4221 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:50.536399  9803 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:50.527452  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:50.549005  9560 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.549726  9560 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:50.551666  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:50.552489  9560 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:50.552744  4145 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:50.554976  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.555639  9543 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:50.542621  4112 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:50.557586  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:50.556079  4140 raft_consensus.cc:2393] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:50.561393  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:50.566519  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:50.569766  4144 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:50.578902  4919 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:50.572877  9808 raft_consensus.cc:2764] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:20:50.556082  9543 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:50.584112  9543 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.585179  9543 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:50.586565  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59233.8us
I20260709 13:20:50.586805  4295 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:20:50.591480  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:50.591785  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.592088  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.594676  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.571393  9560 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:50.608510  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.604961  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.607415  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.618299  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.619441  4220 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:20:50.618322  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.620654  4221 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:50.624673  4144 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:50.622450  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:50.629040  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:50.631233  4139 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.636608  4215 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:50.637636  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:50.640048  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.641148  4220 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:50.629173  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.656881  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:50.662685  9904 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:20:50.681461  9890 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:50.682962  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.630486  9803 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.633476  9560 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.570036  9893 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.647119  9872 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:50.627388  9768 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:20:50.705785  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:50.707471  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 103927us
I20260709 13:20:50.708268  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:50.717238  4213 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:50.717849  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 132202us
I20260709 13:20:50.719175  4139 raft_consensus.cc:2410] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:50.654503  9839 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.706586  9872 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:50.695436  9803 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.727769  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.726491  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:50.725708  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.729717  4216 raft_consensus.cc:2368] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 16. Current term is 17.
W20260709 13:20:50.722930  9913 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
W20260709 13:20:50.766688  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.730154  4213 raft_consensus.cc:2368] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:20:50.794183  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:50.728704  9842 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:20:50.804383  9802 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:50.805162  9802 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.814203  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.815006  4287 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:50.819689  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.820591  4287 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.820962  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.821853  4290 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:50.822947  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.823653  4292 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:50.831709  4287 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 21.
I20260709 13:20:50.807408  9802 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:50.848582  4296 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:50.855623  4292 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
W20260709 13:20:50.863430  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 133238us
I20260709 13:20:50.875062  4288 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:20:50.875365  4186 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:50.879182  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.879721  4294 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:50.881322  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.888758  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.888652  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.889640  4293 raft_consensus.cc:1240] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:50.879666  4186 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:50.878849  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.891695  4288 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:50.892521  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.895386  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.895618  4186 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:50.896684  4292 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 20. Current term is 21. Ops: [18.10-20.11]
I20260709 13:20:50.898061  4289 raft_consensus.cc:2393] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:50.898532  4216 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:50.899859  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.904109  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.904981  4292 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:50.906117  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.916013  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.906828  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.917380  4141 raft_consensus.cc:2393] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 13: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:50.907924  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.911906  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:50.912581  9871 raft_consensus.cc:2804] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:50.913622  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.919373  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.927855  4294 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:20:50.929082  4216 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:50.780947  9560 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:50.899915  9868 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.904919  9545 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:50.938980  4288 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:20:50.935395  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:50.903805  9858 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:50.937868  4186 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:50.898083  9898 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:50.943734  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.944041  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.944330  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:50.948576  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53874.6us
I20260709 13:20:50.954402  4141 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:50.950831  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:50.955618  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:50.957643  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:50.960793  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:50.938684  9764 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:50.941651  9871 raft_consensus.cc:697] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:50.971665  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.943656  9888 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:50.946410  9545 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:50.951846  9858 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:50.977255  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:50.974728  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.993420  4139 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:50.919941  9568 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:50.989121  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:50.959332  9726 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:50.994637  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:50.971025  9922 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:20:50.996268  4216 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:50.967846  9822 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:51.009128  4213 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:51.011044  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:51.012981  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.969476  9764 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:50.914433  9872 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.013970  4142 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 20.
I20260709 13:20:50.979831  9870 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:51.035097  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:50.982017  9545 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:50.981462  9536 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:51.042621  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:51.040571  4186 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:51.007710  9903 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:51.046327  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84558.9us
I20260709 13:20:51.048678  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:51.001994  9726 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:51.141120  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.044593  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:51.018332  9875 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:51.007544  9803 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:51.026970  9764 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:51.097081  9931 log.cc:927] Time spent T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:20:51.098621  9933 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:51.106295  4219 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:51.109884  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:51.111461  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:20:51.113494  9926 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:20:51.037453  9822 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:51.126549  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:51.165710  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.128445  4218 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:20:51.054693  9870 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:51.053233  9768 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:51.042933  9831 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:20:51.156006  4289 raft_consensus.cc:2410] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:51.162616  4221 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:51.174119  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:51.168624  4140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.003s	sys 0.042s
I20260709 13:20:51.171640  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:51.178169  4140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.003s	sys 0.042s
I20260709 13:20:51.180188  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:51.141119  9726 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.191859  4143 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 11.
I20260709 13:20:51.194538  4142 raft_consensus.cc:2368] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:20:51.149411  9875 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:51.204046  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:51.205161  4142 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:20:51.206879  4142 raft_consensus.cc:1240] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.222577  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:51.228457  4221 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:51.203552  9875 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:51.234292  4142 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:51.135061  9871 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.237349  4142 raft_consensus.cc:1240] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:51.203739  9768 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:51.221931  9775 consensus_meta.cc:287] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.724s	user 0.014s	sys 0.000s
I20260709 13:20:51.256775  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.261407  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.265626  4143 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:51.269021  4147 raft_consensus.cc:2410] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:51.272496  9822 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:51.180684  9858 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.283479  4142 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.253949  9937 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:51.302141  9775 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:20:51.302570  9935 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:20:51.281716  9831 raft_consensus.cc:2764] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:51.302989  9536 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:51.301061  4112 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:51.268056  9886 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.327725  4142 raft_consensus.cc:1240] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:51.303261  9928 log.cc:927] Time spent T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:20:51.341238  4140 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.350303  4142 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:51.331005  9625 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:51.359045  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 58207.8us
W20260709 13:20:51.361852  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 93280.5us
I20260709 13:20:51.363468  4187 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.372558  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.375845  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.287614  9870 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:51.374714  9900 consensus_meta.cc:287] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.842s	user 0.016s	sys 0.000s
I20260709 13:20:51.367827  9831 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.383459  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.376003  9849 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:51.391013  4138 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:51.379680  9944 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:51.373908  9886 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:20:51.378021  9656 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:51.377565  9952 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:51.400583  9543 consensus_meta.cc:287] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.008s
I20260709 13:20:51.394953  9831 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.359864  9768 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.410087  9656 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:51.421777  9942 log.cc:927] Time spent T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:51.429823  4290 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:51.421783  9952 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:51.438997  9952 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.439144  9656 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:51.443758  9927 log.cc:927] Time spent T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.536s	user 0.002s	sys 0.000s
I20260709 13:20:51.409232  9843 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:51.444909  9843 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:51.446691  9888 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:51.447611  9843 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:51.411743  9944 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:51.448747  4143 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:51.444954  9946 log.cc:927] Time spent T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:20:51.468281  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84909.7us
I20260709 13:20:51.453073  9543 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:51.474257  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.482511  4187 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.495252  9960 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:51.487586  9939 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:20:51.498906  9831 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:51.501691  9955 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:20:51.503988  9726 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.528728  9726 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:51.479182  9543 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.481213  9957 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:51.532485  9543 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:51.533885  4215 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.536156  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:51.540556  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:51.541535  4295 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:51.545416  9960 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:51.497370  9849 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:51.558161  4290 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:51.559156  9875 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:51.560393  9545 consensus_meta.cc:287] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.508s	user 0.015s	sys 0.000s
I20260709 13:20:51.569916  9875 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:51.571833  9545 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.574854  9545 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:51.575954  4221 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:51.577915  9764 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.580570  4222 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:51.580075  4138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2849) took 1087 ms. Trace:
I20260709 13:20:51.589504  4138 rpcz_store.cc:276] 0709 13:20:50.492408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.493852 (+  1444us) service_pool.cc:224] Handling call
0709 13:20:51.579856 (+1086004us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540017fa54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:51.580004 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052078976}
I20260709 13:20:51.613463  4295 raft_consensus.cc:2410] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:51.599108  9764 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:51.616587  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:51.617961  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 135562us
I20260709 13:20:51.584790  9960 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.626832  4295 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:51.624835  9768 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.633868  4295 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:51.634285  9768 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.634873  4295 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.636971  9768 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:51.600255  9888 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:20:51.655108  9888 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:51.655592  9888 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:51.656440  9849 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.657437  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:51.676059  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:51.682016  9875 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:51.683660  9875 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:51.689007  9888 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:51.690474  9932 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.552s	user 0.002s	sys 0.000s
I20260709 13:20:51.690691  9875 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:51.695937  4221 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:20:51.699625  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.725212  4919 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:51.727391  9839 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:51.727676  9625 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:51.711026  9568 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:20:51.729657  9839 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:51.730278  9839 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:51.743374  9920 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.969s	user 0.003s	sys 0.000s
I20260709 13:20:51.753820  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:51.763525  9568 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:51.764396  9568 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:51.766248  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:51.767827  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:51.769944  4222 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.771232  9888 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:51.775899  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:51.781734  4213 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.787854  9543 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:51.792886  9951 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:51.793608  9543 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.789727  9895 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:51.796020  9895 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:51.793761  9951 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:51.798519  9543 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:51.798870  9951 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:51.799010  9895 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:51.805473  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:51.806393  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:51.779541  9568 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:51.708732  9868 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:20:51.810346  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:51.811329  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:51.815686  9669 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.816327  9669 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.822131  9669 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:51.738888  9625 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.813972  9875 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.827049  9951 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:51.830013  9875 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.830852  9951 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:51.831256  9951 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:51.832736  9875 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:51.832492  9625 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.835381  9625 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:51.838919  9839 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:51.840749  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:51.849737  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75464.4us
I20260709 13:20:51.852640  9951 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.829492  9568 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:51.854511  4289 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:51.867187  4294 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:20:51.870025  4294 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:20:51.870147  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61092.1us
I20260709 13:20:51.872287  9875 raft_consensus.cc:2764] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:51.872869  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:51.878914  9951 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.892202  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:51.893368  4292 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:51.894738  4261 leader_election.cc:400] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 16. Current term is 17.
I20260709 13:20:51.905120  4261 leader_election.cc:403] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:51.915223  4111 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.915194  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:51.920179  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:51.903414  9953 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.921660  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:51.921725  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:51.894625  9839 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:51.931458  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 103865us
I20260709 13:20:51.934834  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.938599  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:51.940725  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:51.945391  9938 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.713s	user 0.002s	sys 0.002s
I20260709 13:20:51.945942  9895 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:51.916152  9548 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.947949  9548 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.950724  9548 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:51.912581  9943 consensus_queue.cc:1059] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:20:51.952276  9943 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.953225  9943 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.955847  9947 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:51.955817  9839 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:51.956748  9947 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:51.957988  9953 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.959201  9947 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:51.960590  9543 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 16. Current term is 17.
I20260709 13:20:51.961136  9839 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:51.961722  9543 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:51.962214  9543 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:51.963270  9543 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.965112  9625 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.965725  9625 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:51.906862  9568 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:51.960446  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:51.969079  4141 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:51.929085  9868 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:51.902065  9875 consensus_queue.cc:1059] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:20:51.977342  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2748) took 1109 ms. Trace:
W20260709 13:20:51.979916  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 85282.3us
I20260709 13:20:51.982164  4261 leader_election.cc:400] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:20:51.982837  4261 leader_election.cc:403] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:51.978189  4287 rpcz_store.cc:276] 0709 13:20:50.867659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.868045 (+   386us) service_pool.cc:224] Handling call
0709 13:20:50.896669 (+ 28624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:50.897022 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:50.922661 (+ 25639us) log.cc:844] Serialized 14 byte log entry
0709 13:20:51.132239 (+209578us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:51.132717 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:20:51.132837 (+   120us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:51.132868 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.132928 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:51.856487 (+723559us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:51.968573 (+112086us) raft_consensus.cc:1685] finished
0709 13:20:51.977049 (+  8476us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:51.977254 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17413,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":2021,"raft.queue_time_us":88458,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":21000,"spinlock_wait_cycles":7281920,"thread_start_us":164323,"threads_started":2,"wal-append.queue_time_us":232747}
I20260709 13:20:51.972143  9775 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:51.973201  9952 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:51.967808  9888 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:51.993288  4216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2399) took 1033 ms. Trace:
I20260709 13:20:51.970449  9953 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:51.977557  9543 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:52.001374  4216 rpcz_store.cc:276] 0709 13:20:50.960174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.960424 (+   250us) service_pool.cc:224] Handling call
0709 13:20:50.979266 (+ 18842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.000165 (+ 20899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.993006 (+992841us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b54003c2dd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:51.993223 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38544640}
I20260709 13:20:51.977636  9947 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:51.983019  9589 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:52.004927  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 64261.6us
I20260709 13:20:51.984037  9868 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.013448  9947 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.008728  9943 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:51.992136  9875 consensus_queue.cc:1243] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:52.019572  9568 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.020816  9589 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.025242  4144 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 13. Ops: []
I20260709 13:20:52.040297  4144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2410) took 1149 ms. Trace:
I20260709 13:20:52.025417  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:52.032048  4296 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:52.033939  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:52.033936  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:52.041060  4144 rpcz_store.cc:276] 0709 13:20:50.891001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.317304 (+426303us) service_pool.cc:224] Handling call
0709 13:20:52.024803 (+707499us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800001298. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbda22 00007fee44ad6c09 00007fee43c30ee0 00007fee43cfa0ab 00007fee43cfa131 00007fee43cbbfc0 00007fee43ca6929 00007fee43ca63d2 00007fee3d21dbd4
0709 13:20:52.025049 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.039871 (+ 14822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.040214 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5060352}
I20260709 13:20:52.035039  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.034090  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:52.042320  4287 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
W20260709 13:20:52.048373  4113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.054630  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.056465  4919 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:20:52.056432  9669 consensus_queue.cc:1175] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34e6205f3c1d434193126fef20d73800" responder_term: 14 status { last_received { term: 12 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:52.057482  9947 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:52.060179  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.049186  4292 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:52.061290  4292 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:52.038837  9943 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.077201  9943 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.078382  4292 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.040684  9875 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:20:52.079432  4292 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:52.088575  9930 log.cc:927] Time spent T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 1.181s	user 0.006s	sys 0.000s
I20260709 13:20:52.089713  9936 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:52.092485  9898 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:52.097265  9979 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:20:52.098302  9589 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:52.067586  9767 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.104065  9767 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.105366  9625 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.107349  9767 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:52.108986  9868 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:52.067631  9839 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:20:52.059728  9981 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.112438  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.115459  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:52.121495  4292 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:52.118144  9568 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.124328  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:52.126083  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:52.128706  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.129300  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.132763  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.133548  4295 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:52.136874  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50105.2us
I20260709 13:20:52.138581  9775 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:52.138868  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.139218  9775 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.139595  9536 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:52.142922  9775 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:52.143510  9775 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.146889  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:52.139623  9978 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:52.150357  9978 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:52.151379  9978 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.152531  9703 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.153076  9703 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.155473  9703 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.155593  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:52.084630  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:52.186528  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.189935  4295 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:20:52.190613  4295 pending_rounds.cc:85] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 6
I20260709 13:20:52.190877  4295 pending_rounds.cc:107] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.7
W20260709 13:20:52.194782  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 56628.2us
I20260709 13:20:52.200677  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.201092  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.191380  4295 raft_consensus.cc:2889] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:52.193599  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 78283.2us
I20260709 13:20:52.206948  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.143973  9775 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.207732  4221 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:52.203738  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:52.227078  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:52.227967  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 60536.4us
W20260709 13:20:52.229982  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 248063us
I20260709 13:20:52.232849  4291 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:20:52.233619  4291 pending_rounds.cc:85] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 9
I20260709 13:20:52.233948  4291 pending_rounds.cc:107] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:20:52.234268  4291 raft_consensus.cc:2889] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:52.236282  4290 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:52.152211  9838 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.240836  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.241822  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.242326  4295 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:52.245085  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.191061  9822 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.191272  9589 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:52.253922  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.208288  9978 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:52.254753  4221 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:52.194283  9981 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:52.252470  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:52.256958  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.223749  9839 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:52.140262  9536 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.259498  4296 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 19 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:20:52.270043  4218 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:52.266106  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.249768  9849 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:52.271068  4213 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:52.275552  4218 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:52.291138  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.294019  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.247066  9768 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:20:52.249828  9669 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:20:52.303238  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 218751us
I20260709 13:20:52.309746  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:52.263496  9766 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.311054  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:52.287161  9849 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.313066  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.287029  9822 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:52.255954  9838 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.296547  9980 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.287688  9985 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.297652  9936 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:52.322295  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:52.328519  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.329591  4146 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:52.261072  9589 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.331434  4141 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:52.331871  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:52.334040  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.348435  4147 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:52.334824  4142 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:52.350013  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.351145  4147 raft_consensus.cc:2468] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:52.337455  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:52.318295  9943 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:52.318753  9849 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.250068  9874 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:20:52.297945  9875 consensus_queue.cc:1059] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:52.355252  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:52.357786  4144 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:52.319270  9868 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:52.361944  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:52.365051  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:52.293467  9839 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.325721  9898 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.374069  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.385649  4140 raft_consensus.cc:2410] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:52.394783  9845 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:52.395747  9845 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.395849  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.398675  9845 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.400470  4140 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:52.407423  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:52.321175  9848 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:20:52.330856  9802 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:52.325237  9822 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.367607  9980 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.319168  9766 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:52.426293  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 130493us
I20260709 13:20:52.368762  9874 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:52.383158  9900 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.480739  4145 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:52.456619  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.355577  9936 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.468998  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.473786  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.483165  4291 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:52.431636  4112 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:52.485965  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.486997  4141 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:20:52.478875  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.491956  4287 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:52.492563  4287 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:20:52.486982  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55468us
I20260709 13:20:52.495209  9560 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:52.499075  9766 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:52.491958  4296 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:52.503784  9987 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.178s
I20260709 13:20:52.499611  9822 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.450718  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.512832  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:52.526969  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.494925  4287 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.448513  9898 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:52.552778  9822 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:52.486073  9900 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.481484  9802 consensus_queue.cc:1243] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:52.563371  4145 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:52.423254  9895 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:20:52.553822  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:52.480974  9874 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:52.425776  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
W20260709 13:20:52.562778  9970 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:20:52.570182  4287 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.507542  9890 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.464238  9888 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:20:52.591995  9934 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:52.597148  9838 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:52.564715  9775 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:52.591833  9988 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:20:52.569804  9900 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:52.597215  9992 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:52.607507  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.458086  9980 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:52.591724  9989 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:20:52.633613  9948 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:52.634042  4138 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:52.610064  9536 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.585457  9898 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:52.616029  9936 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.598760  9548 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.637198  9548 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.586947  9890 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.641021  9890 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.646303  9548 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:52.622004  9543 consensus_meta.cc:287] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.000s
I20260709 13:20:52.647935  9543 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:52.648201  4295 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:20:52.610714  9802 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.648613  4295 pending_rounds.cc:85] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 5
I20260709 13:20:52.648582  9543 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:52.651467  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.653518  9543 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:52.621163  9951 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.003s
I20260709 13:20:52.632050  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:52.632938  9589 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.655084  9589 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.632661  9775 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:52.621115  9839 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.649188  4295 pending_rounds.cc:107] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:20:52.657074  4295 raft_consensus.cc:2889] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:52.657842  4111 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:52.658867  9839 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:52.625281  9874 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.625556  9980 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:52.662791  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.665282  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.666684  4145 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:52.667735  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.670249  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.671833  9802 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.673960  9874 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:52.695472  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.702067  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.696837  4293 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 21.
I20260709 13:20:52.704715  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.705850  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.697844  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.707204  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.700419  4145 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:52.709306  4145 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:20:52.709975  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:52.701491  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 250892us
I20260709 13:20:52.725209  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:52.588169  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:52.696651  9890 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.678002  4146 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
W20260709 13:20:52.727890  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 139810us
I20260709 13:20:52.733011  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.728783  4145 pending_rounds.cc:85] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 10
I20260709 13:20:52.734669  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.706854  9589 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.736598  4145 pending_rounds.cc:107] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:20:52.740309  9934 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.739979  4145 raft_consensus.cc:2889] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:52.742663  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.745437  9934 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.750205 10005 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:52.750797 10005 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.751121 10005 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:52.691329  9900 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.758893  9900 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:52.762449  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.763103  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.762347  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.771845  4140 raft_consensus.cc:606] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:52.772625  4140 raft_consensus.cc:614] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:52.736058  9997 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.780190  9890 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.693913  9849 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.783681  9849 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.784729  9987 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:52.786528  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.736989  9980 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.789721  4221 raft_consensus.cc:1240] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:52.697280  9802 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.789899  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.793471  9987 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.772421  9548 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.804764  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:52.806902  4292 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.805902  4287 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:52.807026  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.810799  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:52.813592  4287 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.817022 10004 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:52.798512  9980 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.822767  4261 leader_election.cc:400] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13.
I20260709 13:20:52.816082  4292 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:52.826694  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:52.840068  4292 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:20:52.840636  4292 pending_rounds.cc:85] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:52.840868  4292 pending_rounds.cc:107] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:20:52.841123  4292 raft_consensus.cc:2889] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:52.829531  9669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.009s
I20260709 13:20:52.821630  9898 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.825904  9980 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.823199  9874 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:52.845077  4261 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:52.845830  9669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.007s	sys 0.010s
I20260709 13:20:52.824421  9839 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:20:52.818990 10005 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.842408  9536 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:52.864835  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.871330 10005 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:52.872251  9536 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:52.873715  9536 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.866285  9874 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.862021  9888 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.888209  4287 raft_consensus.cc:2410] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:52.850009  9898 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.859726  9951 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:20:52.879072  9669 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.898100  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:52.899807  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 608705us
I20260709 13:20:52.909690  9987 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:52.911546  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.912631  9987 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.914995  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:52.916359  9987 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.916883  9987 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:52.917311  9987 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:52.922945  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 599135us
I20260709 13:20:52.927656  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.927793  9886 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:52.934804  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.935882  9987 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.938560  9987 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:52.939097  9870 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.939723  9870 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.942235  9953 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.942883 10004 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:52.943213  9870 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:52.942842  9953 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:52.946867  9898 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:52.948460  9831 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:52.949328  9831 consensus_queue.cc:1243] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:52.948635  9858 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:52.951989  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:52.953270  9726 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:52.953823  9802 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:52.955487  9726 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:52.962920  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.963671  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:52.965145  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.966671  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.967499  4290 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:52.970448  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:52.971705  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:52.972901  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.931972  9886 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:52.975175  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:52.975950  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.982626  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.983266  4218 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:52.979934  4140 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:52.985010  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.987016  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.987879  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:52.988022  4215 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:52.989627  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.887728  9874 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:20:52.991096  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:52.992247  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.992619  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.992930  4218 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:52.992980  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.993327  4220 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:52.993713  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:52.994158  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.889846 10005 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:20:52.990195  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:52.959867  9767 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:52.890377  9888 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:52.997999  4218 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:20:53.001055  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:52.998353  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:53.002761  4215 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.002969  4218 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:53.006166  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:53.011749  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:53.017724  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:53.040583  4140 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:53.040877  4144 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:53.040781  4220 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:53.013212  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.030768  9838 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:53.031438  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:53.024546  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.053905  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.029369  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:52.998548  9767 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:53.065604  4287 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:53.068998  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.009549 10005 consensus_queue.cc:1243] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:53.071623  9951 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:53.071455  4112 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.072842  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:53.073948  9951 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.074591  9951 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:53.063562  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:53.082114  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:53.083743  4138 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:53.085491  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:53.079950 10005 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:53.086699 10005 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.087280 10005 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:53.089018  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:53.093883  9839 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:53.107044  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:53.111358  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:52.991909  9886 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:53.103475  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.120496  4220 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:53.057714  9898 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.126631  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:53.139344  9767 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.163408  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:53.164701  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:53.174172 10000 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:20:53.175870 10012 log.cc:927] Time spent T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:20:53.179677  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:53.180783  4145 raft_consensus.cc:2410] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:53.184983  4145 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:53.186666  4145 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:53.195744  4215 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
W20260709 13:20:53.105610  9985 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:20:53.114358  9858 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:53.154817  9669 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:53.169203  9953 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:53.218976 10010 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:20:53.210140  9831 raft_consensus.cc:2764] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:20:53.215029 10006 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:53.257313  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 244222us
I20260709 13:20:53.216605  9766 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.224537  9858 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.231415  9625 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:53.161469  9898 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.263036  9767 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.278111  9858 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:53.285704  9978 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:53.317615  9993 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.719s	user 0.005s	sys 0.000s
I20260709 13:20:53.323028  9875 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:53.323782  9875 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:53.282207  9768 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:20:53.324952  9875 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.328725  9548 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.326373  9875 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:53.329300  9548 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:53.333016 10014 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:20:53.281622  9874 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:20:53.278297  9766 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.334219  4214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 911) took 1079 ms. Trace:
I20260709 13:20:53.368798  4214 rpcz_store.cc:276] 0709 13:20:52.254494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.254621 (+   127us) service_pool.cc:224] Handling call
0709 13:20:52.287776 (+ 33155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.500021 (+212245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:52.500072 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:52.500388 (+   316us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:52.500465 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.333920 (+833455us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001f7f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:53.333976 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.334126 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487348096}
I20260709 13:20:53.353438  4140 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 21.
I20260709 13:20:53.342409  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:53.364910  9981 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.339959  9951 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.365526  4288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3227) took 1336 ms. Trace:
I20260709 13:20:53.265632 10006 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.254895  9669 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:53.372891  4144 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:53.372829  4288 rpcz_store.cc:276] 0709 13:20:52.028933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.029093 (+   160us) service_pool.cc:224] Handling call
0709 13:20:52.029515 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:52.185302 (+155787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:52.185349 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:52.222639 (+ 37290us) log.cc:844] Serialized 26 byte log entry
0709 13:20:52.359258 (+136619us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:52.359304 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.359376 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:53.316954 (+957578us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4400022b4c. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bb1bc85 00007fee3bb1c6a2 00007fee3e88e1db 00007fee3e889aaf 00007fee3e87d86e 00007fee3e87cbb6 00007fee3e87c7d8 00007fee3e886221 00007fee3e8861d9 00007fee3e886169
0709 13:20:53.360001 (+ 43047us) raft_consensus.cc:1685] finished
0709 13:20:53.360041 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.365432 (+  5391us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20928,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":17089,"spinlock_wait_cycles":7691520,"thread_start_us":192606,"threads_started":2,"wal-append.queue_time_us":226272}
I20260709 13:20:53.301556  9953 consensus_queue.cc:1059] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:20:53.366145  9875 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:53.380587  4290 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 20. Current term is 21. Ops: [17.9-20.10]
I20260709 13:20:53.378526  9981 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.385020  9768 raft_consensus.cc:3055] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:53.385416  9978 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:53.385951  9898 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.386559  9981 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.385531  9768 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:53.389600  9858 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.389449  9768 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.391670  9768 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:53.391774  9858 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:53.392122  9980 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.004s
I20260709 13:20:53.397161  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:53.402266  9886 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:53.403520  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:53.405097  9943 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:53.415320  9980 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:53.385949  9978 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:53.395203  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 101208us
I20260709 13:20:53.417593  4187 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.417863  9980 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:53.413358  9669 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:53.415840  9943 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:53.419380  9943 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.388111 10006 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.404141  9766 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.421197  9766 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:53.421808  9766 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:53.421664  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.423082  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2884) took 1078 ms. Trace:
I20260709 13:20:53.422892  9766 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.423979  9869 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:53.424536  9869 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.424930  9869 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:53.426831  4110 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:53.432786  9951 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.438948 10005 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.424849  9999 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:53.442991  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.432893  9952 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.444975 10019 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:53.440513  9999 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:53.446385  9999 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.447500  9999 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:53.425045  9886 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:20:53.423488  4143 rpcz_store.cc:276] 0709 13:20:52.344216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.369858 (+ 25642us) service_pool.cc:224] Handling call
0709 13:20:52.406360 (+ 36502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.322397 (+916037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:53.322435 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:53.322488 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:53.322525 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.422802 (+100277us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b5400265a54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:53.422856 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.423016 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2106006272}
I20260709 13:20:53.440568  9726 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:20:53.439113 10025 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:20:53.441819  9875 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:53.467610  9875 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:53.469885 10005 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.473344  9548 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.486675  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:53.498399  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 281901us
I20260709 13:20:53.495886  4187 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:53.503583  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.506410  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:20:53.507449  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 404116us
I20260709 13:20:53.509100  4112 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.494477  9960 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:20:53.504148  9831 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.517953 10005 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:53.515918  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.507614 10019 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:53.519189  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:53.510663  9838 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:53.521109  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.521762  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.520843  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.526566  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:53.510958  9921 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.514321  9951 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.518590  9978 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.525470  4220 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 11. Current term is 13. Ops: []
I20260709 13:20:53.527999  4219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 906) took 1332 ms. Trace:
I20260709 13:20:53.530824  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:53.530730  4219 rpcz_store.cc:276] 0709 13:20:52.195613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.195780 (+   167us) service_pool.cc:224] Handling call
0709 13:20:52.196199 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.359705 (+163506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:52.359740 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:52.359814 (+    74us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:52.359860 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.527730 (+1167870us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000249d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:53.527786 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.527940 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375447296}
I20260709 13:20:53.532106  9978 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.523289 10005 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.536823  9875 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:53.537405  9875 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:53.537814  9875 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:53.523346  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.521665  9839 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:53.551985 10031 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.552788 10031 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.528542  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:53.528275 10030 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:53.560145 10006 raft_consensus.cc:2764] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:53.563719  9888 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.564975  9869 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.566272  4218 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 19: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:53.557211  9978 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.570040  9869 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.570837  9978 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.574045  9548 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.574875  9978 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.577773 10023 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:53.559058  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2888) took 1190 ms. Trace:
I20260709 13:20:53.579250  4141 rpcz_store.cc:276] 0709 13:20:52.369056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.496280 (+127224us) service_pool.cc:224] Handling call
0709 13:20:52.496772 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.562747 (+ 65975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:52.562785 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:52.562833 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:52.562865 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.558792 (+995927us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b5400068954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:53.558843 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.558980 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151197440}
I20260709 13:20:53.528627 10019 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:53.585911 10033 log.cc:927] Time spent T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:20:53.586022  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:20:53.583559  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.591403  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:53.592007  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:53.594388 10031 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.588783 10019 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.599742  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:53.601707  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:53.605083  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:53.606257  4146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2871) took 1278 ms (client timeout 1601 ms). Trace:
I20260709 13:20:53.591284 10004 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:53.606699  4146 rpcz_store.cc:269] 0709 13:20:52.328277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.337140 (+  8863us) service_pool.cc:224] Handling call
0709 13:20:53.606087 (+1268947us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540044a554. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:53.606196 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687035264}
I20260709 13:20:53.616519 10031 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:53.617254 10031 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:53.618207 10031 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.621824 10005 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.623808  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:53.602437  9987 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:53.625758  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:53.599399  9839 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:20:53.625345  9978 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:53.620721  9999 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:53.635653  4261 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:53.640228  9766 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.640959  9766 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.644737  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.645947  9766 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.643762  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.644271  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:53.635174 10005 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:53.637753 10006 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:53.621173 10004 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.652280  9999 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:53.663007  9999 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:53.659106  9921 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:53.665462  9921 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:53.666105  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44160 (request call id 3198) took 1403 ms. Trace:
I20260709 13:20:53.666620  4221 rpcz_store.cc:276] 0709 13:20:52.262813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.263013 (+   200us) service_pool.cc:224] Handling call
0709 13:20:52.264130 (+  1117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.796779 (+532649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.665747 (+868968us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54000244d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:53.666032 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208213248}
I20260709 13:20:53.668226  9997 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:53.668869  9997 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:53.669750  4187 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.601s (SENT) [suppressed 3 similar messages]
I20260709 13:20:53.677513 10004 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.678431  9997 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.680142  9921 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:53.681720  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.682168  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.697278  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.701169  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.702770  4290 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:20:53.703261  4290 pending_rounds.cc:85] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 8
I20260709 13:20:53.703485  4290 pending_rounds.cc:107] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:20:53.703593  4288 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:20:53.703748  4290 raft_consensus.cc:2889] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:53.704718  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.705638  4288 raft_consensus.cc:2410] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:53.705917  4293 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:20:53.706279  4293 pending_rounds.cc:85] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:53.706496  4293 pending_rounds.cc:107] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:20:53.706773  4293 raft_consensus.cc:2889] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:53.708231  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:53.704870  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.710773  4287 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:53.711889  4290 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:53.712766  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.707594  9953 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.718894  9953 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.720893  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2778) took 1260 ms. Trace:
I20260709 13:20:53.721761  9953 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.725440  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.721426  4295 rpcz_store.cc:276] 0709 13:20:52.460506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.460697 (+   191us) service_pool.cc:224] Handling call
0709 13:20:52.461068 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.657791 (+196723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.720630 (+1062839us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002963d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:53.720826 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429257984}
I20260709 13:20:53.738970  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:53.739830  4221 raft_consensus.cc:606] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.741299  9874 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.741902  9874 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.744549  9766 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:53.744308  9874 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.752717  9874 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.753345  9874 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.755497  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:53.756762  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:53.757917  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:53.758558  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.759548  4216 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:53.760898  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.763078  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.771085  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:53.769134  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:53.775421  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.778533  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.791610  4289 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 19: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:53.792526  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.779613  9999 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:53.781229  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.783259  9874 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:53.783691  9766 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:20:53.784580  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.675246  9875 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:53.794552  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.753968  9890 consensus_queue.cc:1059] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:20:53.808884  9890 raft_consensus.cc:3055] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:53.795606  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:53.795691  9858 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:53.806943  9875 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:53.808056  4291 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:53.812614  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:53.809437  9890 raft_consensus.cc:740] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:53.816833  4259 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:53.822273  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:53.823995  4139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 635) took 1234 ms. Trace:
I20260709 13:20:53.824620  4139 rpcz_store.cc:276] 0709 13:20:52.589077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.751091 (+162014us) service_pool.cc:224] Handling call
0709 13:20:52.751378 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.637950 (+886572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:53.637985 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:53.638034 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:53.638067 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.823649 (+185582us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400286c54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:53.823724 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.823912 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038399232}
I20260709 13:20:53.831658  4041 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:53.833756  4041 catalog_manager.cc:5697] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:20:53.842578  4041 catalog_manager.cc:5697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.800884  9822 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:53.864534  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:53.864058  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:53.865864  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.866295  4290 raft_consensus.cc:2410] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 17 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:53.854903  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:53.868387  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:53.869858  9999 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:53.870291  9999 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:53.870682  9999 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:53.872648  4293 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.858662  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.876977  4294 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:53.859735  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.878350  4292 raft_consensus.cc:2410] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:53.860704  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:53.879220  4287 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:53.887562  9543 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:53.888599  9543 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:53.890055  9543 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.896494  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:53.898562  4294 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:53.850181  9890 consensus_queue.cc:260] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.918757  9890 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:53.862183  9874 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:53.818099  9943 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:53.925729  9548 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.926539  9548 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.930147  9848 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:53.930910  9848 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:53.933298  4219 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:53.936506  9936 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:53.937225  9936 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:53.941234  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:53.943216  9981 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:53.944265  9548 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:53.949810  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:53.944547  9951 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:53.951648  9987 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:53.953162 10024 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:53.948556  9848 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:53.945739  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:53.954277  9848 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:53.954890  9848 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.888111  4287 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:20:53.959519  4293 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 22.
I20260709 13:20:53.955336  9848 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.962556  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.964166  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:53.964951  4221 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
W20260709 13:20:53.985296  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 166197us
I20260709 13:20:53.987920  4111 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:53.919528  9822 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.996084  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:53.997960  9822 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.002074 10023 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:53.983533  9948 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:54.009567 10031 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:54.032145  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:54.036250  4144 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:54.042608  4296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3257) took 1045 ms. Trace:
I20260709 13:20:54.046377  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.043123  4296 rpcz_store.cc:276] 0709 13:20:52.997170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.217161 (+219991us) service_pool.cc:224] Handling call
0709 13:20:53.243240 (+ 26079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.392678 (+149438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:53.392713 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:53.392764 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:53.392800 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:54.042315 (+649515us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540042b8d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:54.042372 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:54.042537 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343115136}
I20260709 13:20:54.056660  4294 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:53.992904  9999 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.072577  4143 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 20. Current term is 21. Ops: [17.9-20.10]
I20260709 13:20:54.076170 10031 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:54.086915 10040 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:20:54.041498 10023 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:54.089442 10023 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.103205  9999 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:54.086915 10031 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.122810  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:54.172895  4144 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:54.174132  9536 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.273345  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:54.274189  4139 raft_consensus.cc:2376] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16. Re-sending same reply.
I20260709 13:20:54.275271  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.216602  9999 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:54.196265  9536 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:54.280230  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 426906us
W20260709 13:20:54.234172 10019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.023s	sys 0.016s
I20260709 13:20:54.283241  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:54.293119  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:54.294195  4139 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:54.294559  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 299338us
I20260709 13:20:54.279042  9890 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:54.303491  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 133726us
I20260709 13:20:54.308951  4288 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:54.279214  9936 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:54.310730  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.312570  4138 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:20:54.279354  9839 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:54.286666 10019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.023s	sys 0.017s
I20260709 13:20:54.336560  4291 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:54.344220  4139 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 19.
I20260709 13:20:54.354218  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:54.354709  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 72611.9us
I20260709 13:20:54.355150  4139 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:54.356824  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:54.359484  4288 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:54.285424  9999 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.391728  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.410538  4289 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 11.
I20260709 13:20:54.393504  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.412782  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.414673  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:54.397050  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.392419  9943 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.416260  9943 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:54.417104 10054 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:20:54.348483  9895 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:54.418138  9895 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:54.419081  9943 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:54.336079  9839 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:54.420737 10046 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
I20260709 13:20:54.421974  9839 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:54.424250  9543 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:54.382155 10025 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:20:54.424921  9543 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.427719  9543 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:54.432662  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.434129  4146 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 15: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:54.439371  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:54.443266  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:54.449352  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.449740  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.451032  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.452162  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:54.453919  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 70112.2us
I20260709 13:20:54.460314  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.456674  4139 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:54.411902  9999 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:54.464607  4147 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:54.454988  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 158903us
I20260709 13:20:54.466152  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.336627  9848 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.484539  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:54.485719  4146 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 19: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:54.441118  9943 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.454488  9874 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.453644  9536 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:54.453720  9839 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:54.453920  9888 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:54.497716  4142 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:54.491665  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 329147us
I20260709 13:20:54.491576 10025 consensus_queue.cc:1243] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:20:54.504962  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 112777us
I20260709 13:20:54.487955 10023 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.512691  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:54.513399  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:54.516515  4112 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:54.521721  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:54.495899  9943 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.499030  9548 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.500319  9802 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:54.527402  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 58300.4us
I20260709 13:20:54.513377  9895 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:54.530203  9936 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:54.520284  9951 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:54.497323  9874 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.517115  9568 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:20:54.503422  9839 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:54.507731  9888 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:54.518359  4139 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:54.514562  9822 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.538201  9936 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.571972  9952 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.572993  9952 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.523586 10023 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:54.552701  9999 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.537009  9869 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:20:54.555927 10061 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.585623  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.585772  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:54.586229  4293 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:20:54.589516  4140 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 17: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:54.589636  4293 pending_rounds.cc:85] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 9
I20260709 13:20:54.590481  4293 pending_rounds.cc:107] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:20:54.591264  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.576216  9952 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:54.533761  9548 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.591719  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:54.536616  9802 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.617959  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:54.619573  4217 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:54.619998  4217 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:54.597579  9888 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:54.576689  9936 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:54.621119  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:54.600752  9839 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:54.601747  9960 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:54.602272 10023 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:54.605177 10061 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.608749  9858 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:54.609021  9872 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:54.609536  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 44289.8us
I20260709 13:20:54.551940 10043 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:20:54.648605  9895 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.649559  9768 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:54.650020  9768 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:54.650220  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.651758  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.614866  4222 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:20:54.613741 10055 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:20:54.616261  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:54.585110  9726 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:20:54.623293 10050 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:54.623133  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:54.655107  4218 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:54.655911  9943 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:54.627127  9766 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:54.624003  4217 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.657871  4147 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:54.658017  4217 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:54.633157  4216 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:54.658934  4216 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:54.630277  9548 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:54.644426  4293 raft_consensus.cc:2889] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:54.583114  9543 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:54.646128  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54541.2us
I20260709 13:20:54.647221  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.662181  4291 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:54.649255  9895 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.650444  9768 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:54.615538  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:54.663889  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:54.644208  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 104700us
I20260709 13:20:54.600914  9848 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:54.667235  4145 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 17. Ops: [15.8-15.8]
I20260709 13:20:54.660099  4216 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.671388  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:54.673067  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.673744  4216 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:54.674351  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 161131us
I20260709 13:20:54.676178  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.676357  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:54.648559 10043 consensus_queue.cc:1243] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:54.681445  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:54.682365  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.683622  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.687781  4291 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 17: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:54.691576  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:54.694584  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:54.666198  9766 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:54.696852  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:54.697575  4296 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.699159  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:54.673257 10062 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:54.672648  9947 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:54.680766  9548 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:54.706310  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:54.683840  9568 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:54.656837 10067 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:20:54.669767  9543 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.715435  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:54.725198  4217 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:20:54.712985  9775 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.728818  9999 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:54.729264  9822 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:54.742044  4143 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:20:54.699838  9874 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:54.744277  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:54.706239 10062 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:54.707955 10057 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:54.675470 10023 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:20:54.735494  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.735347  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:54.760123  4213 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.716176 10064 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:54.763348  4216 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:54.763906  4216 pending_rounds.cc:85] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 7
I20260709 13:20:54.764228  4216 pending_rounds.cc:107] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:54.671830  9872 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:54.739398  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:54.740361  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.740491  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.707708 10069 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.730064 10067 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:54.751178  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.753926  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:54.766196  4138 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:54.754344  4110 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:54.730032  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:54.794068  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 64133.2us
I20260709 13:20:54.795549  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:54.755504  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 149220us
I20260709 13:20:54.710698  9548 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.757556  4221 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:54.764094  4296 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:54.764586  4216 raft_consensus.cc:2889] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:54.736042  4217 pending_rounds.cc:85] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 10
I20260709 13:20:54.771566  4139 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:54.797473  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:54.742344  9839 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:54.808501  4217 pending_rounds.cc:107] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:20:54.809190  4217 raft_consensus.cc:2889] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:54.811264  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:54.813122  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:54.826704  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 72486.5us
I20260709 13:20:54.832043  4213 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:54.822309  9875 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:54.834981  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.835700  9875 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.836402  9875 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.747586  9947 consensus_queue.cc:1059] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:20:54.792675  9999 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:54.821127  9548 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.792330 10067 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:54.821591  9943 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:54.761581  9766 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.766119  9589 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:20:54.839434  9838 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:54.850720 10060 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 13:20:54.827553  9874 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:54.805536 10069 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.837935 10057 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.840862  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:54.848436 10070 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:54.839608  9981 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:54.863539  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 121927us
W20260709 13:20:54.883390  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 189617us
I20260709 13:20:54.891132  4287 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.859341  9943 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:54.900454  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 87446.7us
I20260709 13:20:54.897676  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:54.868793  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 99963.8us
I20260709 13:20:54.905150  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:54.909983  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:54.910894  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:54.912057  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:54.919317  4287 raft_consensus.cc:2410] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:54.925103  9543 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:54.925896  9543 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:54.928947  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:54.871002  9838 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:54.874446 10050 raft_consensus.cc:3055] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:54.876274 10070 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:54.937179  4261 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:54.940503  4110 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:54.950795  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:54.879079  9766 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:54.942983  4291 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:54.933341  4296 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:54.837941 10062 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:54.889911  9831 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:54.958601  4110 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:54.969688  4291 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 21. Current term is 22. Ops: [18.10-21.11]
W20260709 13:20:55.012071  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 45097.4us
I20260709 13:20:55.013507  4292 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
W20260709 13:20:54.977962  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 104853us
W20260709 13:20:55.017172  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.014830  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:54.945583 10050 raft_consensus.cc:740] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:54.890710  9981 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:55.020015  4296 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:54.965173 10044 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:20:54.955581  9839 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:54.954941  9543 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:54.957118 10070 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.962255  9888 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:54.908859  9943 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.011512  9831 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:20:55.104715  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 90014.5us
I20260709 13:20:55.105796  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:55.007283  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 70212.2us
I20260709 13:20:54.968014  9802 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:55.010895  9900 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.981335 10064 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.070688 10092 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:55.088977  9767 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.089696 10061 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:55.112792  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:55.112022  4111 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:20:55.155682  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50009.5us
I20260709 13:20:55.115090  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:55.131265  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:55.158903  4287 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:20:55.092890 10085 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:55.161665  4041 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:55.166834  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54931.5us
I20260709 13:20:55.102823  9875 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:55.130841  9775 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:55.170918  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 61908.4us
I20260709 13:20:54.961009  9999 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.152608  9872 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:55.207129  4186 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:55.172936  9849 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:55.177625  9900 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:55.174568  9948 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:55.171115 10086 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:55.101704  9831 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.176920  9875 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:55.184962  9802 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:20:55.247496 10095 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.232156  9822 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:20:55.205232  9874 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.236850  9900 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.154518 10092 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.162194  9838 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.362191  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.353438 10025 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:55.354688 10093 log.cc:927] Time spent T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:20:55.363097  4295 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:55.192865  9775 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:55.353417  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 146380us
I20260709 13:20:55.365327  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.267383 10095 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.370545  9849 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.382900  9849 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.384446 10095 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:55.385664  9981 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:55.364291  9900 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.346771  9953 raft_consensus.cc:993] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:55.266119 10086 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:55.278020  9948 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:20:55.388211  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:55.440683  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 265723us
W20260709 13:20:55.366101  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 191982us
I20260709 13:20:55.175328 10085 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.266718  9875 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.370702 10069 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:55.388989  9936 consensus_meta.cc:287] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.003s
I20260709 13:20:55.489041  9936 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.491516  9936 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:55.448487  4294 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:20:55.456635 10080 raft_consensus.cc:1081] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
W20260709 13:20:55.456813  4140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 2909) took 1424 ms (client timeout 1810 ms). Trace:
I20260709 13:20:55.457584  4146 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 17. Ops: [15.9-15.9]
I20260709 13:20:55.463641  9895 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:55.465884  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 84706.7us
I20260709 13:20:55.466069  4289 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:55.467473  9766 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:55.468796  9943 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:55.530570  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.386132 10095 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:55.471009 10086 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:55.472415 10052 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:55.376325 10094 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:20:55.356227 10050 consensus_queue.cc:260] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:55.481132  9568 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.554989  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:55.555989  4218 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:55.485114  4147 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:55.487064  4144 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:55.503661 10101 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:55.507995 10092 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:55.510133 10085 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:55.512457  4295 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:55.515969  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 407911us
I20260709 13:20:55.523844  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:55.512373  4140 rpcz_store.cc:269] 0709 13:20:54.032595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.046031 (+ 13436us) service_pool.cc:224] Handling call
0709 13:20:55.456541 (+1410510us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400076f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:55.456743 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246618496}
I20260709 13:20:55.598354  4112 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:55.543751  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:55.527935 10090 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:20:55.599123 10105 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:55.482479  9775 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:55.601027 10077 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:20:55.601066  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43762.3us
I20260709 13:20:55.481138  9948 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.539016 10095 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.597947  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:55.627650  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:55.535490  4293 raft_consensus.cc:1240] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:55.631340  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:55.641124  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 89407.5us
I20260709 13:20:55.641932  4145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2430) took 1400 ms. Trace:
I20260709 13:20:55.642359  4145 rpcz_store.cc:276] 0709 13:20:54.241412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.549193 (+307781us) service_pool.cc:224] Handling call
0709 13:20:54.660448 (+111255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:54.673057 (+ 12609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:55.641669 (+968612us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003967d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:55.641860 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254897408}
I20260709 13:20:55.656316  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:55.657140  4295 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:55.656744  4290 pending_rounds.cc:85] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 7
I20260709 13:20:55.660091  4290 pending_rounds.cc:107] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:55.664201  4290 raft_consensus.cc:2889] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:55.664968  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:55.666770  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 50099.4us
I20260709 13:20:55.666800 10092 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:55.675631  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46220.1us
I20260709 13:20:55.553287  9869 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:20:55.679891  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:55.595407  9568 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.717417  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:55.735925  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.654232  9981 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:55.721858  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 93676.4us
W20260709 13:20:55.740444  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 60850.5us
I20260709 13:20:55.742887  9952 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:55.752939  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.763705  4222 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 13:20:55.764149  4222 pending_rounds.cc:85] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 9
I20260709 13:20:55.764750  4222 pending_rounds.cc:107] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:20:55.754472  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:55.716804  9768 consensus_meta.cc:287] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 1.035s	user 0.016s	sys 0.000s
I20260709 13:20:55.679297 10092 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:55.674064  9767 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:20:55.766732  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.766821  9768 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:55.743515  9952 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.768373  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.769464  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.769781  4220 raft_consensus.cc:2393] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 17: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:55.770174  4214 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:55.770471  9952 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:55.770675  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.771055  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.661439 10108 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:55.771728 10108 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:55.769523  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.772439  9768 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:55.680670  9943 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:55.747404  9775 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:55.773371  9775 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.773280  9943 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.773901  9775 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:55.674024 10085 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.776412  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.777019 10085 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.777060  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.779526  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.780696 10092 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:55.752804  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:55.751665  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.765141  4222 raft_consensus.cc:2889] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:55.787200  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47334.5us
I20260709 13:20:55.792712  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:20:55.718971 10090 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:20:55.763617  9548 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.003s
I20260709 13:20:55.803242  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:55.737340  9874 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
W20260709 13:20:55.808152  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44695.3us
I20260709 13:20:55.810030  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:55.762953 10069 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.786589  4294 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:20:55.834350  4294 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.834887  4294 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:55.772480 10108 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:55.838680  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50655.2us
I20260709 13:20:55.842547  4295 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:55.792423  9936 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:20:55.836067  9874 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:55.867828  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58544.7us
I20260709 13:20:55.803817  9875 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:55.822749  9766 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:55.885598  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:55.823087  9981 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:55.796880  9536 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:20:55.871326  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:55.852209  9874 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:55.909462  4218 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:55.912254  4292 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:55.915102  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:55.916620  4214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:55.917840  4214 raft_consensus.cc:606] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:55.812700  9548 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:55.924976  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 53681.9us
I20260709 13:20:55.906587  4294 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.930941  4295 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:55.939883  9952 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:55.941464  9568 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:55.944482  9981 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:55.945935 10117 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:20:55.946242 10070 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.832s	user 0.010s	sys 0.002s
I20260709 13:20:55.946635 10070 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.947721  4291 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:55.877835  9766 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:55.952431 10050 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:55.887881 10109 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:55.958729  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59962.4us
I20260709 13:20:55.970252  9952 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:55.971511  9952 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:55.974601  9548 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:55.976308  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.981076  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:55.985370  4294 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.002190  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:56.015758  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 48682.2us
I20260709 13:20:56.017593  4292 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:56.027459  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.017045 10104 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.036862 10052 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:56.037593 10052 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:56.039073 10116 log.cc:927] Time spent T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:56.040098 10052 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.033823  4294 raft_consensus.cc:1240] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:56.033675  9842 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:56.044644 10108 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.045059  9842 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.047236 10108 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.001618 10070 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.047289  9842 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.028986 10094 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:56.037882  9900 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.002s
I20260709 13:20:56.056289  4289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3285) took 1114 ms. Trace:
I20260709 13:20:56.071424  4289 rpcz_store.cc:276] 0709 13:20:54.941881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.942095 (+   214us) service_pool.cc:224] Handling call
0709 13:20:54.942670 (+   575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:55.513637 (+570967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.055751 (+542114us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54002599d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:56.056138 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202657024}
I20260709 13:20:56.085655  4289 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:56.089421  4292 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:56.057237 10124 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.087843  9960 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:20:56.076784  9900 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.106438  9900 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.106509 10067 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.085887 10025 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:20:56.058004 10094 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.094535 10123 consensus_queue.cc:1059] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:20:56.127249  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 333261us
I20260709 13:20:56.130434 10123 raft_consensus.cc:3055] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:56.131042 10123 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:56.103654 10124 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.132009 10123 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.133909 10123 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:56.134819  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.135788 10062 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:56.136462 10124 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.147426 10085 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.148136  9775 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.149454  9858 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:56.150427  9858 consensus_queue.cc:1059] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:56.151293  9775 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.155037  9858 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:56.156261 10124 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:56.157832  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.199008 10094 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.162197  4041 catalog_manager.cc:5697] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.162817  4213 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:20:56.200989  4041 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:20:56.164121 10122 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:56.165210 10025 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:56.205092 10025 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.166203  9831 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:56.167109 10074 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:56.169648  9766 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.174314  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
W20260709 13:20:56.191522  4040 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 176) took 21673 ms (client timeout 15000 ms). Trace:
I20260709 13:20:56.203167  4041 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 9 to 12, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 12 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.221980 10025 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:56.225670  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.226415  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:56.228329  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 425196us
I20260709 13:20:56.229673  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:56.230216  4041 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.234277  4289 raft_consensus.cc:2410] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:20:56.234954  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.235877  4292 raft_consensus.cc:2468] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 10.
I20260709 13:20:56.235258  9802 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:56.238353  9802 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:56.238826  9802 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:56.252660  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:56.258932  9999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.006s	sys 0.004s
W20260709 13:20:56.261034  9999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.006s	sys 0.004s
I20260709 13:20:56.261756 10137 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:56.262439  9766 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:56.211501  4040 rpcz_store.cc:269] 0709 13:20:34.518228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.520465 (+  2237us) service_pool.cc:224] Handling call
0709 13:20:35.168569 (+648104us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:56.191387 (+21022818us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:49.740456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:49.741607 (+  1151us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:49.748982 (+  7375us) write_op.cc:435] Acquired schema lock
0709 13:20:49.786122 (+ 37140us) tablet.cc:662] Decoding operations
0709 13:20:50.140682 (+354560us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:50.140817 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:50.140848 (+    31us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:20:50.143212 (+  2364us) tablet.cc:701] Row locks acquired
0709 13:20:50.143285 (+    73us) write_op.cc:260] PREPARE: finished
0709 13:20:50.143571 (+   286us) write_op.cc:270] Start()
0709 13:20:50.143778 (+   207us) write_op.cc:276] Timestamp: P: 1783603250143486 usec, L: 0
0709 13:20:50.143827 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:20:50.230145 (+ 86318us) log.cc:844] Serialized 8975 byte log entry
0709 13:20:50.644798 (+414653us) op_driver.cc:464] REPLICATION: finished
0709 13:20:50.936984 (+292186us) write_op.cc:301] APPLY: starting
0709 13:20:50.949967 (+ 12983us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:51.582924 (+632957us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:51.583066 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:51.648705 (+ 65639us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:51.649463 (+   758us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=0,mrs_lookups=0
0709 13:20:51.649553 (+    90us) write_op.cc:312] APPLY: finished
0709 13:20:51.650244 (+   691us) log.cc:844] Serialized 204 byte log entry
0709 13:20:51.650460 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:51.650694 (+   234us) write_op.cc:454] Released schema lock
0709 13:20:51.650779 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:51.651860 (+  1081us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18003f8560. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3e88a4bc 00007fee3bbd848b 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf2455 00007fee3ec5f190 00007fee3ec58ae7 00007fee3ec57dd9
0709 13:20:51.682407 (+ 30547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:51.683246 (+   839us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1375422,"reported_tablets":54,"spinlock_wait_cycles":64578816,"child_traces":[["op",{"apply.queue_time_us":213826,"apply.run_cpu_time_us":44125,"apply.run_wall_time_us":735820,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100313,"num_ops":23,"prepare.queue_time_us":119064,"prepare.run_cpu_time_us":28803,"prepare.run_wall_time_us":746214,"raft.queue_time_us":25379,"raft.run_cpu_time_us":22535,"raft.run_wall_time_us":185176,"replication_time_us":475695,"spinlock_wait_cycles":25682304,"thread_start_us":404578,"threads_started":4,"wal-append.queue_time_us":302968,"wal-append.run_cpu_time_us":17556,"wal-append.run_wall_time_us":2110069}]]}
I20260709 13:20:56.267668  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.237344 10025 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:56.272195  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:56.274976  4041 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:20:56.277056 10113 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.430s	user 0.003s	sys 0.000s
I20260709 13:20:56.278849 10095 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.280478  9999 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.256505  9858 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:56.284741  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.292452  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:20:56.361140  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 68817.1us
I20260709 13:20:56.265340  9960 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.366860  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.367130  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:56.367779  4215 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:56.368119  4215 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:56.368067  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:56.368645  4217 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:56.369879  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:56.286362 10025 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.234364 10074 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.369123  4215 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.383917  4215 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:56.379446  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:56.287508  9953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.013s	sys 0.000s
I20260709 13:20:56.364852  9960 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.365339  9999 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.379041  9869 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.395960  9869 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.397022 10025 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.398399  9869 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.398473  9960 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.400796  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:56.263506 10092 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.378352  4041 catalog_manager.cc:5697] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:56.234079  9831 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.386005  4218 raft_consensus.cc:2393] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 18: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:56.365547 10095 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.365775 10086 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:56.267663 10137 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 13:20:56.378439 10104 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:56.409186  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:20:56.387305  9953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.013s	sys 0.000s
I20260709 13:20:56.418272  4218 raft_consensus.cc:1240] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:56.418812  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.410017  4041 catalog_manager.cc:5697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.419505  4216 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:20:56.388247 10085 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:56.421272  4041 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.462666  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.416391 10104 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.468179 10104 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:56.469125  4294 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:56.471637  9921 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:56.473794 10072 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:56.474524 10072 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.472292  9921 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:56.481891 10129 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.397s	user 0.000s	sys 0.002s
W20260709 13:20:56.484634  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.485006  9999 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.485776  4287 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:56.487450 10092 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:56.487776 10133 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:20:56.490995  9831 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:56.414342 10095 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.495571 10095 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.417524 10137 consensus_queue.cc:1243] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 34e6205f3c1d434193126fef20d73800 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:56.498474 10074 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:56.499106 10072 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.501945  9802 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.484076  9921 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.507455  4892 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:56.510131  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.567116  4041 catalog_manager.cc:5697] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.505112 10085 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.599433  9943 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.567692  9997 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:56.661525  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.616271 10086 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:56.678848  9943 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.677699  9802 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.667904  9766 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.686123  4041 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.539674  4215 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:20:56.679797 10086 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.726372 10086 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.686292  9943 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.726823  4261 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:56.704833 10085 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:56.728945  9997 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:56.729525 10085 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:56.729696  9997 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.732625  9997 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.733837  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.734889 10086 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:20:56.741103  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:56.742372  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:56.750029 10102 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:56.729018  9943 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:56.686928  9766 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:56.759052 10086 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:56.766892  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet a35e1cee8a15436dbfaf75dd67824aad with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:56112
I20260709 13:20:56.766978  9849 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.769342 10067 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.756320 10102 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:56.773389 10102 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.774669 10102 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:56.781308  4146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2429) took 2540 ms. Trace:
I20260709 13:20:56.756232 10085 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:56.784667 10097 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:56.785820  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 768506us
I20260709 13:20:56.761602  4041 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 4 to 10, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.786864  4146 rpcz_store.cc:276] 0709 13:20:54.241097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.502408 (+261311us) service_pool.cc:224] Handling call
0709 13:20:55.457289 (+954881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:55.512924 (+ 55635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.780996 (+1268072us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5400076f50. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece18ad 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:56.781194 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2157674752}
I20260709 13:20:56.788578  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.791077  4215 pending_rounds.cc:85] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 8
I20260709 13:20:56.791007  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.797868  4215 pending_rounds.cc:107] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:20:56.798506  4215 raft_consensus.cc:2889] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:56.798884  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:56.799823  4216 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:56.755615  9766 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:56.793094  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.794240  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:56.808125  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.760265 10086 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:56.811218  4041 catalog_manager.cc:5697] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 5 to 9, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 9 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:20:56.813868  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.815237  4219 raft_consensus.cc:2393] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:56.818140  4216 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 19.
W20260709 13:20:56.801313  9838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.338s	user 0.021s	sys 0.034s
I20260709 13:20:56.820565  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.821187  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.823659 10148 tablet_replica.cc:333] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
W20260709 13:20:56.823997  9838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.022s	sys 0.034s
I20260709 13:20:56.830430  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:56.825469 10148 raft_consensus.cc:2243] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.795254 10085 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.835161  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:56.793453 10061 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:56.806383 10031 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:56.837707  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.835811  4041 catalog_manager.cc:5697] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.840154  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.806847 10097 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:56.848212  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:56.851771  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:56.852913  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:56.853514  4144 raft_consensus.cc:606] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:56.854133  4140 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:56.822152  9943 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.856621  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:56.864498  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 68526.1us
I20260709 13:20:56.865718  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:56.866264  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:56.867049  4138 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 21.
I20260709 13:20:56.843722 10085 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:56.850626 10148 raft_consensus.cc:2272] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.879431  4144 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:20:56.888391 10125 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.888880  9888 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:56.891299 10097 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.892637 10097 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:56.849551 10105 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:56.895546 10105 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.898312 10105 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:56.850818 10061 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.904568  9858 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:56.859335  9802 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:56.911093  4293 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:20:56.910990  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2933) took 1395 ms. Trace:
I20260709 13:20:56.916775  4291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46846 (request call id 3291) took 1897 ms. Trace:
I20260709 13:20:56.916044  4141 rpcz_store.cc:276] 0709 13:20:55.515840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.529819 (+ 13979us) service_pool.cc:224] Handling call
0709 13:20:55.552520 (+ 22701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:55.552787 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:55.668813 (+116026us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.785300 (+1116487us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b18001f02a0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bb6fc0a 00007fee452af219 00007fee3bbf7a40 00007fee3bbf24e4 00007fee3bbf2455 00007fee3ecda060 00007fee3ecec716 00007fee3ecfd287 00007fee3ecfd208
0709 13:20:56.910394 (+125094us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.910708 (+   314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:56.910764 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:56.910797 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.910844 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.910936 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59212,"prepare.queue_time_us":431375,"prepare.run_cpu_time_us":4440,"prepare.run_wall_time_us":18509,"raft.queue_time_us":817834,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7418,"spinlock_wait_cycles":11996032,"thread_start_us":562169,"threads_started":3,"wal-append.queue_time_us":422456}
I20260709 13:20:56.920969 10123 raft_consensus.cc:993] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:56.921614 10123 raft_consensus.cc:1081] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:20:56.917948  4291 rpcz_store.cc:276] 0709 13:20:55.019117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.027562 (+  8445us) service_pool.cc:224] Handling call
0709 13:20:55.027946 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:55.948120 (+920174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.916441 (+968321us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54002783d4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:56.916696 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114836736}
I20260709 13:20:56.925235  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.871304 10057 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:56.849423 10074 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:20:56.927901  4141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:20:56.929016  4141 raft_consensus.cc:606] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:56.929418  4141 raft_consensus.cc:614] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:56.855832 10031 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.929726  4145 raft_consensus.cc:1240] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:56.933943  4146 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:56.938839  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.946486  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:56.868960  9943 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.965021  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:56.905454  9858 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:56.971989  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:56.928328  9802 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:56.985564  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:20:57.004815  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.005182  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.001893  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:57.011009  4288 raft_consensus.cc:1240] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:57.029678  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:56.963740  9999 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:56.967262 10064 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.002184  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.038659  4146 raft_consensus.cc:2410] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:20:56.998539 10137 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:56.938092 10057 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.000463 10148 ts_tablet_manager.cc:1916] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:56.923372 10086 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.053907  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.054735  4146 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:20:57.003433 10092 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:56.998155 10095 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.056785  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:57.060742  4288 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
W20260709 13:20:57.059201  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 262874us
I20260709 13:20:57.067791  4110 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:57.070178  4293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:20:57.044658 10124 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.092839 10124 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.095487 10124 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.044432 10074 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.052239  9766 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:57.076282  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 210639us
W20260709 13:20:57.064065 10104 consensus_meta.cc:287] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.595s	user 0.018s	sys 0.000s
I20260709 13:20:57.052464 10137 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:57.085453  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.086191  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.045575 10064 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.129041 10064 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.115393  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.131564  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.099520  9952 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:57.049355  9999 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.089543 10061 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.066197 10092 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.141403  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.138986  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:57.159621  4219 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:20:57.160916  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:57.145311  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:57.096355 10074 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.067029 10095 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.163205  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:57.164475  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:57.141104  9900 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:57.130445  9548 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:57.172955  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.112265  9766 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.140317 10023 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:57.219703  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.198498 10137 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.223651  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.199780  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:57.154471 10124 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:57.209440  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.168207 10064 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.097541  9802 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.135015 10104 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.226034  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:57.243330  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:57.253086  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:57.254642  4142 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:57.251147  4214 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:57.267594  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:57.223501 10031 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.275753  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:57.278578  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:57.233227 10137 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.240620  9838 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:57.292635  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:20:57.296895  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 162524us
I20260709 13:20:57.217833  9900 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.291787  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.308301  4147 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:57.312546  4259 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:57.312668  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.326380  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.329473  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.331910  9766 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.226789 10023 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.273277 10160 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.274325  9943 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.238431 10064 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.223085  9548 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:57.339813  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.280748  9858 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.286304 10031 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.239002 10124 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.283353 10158 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.367424 10166 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.434686 10166 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.437351 10166 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:57.437952  9999 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:57.438128 10166 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:57.438983  9999 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:57.439049 10166 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.336576  9900 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:57.368000 10155 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:20:57.370932 10023 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:57.371743  4146 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:57.371846  9548 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:57.374406 10064 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.375018  9943 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.442775  9943 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.445868  9943 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.356808 10074 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.383311  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.448369  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.450093  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.451095  4147 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 17: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:57.452143  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.453248  4147 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:20:57.454416  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.386421  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.460098  4147 raft_consensus.cc:2368] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:20:57.429598  4221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54764 (request call id 932) took 1178 ms. Trace:
I20260709 13:20:57.305120 10137 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.432132  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.461352  4221 rpcz_store.cc:276] 0709 13:20:56.250704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.250841 (+   137us) service_pool.cc:224] Handling call
0709 13:20:56.251215 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.492230 (+241015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.492594 (+   364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:56.492679 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:56.492740 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.429277 (+936537us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54001f7f54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:57.429333 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.429522 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553506560}
I20260709 13:20:57.457301 10166 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:57.383576  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 120479us
I20260709 13:20:57.458178 10031 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.470950  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:57.482133 10067 consensus_meta.cc:287] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.005s
I20260709 13:20:57.484300 10092 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.380694 10085 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.488555  4927 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:57.489899 10162 consensus_queue.cc:1059] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:57.488723  4287 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:57.490221  9924 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.491395  9924 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.466979 10158 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.492033 10162 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:57.493225  9838 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:57.493631  9838 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:57.494526 10158 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.494609  9838 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.389528 10160 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.496594  4187 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:57.480090 10031 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:57.498270 10135 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:57.499367 10160 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.501530  4187 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:57.479637 10124 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:57.477402  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.504781  4139 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:20:57.506207  4139 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:20:57.463857 10102 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.007s
I20260709 13:20:57.505394  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:57.506837  4142 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
W20260709 13:20:57.521173  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 214528us
I20260709 13:20:57.510463  4139 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:57.521680  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.526170  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.527472  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.529219  4213 raft_consensus.cc:2410] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:20:57.475936  9943 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:57.488173 10085 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.536299  4293 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:57.537740  4293 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:57.539599  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:57.540030  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 227574us
I20260709 13:20:57.543192  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.544278  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:57.507895 10135 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:57.558656  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:57.562470  4290 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:57.528434 10124 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:57.527271 10083 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.577137  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:57.565774  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.557407  4185 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:57.566442  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:57.580682  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:57.578008  4288 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:57.588953  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:57.567849  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.594998  4292 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:57.571373 10166 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:57.557622  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:20:57.575601  4296 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:20:57.557114  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:57.587065  4293 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.601167  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:57.607281 10074 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:57.608836 10119 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.609465 10119 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.612008 10119 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.618284 10057 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.620750  9953 raft_consensus.cc:3055] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:57.624518  9953 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:57.622187  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:57.626741  4288 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
I20260709 13:20:57.622769  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:20:57.621255 10165 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:20:57.625559  9953 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.646327  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:57.646843 10104 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.647187  9953 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:57.650059 10097 consensus_meta.cc:287] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.007s
I20260709 13:20:57.646041 10123 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:57.651608 10123 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:57.652678 10072 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:57.656601 10119 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:57.657234 10119 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.657919 10119 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:57.572780 10124 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.660904  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:57.558368 10160 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.645859 10158 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:57.559401 10164 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:57.565176 10092 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.665493  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.577854 10085 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.674599  4925 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:57.553715  9943 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.687543  4290 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:57.698921  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:57.667711 10124 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.661553 10173 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:57.712926  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67056.9us
I20260709 13:20:57.591428 10083 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.656150 10072 consensus_queue.cc:1059] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:20:57.678848 10160 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.742844  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.705081 10067 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:57.714068 10173 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:57.740916  9924 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:57.682693 10092 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.690447 10085 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:57.763269  9943 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:57.765972 10083 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.775959 10137 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.778941 10160 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:20:57.758790 10173 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.787761 10052 raft_consensus.cc:3055] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:57.788533 10052 raft_consensus.cc:740] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:57.789928 10052 consensus_queue.cc:260] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.794646 10085 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.751633 10067 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:57.801731 10067 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:57.876689  4215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.035s
W20260709 13:20:57.878010  4215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.014s	sys 0.036s
I20260709 13:20:57.878321  4140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2942) took 1015 ms. Trace:
I20260709 13:20:57.881541  4215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 2457) took 1089 ms. Trace:
W20260709 13:20:57.888165  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 241729us
W20260709 13:20:57.893116  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 252634us
I20260709 13:20:57.894528  4288 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:57.894133  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:57.896770  4289 raft_consensus.cc:2368] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18.
I20260709 13:20:57.879096  4140 rpcz_store.cc:276] 0709 13:20:56.862413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.863367 (+   954us) service_pool.cc:224] Handling call
0709 13:20:56.863779 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.910358 (+ 46579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.910391 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:56.910431 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:56.910468 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.877454 (+966986us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b5400021cd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:20:57.877551 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.878077 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106570112}
I20260709 13:20:57.903074  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.904908  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.906265  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:57.906333  4920 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:20:57.910418  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:57.918320  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:57.763870 10092 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.920243  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:57.882589  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:57.935237 10112 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:57.940249  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.941979  4147 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:20:57.923110  9999 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:57.937800  4891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.947821  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:57.952193  4145 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.963395  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.963789  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:57.882223  4215 rpcz_store.cc:276] 0709 13:20:56.790233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.790374 (+   141us) service_pool.cc:224] Handling call
0709 13:20:56.790779 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:56.799707 (+  8928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.799776 (+    69us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:57.374188 (+574412us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b2c00010988. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3d5dba11 00007fee3d5eb372 00007fee3ed1da01 00007fee3ece243a 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2
0709 13:20:57.374919 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 13:20:57.878993 (+504074us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:57.879119 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.879269 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:57.879344 (+    75us) raft_consensus.cc:1685] finished
0709 13:20:57.879358 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.879845 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":617,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6639,"spinlock_wait_cycles":19630336,"thread_start_us":503198,"threads_started":1,"wal-append.queue_time_us":361972}
W20260709 13:20:57.967118  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 338949us
I20260709 13:20:57.977176  9999 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:57.982733  9999 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:57.985566  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.986225 10095 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:57.986523  9999 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:57.991847  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.000416  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.012310  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:58.007515  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.023981  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.029507  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:58.029860  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.030637  4220 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.033706  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.036109  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:58.037235  4139 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.037403  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.038713  4143 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:58.048300 10171 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.049443 10171 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.034536  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.058467  4213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2456) took 1269 ms. Trace:
I20260709 13:20:58.059096  4213 rpcz_store.cc:276] 0709 13:20:56.788883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.790052 (+  1169us) service_pool.cc:224] Handling call
0709 13:20:58.057829 (+1267777us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400216454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:58.058140 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664738560}
I20260709 13:20:58.061045  4287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46846 (request call id 3323) took 1240 ms. Trace:
I20260709 13:20:58.061623  4287 rpcz_store.cc:276] 0709 13:20:56.820540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.820713 (+   173us) service_pool.cc:224] Handling call
0709 13:20:58.060542 (+1239829us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540042aed4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:58.060802 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533304192}
I20260709 13:20:58.062992 10182 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:58.063436  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.064018 10182 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.063948  9838 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:58.069798  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.070793  4216 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:58.073966  9831 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:58.074991  9831 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.076076 10052 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:58.076750  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.078248 10112 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:58.078805 10112 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:58.080463  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:58.082331  9831 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.085343  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.089874  4293 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:58.090778  4293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:46846 (request call id 3337) took 1023 ms. Trace:
I20260709 13:20:58.091194  4293 rpcz_store.cc:276] 0709 13:20:57.067468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.070020 (+  2552us) service_pool.cc:224] Handling call
0709 13:20:57.999030 (+929010us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54002d5fd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ecd9a3d 00007fee43ca9cd0 00007fee3d22e254 00007fee3d22e1e2 00007fee3d22e111 00007fee3d22e08c 00007fee3d22d342 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:20:58.090651 (+ 91621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020779776}
I20260709 13:20:58.050602 10123 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.091920 10182 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.099864  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.083163  9953 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:58.125873  9953 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.118920  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.104588 10182 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.106706  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.106972  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:58.106122  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.107265  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.108351  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.112882 10171 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.113561  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:58.114674  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.082491  4186 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.117744  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.119541  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.120146  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.125013  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.102382 10123 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:58.116310  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52134 (request call id 2950) took 1187 ms. Trace:
I20260709 13:20:58.138015  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.139036  4214 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:58.141007  4216 raft_consensus.cc:2410] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:58.141804 10135 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.142334  9953 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:58.146999  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47564.7us
I20260709 13:20:58.147930 10081 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:58.142382 10182 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.154266  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:58.157037  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.160235  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.177862  4139 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:58.169312 10173 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.178224  4145 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:58.185120  4220 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:20:58.193605  4215 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
W20260709 13:20:58.194680  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 81397.2us
I20260709 13:20:58.195147  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.197636 10085 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.198575 10085 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.201553 10095 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:58.202612 10182 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.203892  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.204815  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.187104  9999 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:58.205793  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 123622us
I20260709 13:20:58.205801  9999 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.207901 10088 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:58.210204  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.211093  4219 raft_consensus.cc:2468] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:58.212661  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.193295  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.217240  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:58.156864 10119 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.219373  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.219751  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.221465 10088 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:58.226648  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.179143  4141 rpcz_store.cc:276] 0709 13:20:56.945361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.946220 (+   859us) service_pool.cc:224] Handling call
0709 13:20:56.983119 (+ 36899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:56.983664 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.983705 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.984389 (+   684us) log.cc:844] Serialized 26 byte log entry
0709 13:20:58.009123 (+1024734us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18002eb580. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbd7e07 00007fee44a32ab9 00007fee3bbf469b 00007fee3bbf293f 00007fee3bbf4c02 00007fee3e87c20b 00007fee3e881d23 00007fee3e8820d1 00007fee3ec9da0f
0709 13:20:58.115201 (+106078us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:58.115291 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:58.115422 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:58.115491 (+    69us) raft_consensus.cc:1685] finished
0709 13:20:58.115516 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:58.115982 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":10142,"spinlock_wait_cycles":29605120,"thread_start_us":14934,"threads_started":1,"wal-append.queue_time_us":1124243}
I20260709 13:20:58.229852 10177 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.230715 10177 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.234925  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.240274  4928 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:20:58.240553 10095 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:58.240945  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 44610.5us
I20260709 13:20:58.223487  9999 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:58.241672  4185 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:58.255106  4216 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
I20260709 13:20:58.236457 10088 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:20:58.265012 10088 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:58.248138 10135 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.270453  4216 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:58.275074 10085 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:58.275707 10148 ts_tablet_manager.cc:1929] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.7
I20260709 13:20:58.275228  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.283571  9886 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:58.294778  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.298592 10119 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.300251  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.301040  4214 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:20:58.301612  4214 pending_rounds.cc:85] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 7
I20260709 13:20:58.301903  4214 pending_rounds.cc:107] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:20:58.302219  4214 raft_consensus.cc:2889] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:58.303856 10135 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.304872  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.306406  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.307013  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:58.307760  4288 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.303872  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:58.309072 10124 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.017s
I20260709 13:20:58.309315  4289 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:58.309645 10124 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.308053  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.310895  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:58.310992  4294 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:20:58.312716 10177 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:58.269316 10088 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:58.314621 10088 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.304716  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.316934  4217 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 18: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:58.316937  4222 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:58.287205 10112 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.320472  9726 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:58.320990  9726 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.321367  9726 raft_consensus.cc:3060] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.321637 10112 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 22 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.282012  4112 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:20:58.335561  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:58.333774 10135 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.312074 10124 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.327467 10088 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:58.342581  4185 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:58.348904  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 247187us
I20260709 13:20:58.346735 10135 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.360445  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:58.361826 10135 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:58.362682  9548 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:58.364463  9568 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.365159  9568 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:58.366815  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 153514us
I20260709 13:20:58.368185  9568 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.363430  9548 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.368844  4112 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.369319  4259 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:58.370865  9548 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:58.371589  9900 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:58.372119  9900 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.372604  9900 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.344400 10148 log.cc:1199] T a35e1cee8a15436dbfaf75dd67824aad P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/a35e1cee8a15436dbfaf75dd67824aad
I20260709 13:20:58.389420  4288 raft_consensus.cc:2468] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 16.
I20260709 13:20:58.400653  9775 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 13:20:58.401268  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 119545us
I20260709 13:20:58.393891  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:58.393350  9548 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:58.414281  4892 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:58.402084 10173 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:58.403367 10182 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:58.401695 10177 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.401700 10085 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:58.412025  9568 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:20:58.409190  9999 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:58.437939  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:58.443126  9888 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.443979  9888 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.446585  9888 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.407971  9726 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.449870  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:20:58.458253  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 89592.7us
I20260709 13:20:58.429976  9999 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.421900 10052 raft_consensus.cc:2804] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:58.441607 10148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56112 (request call id 0) took 1654 ms. Trace:
I20260709 13:20:58.423141 10095 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
W20260709 13:20:58.471460  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 130517us
I20260709 13:20:58.462639  9886 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.462963  9999 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:58.420776  9775 consensus_queue.cc:1243] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:58.481094  4112 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.461560 10177 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.484779 10177 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:58.481117  9886 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.471510 10173 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:58.487388  9886 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.492645  4111 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:58.496780  9948 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:58.497459  9948 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:58.498721  9948 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.500597  9952 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:58.500861  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 85550.8us
I20260709 13:20:58.468937 10148 rpcz_store.cc:276] 0709 13:20:56.766233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.766485 (+   252us) service_pool.cc:224] Handling call
0709 13:20:56.823089 (+ 56604us) ts_tablet_manager.cc:1151] Deleting tablet a35e1cee8a15436dbfaf75dd67824aad
0709 13:20:56.823197 (+   108us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:20:57.938662 (+1115465us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:58.168293 (+229631us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:58.417110 (+248817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":54935,"thread_start_us":42298,"threads_started":1}
I20260709 13:20:58.501349  9952 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.502916  4261 leader_election.cc:400] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:20:58.503265  4261 leader_election.cc:403] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:58.507889  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.471167 10052 raft_consensus.cc:697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 16 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:20:58.511113  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:58.511534 10052 consensus_queue.cc:237] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.512187  9726 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:58.513909  4111 leader_election.cc:400] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18.
I20260709 13:20:58.516722  4111 leader_election.cc:403] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:58.512513  4928 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:20:58.518841 10125 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:58.519635  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:58.521413 10135 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:58.521896 10135 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:58.522293 10135 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:58.504098  9952 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:58.499889 10061 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:20:58.529520  9568 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18.
I20260709 13:20:58.536172  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.538791  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet a35e1cee8a15436dbfaf75dd67824aad (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:20:58.539402  4290 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:58.540388  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.538825  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:58.541285  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.516469 10173 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
W20260709 13:20:58.546056  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 75250.1us
I20260709 13:20:58.546893  4110 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:58.550221  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:58.554152  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:58.556244  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:58.557230  4213 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:20:58.557547  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.558529  4296 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:58.527583 10124 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.560285  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.561005  4289 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:58.563186 10092 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.563970 10092 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.565975 10135 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.568894 10135 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:58.572073  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.552949  4291 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
W20260709 13:20:58.572417  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 45940.5us
I20260709 13:20:58.582458  4290 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:58.552883 10061 consensus_queue.cc:1243] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:58.583423 10124 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.586411 10124 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.582139  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:58.553552  9726 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:58.594722 10124 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:58.582314  9895 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:58.602382  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.603847  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.608618  9568 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:58.587345  9999 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.606104  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:58.569919  9900 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.604465  9895 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.616106  9895 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.602128 10061 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:20:58.620774  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 83634.9us
I20260709 13:20:58.615589  4295 raft_consensus.cc:2393] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
W20260709 13:20:58.624879  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52897.2us
I20260709 13:20:58.628553 10085 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.629383 10085 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.631783 10085 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:58.631474 10173 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:58.638046 10160 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:20:58.639102  9568 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.642987  9900 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.639784  9568 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.645658  9568 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.619800 10061 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.648618  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:58.651154  4928 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:58.624470 10092 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:58.610651  9726 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.652240  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:58.653812  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:58.654444  9726 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:58.646977  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76383.7us
I20260709 13:20:58.627226  4290 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:20:58.664645  4186 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:20:58.666759  4185 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:20:58.670557 10124 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:58.671085 10124 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:58.671710 10124 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:58.670987  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:58.673331 10120 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:58.673856 10120 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:58.674311 10120 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.678970  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.681874  9548 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:58.682637  9548 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:58.683367 10182 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:58.667157  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.671152  4111 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:20:58.692495 10200 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.172s	user 0.004s	sys 0.000s
I20260709 13:20:58.693943  9568 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:58.698503  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:58.699550 10182 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:58.700047 10182 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.700461 10182 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.703433  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:58.705250  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:58.690088  9886 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:58.708994  9886 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.709877  9886 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:58.709034  9548 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.711086  9548 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.712757  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.714442 10112 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:58.714980 10112 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.715368 10112 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:58.716724  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.707772  4186 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:58.720060  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.721954 10135 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:58.722605 10135 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.722987 10135 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:58.728050  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:20:58.728533  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 68423us
I20260709 13:20:58.728464  9726 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:58.736855  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.743270  9895 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:20:58.743930  4187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:58.729496  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:58.752810  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.782480  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.791199  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:58.796586 10061 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:58.800805  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.800805  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:58.801041  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:58.804629  4143 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:58.750345  9948 raft_consensus.cc:2764] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:20:58.801923  4140 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:20:58.813112  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.747996  9999 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:20:58.817369  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 157657us
I20260709 13:20:58.779027  9838 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:58.833333  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 64362.1us
I20260709 13:20:58.813963 10171 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.839991  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.836992  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.840922  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.837895  4288 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:58.838228  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.842988  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.843123  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.815795  9726 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.785948 10120 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.830715  9838 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.859288  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.855808  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.836292 10061 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:58.863685  4295 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 17: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:58.864746  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.863957 10061 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.866073  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:58.866719  4295 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.860764  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.869956  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.870814  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.839982 10160 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:58.873351  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:58.869306  4144 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:20:58.876124  4140 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:58.877731  9895 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:58.878985  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:58.881767  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:58.857887  9726 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.886232  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:58.887660  4139 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
I20260709 13:20:58.888473  4291 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:20:58.856616 10171 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.889150  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:58.896929 10124 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.899161  9548 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.874523  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.915513  4147 raft_consensus.cc:2393] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:58.883824  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.869447  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:20:58.913836 10203 log.cc:927] Time spent T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:20:58.908115  4138 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:20:58.886842  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:58.915306  4143 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:20:58.872486  9838 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.925771  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:58.910167 10160 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.921236  9900 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:58.948586  4288 pending_rounds.cc:85] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 8
I20260709 13:20:58.935426  9952 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:20:58.942742  9726 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.946938  4293 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:58.949066  4288 pending_rounds.cc:107] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:20:58.956094  4288 raft_consensus.cc:2889] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:58.949359  9568 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:58.955507  9900 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:58.961764  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 105393us
I20260709 13:20:58.961992  9952 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:58.968858  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:58.949359 10160 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.952099  9548 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:58.999359 10214 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.002818  9997 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:59.006307  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 137934us
I20260709 13:20:59.014894  9900 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:59.021078 10088 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.001s
I20260709 13:20:58.983520  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:58.980904  4112 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.978044  9999 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:58.993762  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:58.962647  9726 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:58.994195 10171 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.015547 10112 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.016408  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:20:58.988590  9952 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:59.007777  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:59.030406 10085 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:59.026532  4295 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:20:59.036257  9886 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:59.039083  9886 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:59.040261  9952 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:59.040464  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59714.2us
W20260709 13:20:59.042069  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48526us
I20260709 13:20:59.043081  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:59.044471  9726 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.045821 10067 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:59.046811 10067 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.046978  9726 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:58.973559 10061 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:20:59.051360 10124 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.050973 10160 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:59.054689  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47097.2us
I20260709 13:20:59.054873  4112 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.055751  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:59.071329  4112 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.070493  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:59.072186  4261 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:59.073505 10067 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:59.074143  9999 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.074487  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.075417  4289 raft_consensus.cc:2393] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:59.075946 10120 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.078744  4289 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:59.078223  9775 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:59.074100  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:59.084254 10182 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.085139 10125 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:59.056680 10085 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:59.086665 10182 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.088089 10125 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:59.097245 10160 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:59.073864  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:59.098942  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.068873 10061 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:59.109283  4893 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.110057 10112 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:59.110313  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 43488.9us
I20260709 13:20:59.110548  9895 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:59.110944 10085 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:59.111708  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:59.111660 10085 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.081671  9548 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.114228  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:59.114748  9900 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:59.115217  4222 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:20:59.116091  4213 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:59.116851 10160 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:59.135612  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 261183us
I20260709 13:20:59.115160 10085 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:20:59.149325  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 75456.1us
I20260709 13:20:59.142671  4111 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:59.172885  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:59.176998  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:59.179080  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:59.180567  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.180696 10085 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:59.181808  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:59.182924  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:59.183696  4295 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:20:59.179100  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:59.185133  4222 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:59.172187  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:20:59.187364 10125 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.183274  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:59.192013 10160 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.131654  9997 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:20:59.193805  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:59.193961  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:59.194593  4287 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:59.132052 10182 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.198534  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:59.214643  4220 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:20:59.169286  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.210199  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.217350  4222 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:20:59.215960  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:59.220587  4291 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:59.222209  4289 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:59.150069  9948 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:59.227825  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:59.239768  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:59.240357  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.243752  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:59.201776  9952 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:59.184105 10135 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.219700 10120 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.252575  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:59.225826 10182 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.260998  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.261956 10182 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.262629  4187 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:59.263943  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 70115.3us
I20260709 13:20:59.265002  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:59.265121  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:20:59.247514  9726 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:59.290026  4215 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:59.297463  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:59.267339 10088 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.303458  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.308646  4294 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:20:59.312999  4213 raft_consensus.cc:2368] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15.
I20260709 13:20:59.274142 10119 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:59.321501  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:20:59.290472 10211 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.291240  9726 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:59.294592 10160 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:59.334035  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.338480  4222 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:59.341333  4215 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:20:59.351203  9726 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.295874 10173 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:59.355033  4215 pending_rounds.cc:85] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 8
I20260709 13:20:59.372910  4215 pending_rounds.cc:107] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:20:59.373282  4215 raft_consensus.cc:2889] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:59.359555  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.278558 10120 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:59.367406  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 226461us
I20260709 13:20:59.367306  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:59.378803  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.381486  4287 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
W20260709 13:20:59.382606  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 67551us
W20260709 13:20:59.395427  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 85090.5us
I20260709 13:20:59.402853  4186 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:59.409003  4214 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:59.412022  4186 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:59.311826  9948 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.382344 10212 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.451188 10123 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:59.457352 10223 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:59.483193 10223 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:59.485839 10223 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:59.400226 10173 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:59.483426  9999 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:20:59.490878  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 112203us
I20260709 13:20:59.493166 10230 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:59.494398 10217 log.cc:927] Time spent T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:59.495378 10120 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.417625 10085 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:59.418253 10213 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:59.481884  9888 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:59.457438  9948 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.505745  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:59.509868  4214 raft_consensus.cc:1275] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:59.513581  4291 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:59.466560 10061 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:20:59.503010  9952 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:20:59.524641 10213 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:59.524832  9888 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:59.555279 10085 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:20:59.559609 10123 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:59.518041  9999 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.575572  9888 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.591212 10221 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:20:59.596572 10221 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:59.597518 10119 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:20:59.598189 10119 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:59.606027 10221 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.573652 10135 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.571599 10213 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:59.594404  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 88794.6us
W20260709 13:20:59.616176  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 92629.2us
W20260709 13:20:59.588032  9838 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.005s
I20260709 13:20:59.627532  4112 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:20:59.660950  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 69520us
I20260709 13:20:59.621942 10173 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:59.665957  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 250959us
I20260709 13:20:59.673375  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.674168  4287 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:20:59.683022  4186 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:59.630262  9838 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.684782  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:20:59.688921  4294 raft_consensus.cc:1240] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:59.688493 10123 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:59.706947  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:20:59.625892  9952 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:20:59.710278  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 296558us
W20260709 13:20:59.712067  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 84666.6us
I20260709 13:20:59.728555  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:59.712891 10224 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:59.713380  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 83803.8us
W20260709 13:20:59.714658  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 75259.5us
I20260709 13:20:59.716041 10226 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.756920  4213 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:20:59.710001 10182 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:59.760159  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.770128  4112 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:20:59.771190  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.783229  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:59.785717  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:59.788247  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.789266  4140 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:20:59.790596  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.745927  9886 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:59.782670  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.807874  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.722344 10223 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.814215 10223 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.772500 10226 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.817458 10226 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:59.818138 10182 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:59.819276 10182 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.820405 10234 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.820863  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.778702 10088 consensus_queue.cc:1059] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:20:59.822064  9838 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:20:59.822816  9838 raft_consensus.cc:3055] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:59.823228  9838 raft_consensus.cc:740] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:20:59.823740  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.825394  4112 leader_election.cc:400] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15.
I20260709 13:20:59.825721  4112 leader_election.cc:403] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:59.769464 10135 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:20:59.832834 10135 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.835250 10135 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:20:59.836019  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49983.2us
I20260709 13:20:59.837261  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:20:59.846710  4144 raft_consensus.cc:2393] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 15: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:20:59.847920  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.849359  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.848724  4142 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:20:59.809700  9886 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:59.870919  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.806077 10061 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.836728  9775 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:59.876782  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:20:59.877372  4920 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:59.879913  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.796500 10214 consensus_queue.cc:1059] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:20:59.885200  4140 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
W20260709 13:20:59.868609  4261 connection.cc:256] RPC call timeout handler was delayed by -1.2519979380001587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:20:59.868772 10212 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:59.890115  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:20:59.899632  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:20:59.900246  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.900998  4142 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:59.873553 10223 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:59.876048  9886 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:59.907160  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 72966.1us
I20260709 13:20:59.908433  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:20:59.824033  9838 consensus_queue.cc:260] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:20:59.779641 10085 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:20:59.842348 10233 consensus_queue.cc:1059] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:20:59.887130  9999 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:20:59.922333  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:20:59.878434 10230 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:20:59.973129  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:20:59.874447 10234 consensus_queue.cc:1059] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:21:00.004438 10236 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.917577 10088 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:59.886574 10119 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:00.006211 10241 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.004662 10225 consensus_queue.cc:1059] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
W20260709 13:21:00.009935  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 75496.9us
W20260709 13:21:00.010354  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 65430.9us
I20260709 13:21:00.050163  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:20:59.935209 10135 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:00.051332 10135 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:00.051783 10135 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:00.028590  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 98051.6us
I20260709 13:21:00.029734  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:00.004280 10239 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:00.062449  4919 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:00.022290  9838 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:00.014709  9999 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.109634  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.108763  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:00.119642  4290 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
W20260709 13:21:00.125949  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 190853us
I20260709 13:21:00.062968 10239 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:21:00.152688  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 124379us
I20260709 13:21:00.154173  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:00.157214  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 95308.4us
I20260709 13:21:00.151724 10239 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:00.151440 10245 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:21:00.168898  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 116889us
I20260709 13:21:00.056208 10241 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.173954  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:00.194747  9888 consensus_meta.cc:287] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.573s	user 0.001s	sys 0.009s
I20260709 13:21:00.195284  9888 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.197733  4142 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:00.201747  9888 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.209321  4920 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:00.229743  9999 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:00.228222 10206 log.cc:927] Time spent T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:21:00.302131 10263 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:00.303026 10256 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:21:00.310070  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 251041us
W20260709 13:21:00.313241  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 139360us
I20260709 13:21:00.320024  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:00.320693  4139 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:21:00.324597  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:00.317807  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:00.327903  4290 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 17: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:00.331694  9948 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:21:00.332310  9948 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:00.340842  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:00.339025  9948 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:00.342252  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:00.343410  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:00.343982  4145 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:00.348549  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:00.355566  4291 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:00.345052 10233 consensus_queue.cc:1059] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:00.360852  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:00.345745 10241 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.354737  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:00.365865  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:21:00.334414  9726 consensus_meta.cc:287] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.939s	user 0.009s	sys 0.004s
I20260709 13:21:00.376932  9726 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.378234  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:21:00.333292 10252 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:21:00.383900  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:00.379451  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:00.220866 10243 consensus_queue.cc:1048] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.347s
I20260709 13:21:00.400754 10234 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:00.401472 10234 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.403137 10266 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:00.403785 10234 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.404248 10266 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.389473  4143 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:00.395787  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.397519  9726 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:00.412760 10260 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:21:00.417456 10235 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:00.308408  9999 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:21:00.424252  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.425990  9568 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:21:00.442658  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67642.3us
I20260709 13:21:00.449823  9568 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.451749  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:00.448565  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:00.457810  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:00.460170  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.460433 10266 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.461565  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.462487  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.462800  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:00.463653  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:00.448845  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.464237  4288 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:00.466063  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.468164  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:21:00.470685 10213 consensus_meta.cc:287] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.009s
W20260709 13:21:00.471508 10223 consensus_meta.cc:287] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
W20260709 13:21:00.516383  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49979.8us
I20260709 13:21:00.426653 10124 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.472858  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.477056  4290 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:00.477454 10235 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:00.425081  9895 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:00.478590  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:00.478758  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 47454.4us
I20260709 13:21:00.479516  4217 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:00.366714 10135 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:00.496574  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:00.497454  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.510457  4213 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 16: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:00.538213  9568 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.461603 10125 raft_consensus.cc:3055] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:00.575403  4218 raft_consensus.cc:2468] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:00.517915  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.598641 10125 raft_consensus.cc:740] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:00.599892  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.538218  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:00.538538  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57437.4us
W20260709 13:21:00.562711  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 111074us
W20260709 13:21:00.523792  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58458.6us
I20260709 13:21:00.554747  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:00.605584  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 87815.3us
I20260709 13:21:00.586083  4288 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:21:00.608981  4187 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.524313 10253 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:00.613773  4219 raft_consensus.cc:2368] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19.
I20260709 13:21:00.616885  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:00.617831  4139 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:21:00.620867  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:00.623169  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.611789 10225 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:21:00.549674  9886 consensus_meta.cc:287] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:21:00.510545 10171 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:00.628185  4222 raft_consensus.cc:1240] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 17. Current term is 18. Ops: []
W20260709 13:21:00.562083 10254 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.545s	user 0.005s	sys 0.000s
I20260709 13:21:00.626979  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:00.626580  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.520402 10276 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:00.630097  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:00.523895 10223 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15.
I20260709 13:21:00.624384  4220 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:21:00.633035  4218 raft_consensus.cc:2393] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 22: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:00.564728 10241 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:00.630276  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.624966  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:00.553201 10235 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:00.522857  9999 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:21:00.642532  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.645387  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.667783 10119 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.668787  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.669014 10112 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.671006  4187 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.671653 10235 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:00.672380 10112 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.528761 10124 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.674777  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.675040 10124 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.633316 10253 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.678061  4140 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:00.678524 10253 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.679847 10112 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:21:00.681818  9999 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.682482  9999 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.685151  9953 raft_consensus.cc:3055] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:00.685653  9953 raft_consensus.cc:740] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:21:00.686167 10239 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.003s
I20260709 13:21:00.686837 10239 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.652865  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:00.599776 10125 consensus_queue.cc:260] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.654112 10238 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.654891 10278 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.655915  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.656318  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.658675 10241 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:00.706336 10241 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:00.708767 10238 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.711669 10238 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.712886 10125 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:00.640539 10225 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.634920  9886 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.718135  4216 raft_consensus.cc:2368] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16.
I20260709 13:21:00.718438 10225 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.719556  4925 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:00.703927 10229 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:00.641904 10276 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:00.642100 10171 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.622534 10123 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:00.664404 10120 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:21:00.667733  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.647540 10261 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:21:00.538034  9895 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.648253 10215 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:00.621461 10214 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:00.808414 10214 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.697068  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:00.811127  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 114163us
I20260709 13:21:00.811450 10214 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.703706  4214 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:00.698071 10278 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.521868 10213 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:00.730674  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 87066.7us
I20260709 13:21:00.731582 10247 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:00.758473 10229 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:00.734550  9999 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:00.739091  9838 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:00.721055  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:00.687023  9953 consensus_queue.cc:260] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:00.725471  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.734225  9900 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:00.856767  9900 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:00.858002  9900 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.858868  9948 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:00.755091  4919 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:00.862203  9999 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:00.756521  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.724423 10135 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:00.759805  4217 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:21:00.766820  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.773304  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.777580  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.780470  4186 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:00.793627  4287 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:00.801307  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.805693  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:00.734058  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.778205 10276 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:00.877822  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.881879  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.828873  9886 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.830964  4139 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:21:00.833510 10278 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.838327 10213 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.841518  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.842295  4213 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:21:00.844754  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:00.823324 10247 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:00.855726 10222 consensus_queue.cc:1059] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
W20260709 13:21:00.867594  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 87245.4us
I20260709 13:21:00.905030  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.875180 10123 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:00.860128  9900 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:00.886133 10238 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:21:00.892789  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 111153us
I20260709 13:21:00.896588  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.910403  4217 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:21:00.899142  4214 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:21:00.903474  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:00.886546 10214 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.886694  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:00.914609  4214 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:00.914937  4112 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:00.869989 10211 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:21:00.888849  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.917852  4214 raft_consensus.cc:1240] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:21:00.902447  9895 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.904989 10248 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:00.927585  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83018.1us
I20260709 13:21:00.931087 10123 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 17 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:00.904974 10247 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:00.933108  4214 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:00.935500  4220 raft_consensus.cc:1240] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:21:00.922979 10241 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:00.936635 10266 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:21:00.961838 10123 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:00.964015 10239 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.947162 10251 raft_consensus.cc:3055] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:00.954157  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:00.986546  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:00.955054  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:00.987510  4292 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:00.988073 10248 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:00.956298 10229 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:00.989238  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:00.987301  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:00.990473  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:00.956864  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:21:00.958277 10283 log.cc:927] Time spent T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:21:00.958899 10072 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.959404 10171 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:00.928830  9953 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:00.995644  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:00.996515  4219 raft_consensus.cc:606] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.996855  4219 raft_consensus.cc:614] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:00.998098 10085 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.998847 10085 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:00.999662  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 85067us
I20260709 13:21:01.000069  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:01.002005 10223 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:00.986574 10251 raft_consensus.cc:740] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:21:01.001297  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:00.986577  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:01.007345  4292 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
W20260709 13:21:01.041816  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.036253  4186 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:00.998880 10238 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:01.005365 10251 consensus_queue.cc:260] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:01.080801 10238 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.081389 10251 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:01.081620 10224 raft_consensus.cc:3055] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:01.082182 10224 raft_consensus.cc:740] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:01.082779 10223 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:01.083101 10224 consensus_queue.cc:260] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:01.063081  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 63087.6us
I20260709 13:21:01.084581 10235 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:01.077206  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 154564us
I20260709 13:21:01.088042 10214 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:01.088724 10214 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:01.089845 10214 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.014688 10248 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:01.096171 10248 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:01.096729 10248 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:01.101284 10223 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:01.102475 10223 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.103179 10229 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:01.078845  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 77661.5us
I20260709 13:21:01.073841  4219 raft_consensus.cc:1240] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:21:01.085839 10224 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:01.085843  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:01.110808  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:01.123737  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:01.124733  4143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:01.125489  4143 raft_consensus.cc:606] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.125890  4143 raft_consensus.cc:614] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:21:01.126484  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 314341us
I20260709 13:21:01.129503  9568 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:01.131891  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.133383  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:01.136207  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50468.4us
I20260709 13:21:01.115770  9999 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:01.137004  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:01.137212  9568 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:01.100020 10276 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.128659 10235 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:01.141628 10061 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:01.147914 10173 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:01.149333  4221 raft_consensus.cc:2393] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 20: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:01.152490 10277 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:01.157105  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:01.163589  9568 consensus_queue.cc:1059] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:01.172534  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:01.175450  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:01.156706 10235 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.156131 10276 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:01.169023  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.187616  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.160408 10277 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.178455 10278 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:21:01.185387 10173 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:01.174350  9900 raft_consensus.cc:3055] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:01.190626 10235 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:01.176327 10085 raft_consensus.cc:476] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 13:21:01.188927 10225 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:01.193162  9895 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:01.216241 10085 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:01.226588  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:01.198617 10277 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:01.208307 10173 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:01.196113 10244 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:21:01.209015  9900 raft_consensus.cc:740] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:01.244829  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:01.244818 10173 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:01.232252 10247 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:01.292133  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 62804.2us
W20260709 13:21:01.299271  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 123851us
I20260709 13:21:01.304106  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:01.306381  4221 raft_consensus.cc:606] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.307021  4221 raft_consensus.cc:614] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:21:01.302876  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 107826us
I20260709 13:21:01.309639  4139 raft_consensus.cc:1240] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:01.312049  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:01.312003  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
W20260709 13:21:01.317209 10293 log.cc:927] Time spent T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:21:01.333033  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:01.333863  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:01.335299  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:01.339244  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:01.339576  4142 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:01.334638  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:01.347078  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:01.349084  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:01.351774  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:01.351774  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:01.351567 10298 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:21:01.359311 10298 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:01.359715 10298 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:21:01.357606  4112 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.291755  9900 consensus_queue.cc:260] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.363209  4139 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:01.356751  9999 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:01.365293  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:01.368227  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:21:01.370738  4892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.379884  4219 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:01.336613 10085 raft_consensus.cc:2764] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:21:01.387063 10248 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.390239  4222 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 21. Current term is 22. Ops: []
W20260709 13:21:01.391238 10296 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:21:01.393298  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:01.393973  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:01.394130  4222 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:21:01.394833  4215 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:01.396028  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:01.399297 10247 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:01.405243  4222 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:01.411561  4217 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:21:01.412398  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
W20260709 13:21:01.417128  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59624.6us
I20260709 13:21:01.419035 10171 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.415220  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.424865  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:01.427872 10272 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:01.428577 10272 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:01.427915  4142 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
I20260709 13:21:01.429824 10279 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:01.430305 10279 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:01.431061 10272 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:01.431303 10279 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.432720  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:01.434046 10225 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:01.434636 10225 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:01.437608  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:01.438616  4217 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:01.442440  9948 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:01.442515  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.457592  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:01.458504  4142 raft_consensus.cc:606] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.458943  4142 raft_consensus.cc:614] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:01.465687  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:01.469976  9900 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:01.476626 10244 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:01.480315 10278 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:21:01.470746 10297 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.130s	user 0.003s	sys 0.001s
W20260709 13:21:01.471411  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 63862.3us
I20260709 13:21:01.480888 10278 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.484794  4142 raft_consensus.cc:606] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.488684  4140 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:21:01.488957  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:01.498704  9895 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:01.499929  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:01.501763  4215 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 20: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:01.505409 10225 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:01.507767  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 92944.3us
I20260709 13:21:01.508845  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.509968  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.511004  4187 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.511374 10210 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:01.512934  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:01.513455 10210 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:01.513870  4919 raft_consensus.cc:2393] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate b81584b21ed144698954548303f1e507 in this term.
I20260709 13:21:01.512053  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.516721 10212 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:01.511019 10135 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:01.523370  4215 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:01.525880 10061 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:01.572898  4040 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 16 to 17, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 17 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:01.574868  4040 catalog_manager.cc:5697] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:01.576440  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:01.532258 10248 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
W20260709 13:21:01.575976 10281 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:21:01.585129  4289 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:01.617874  4040 catalog_manager.cc:5697] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:01.619988  4040 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:01.623464  4040 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:01.499926  9895 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.555642 10173 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.637146 10279 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:01.690081  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.704697  4291 raft_consensus.cc:1240] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:01.705790 10213 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.714157  4040 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:01.723047  4222 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:21:01.654484 10267 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:21:01.723487  4040 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 13, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 13 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:01.697211 10238 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.703490 10248 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:21:01.743553  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 316778us
I20260709 13:21:01.753585  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:01.757412  4294 raft_consensus.cc:1240] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:01.715992 10235 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.768129  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:01.769289  4291 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:01.770064  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:01.771073  4288 raft_consensus.cc:2393] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:01.798413 10235 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:01.799328  4139 raft_consensus.cc:1240] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:01.740391 10238 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:01.803045 10238 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:01.736475 10277 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.806077 10277 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:01.807156  4141 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 19: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:21:01.815167  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:01.825338  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:01.826030  4222 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:01.827164  9948 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:01.836052 10278 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:01.840058  4222 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:21:01.766326 10171 consensus_queue.cc:1059] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:21:01.843797 10171 raft_consensus.cc:3055] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:01.844410 10171 raft_consensus.cc:740] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:01.844812  4146 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:01.845715 10171 consensus_queue.cc:260] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.849828  9895 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:01.825753  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:01.851351  4217 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:01.852798  4040 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:01.824012  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:01.860549  4221 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:21:01.855226  4040 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 14 to 18, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 18 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.776093  9999 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:01.751631 10248 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:01.815414 10291 log.cc:927] Time spent T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:21:01.747611 10301 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:21:01.880170  4112 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:01.875528  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.885334 10173 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:01.885565  9999 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.874375 10171 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:01.940757  4261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.021s	sys 0.058s
W20260709 13:21:01.941146  4261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.021s	sys 0.058s
W20260709 13:21:01.941533  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 584024us
I20260709 13:21:01.945700  9895 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:01.946516  9895 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:01.894104  4217 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
W20260709 13:21:01.950657  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 75235.5us
I20260709 13:21:01.899051 10248 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:01.899549 10223 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.957695 10223 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.958954 10307 raft_consensus.cc:3060] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:01.947638  9895 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.901623 10305 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:01.907444  4138 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:01.909083 10225 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:01.910578  4139 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:01.916960  4147 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:01.917001  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: b81584b21ed144698954548303f1e507
I20260709 13:21:01.918459  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:01.974895  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 57995.6us
I20260709 13:21:01.975159  4221 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 12.
I20260709 13:21:01.976126  4112 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:01.764911 10298 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:01.925344  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:01.926755  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:01.933717  4295 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:01.954062  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:01.949069 10247 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:21:01.982867  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:02.002617  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.003677  4218 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:01.996567 10306 consensus_queue.cc:1059] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 13:21:02.009604  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55858.6us
I20260709 13:21:02.011021  9568 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:02.011658  9568 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:01.960309 10223 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.031704  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:21:02.028456  4292 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 11. Current term is 12. Ops: []
I20260709 13:21:01.988150  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:21:02.034757  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46770.4us
I20260709 13:21:02.036123  9568 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.041000 10224 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:21:02.042521 10224 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:02.008514  9948 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:21:02.027344 10238 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:02.042925 10224 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:02.033883 10234 consensus_queue.cc:1059] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:21:02.059471 10229 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:01.995244 10248 consensus_queue.cc:1059] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:21:01.984220 10225 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.041347 10299 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:21:02.064920  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 82195.8us
I20260709 13:21:02.071310  4261 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:02.045643  9948 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.074510 10276 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.074788 10248 raft_consensus.cc:3055] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:02.006028 10305 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.077641  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:02.084326  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:02.069548 10299 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:21:02.144201  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:02.144848  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67316.2us
I20260709 13:21:02.165869  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.167582  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:02.089875 10276 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:02.167886  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83637.7us
I20260709 13:21:02.078972  9948 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:02.086051 10247 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:02.145082 10302 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:21:02.085170 10248 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:02.091341 10061 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.171152 10299 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:02.197685 10311 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:21:02.167524 10125 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.177357 10234 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:02.170599  9999 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:02.207269  4261 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:21:02.222200 10234 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.169140  9886 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.222744 10234 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:02.223408 10305 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:02.223105  9886 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.226912  9886 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:02.228147 10248 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.230237 10248 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.263571 10298 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:02.209764 10061 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.282498 10061 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:02.286119  4288 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:21:02.288872  4262 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:02.290498 10315 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:21:02.293340 10276 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.293501 10229 raft_consensus.cc:3055] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:02.293872 10229 raft_consensus.cc:740] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:21:02.294255  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 87097.2us
I20260709 13:21:02.295068 10305 raft_consensus.cc:2804] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:02.295756 10305 raft_consensus.cc:697] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:02.297288 10225 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.296984 10305 consensus_queue.cc:237] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.243790 10317 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:02.299412 10317 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:02.299817 10317 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.302738  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.294700 10229 consensus_queue.cc:260] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.304740  4261 leader_election.cc:400] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19.
I20260709 13:21:02.305334  4261 leader_election.cc:403] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:21:02.308746  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:02.310345  4261 leader_election.cc:400] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16.
I20260709 13:21:02.310675  4261 leader_election.cc:403] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:21:02.319492 10229 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.322603  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:02.243211 10125 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.325371 10125 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.328454  9948 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.334722 10235 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:02.335281 10235 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:02.313216 10306 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19.
W20260709 13:21:02.338589  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 167246us
I20260709 13:21:02.340998  4187 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:02.359357  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:02.362561  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.363235  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.363950  4215 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:02.364800  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.365590  4218 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:02.367687  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:02.315126 10085 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16.
I20260709 13:21:02.318197 10298 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:02.373903 10320 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:21:02.374408  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:02.375124  9948 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:02.357998  9999 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:21:02.376469  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.402429  4222 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 18.
I20260709 13:21:02.380903 10318 consensus_queue.cc:1059] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:02.381423  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:02.354382 10052 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:02.393873  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 3032) took 1036 ms. Trace:
I20260709 13:21:02.404429  4147 rpcz_store.cc:276] 0709 13:21:01.357246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:01.358049 (+   803us) service_pool.cc:224] Handling call
0709 13:21:02.393690 (+1035641us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400285854. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:21:02.393810 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907842432}
I20260709 13:21:02.372506  4040 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 11 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:02.395744  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:02.342406 10222 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.385320  4290 raft_consensus.cc:2410] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:21:02.403380 10085 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:02.369956 10247 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:21:02.424424 10279 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:02.420663 10225 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:02.419984  4112 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:02.414019 10052 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.447189  4040 catalog_manager.cc:5697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 13, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 13 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:02.463209  4221 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:02.447964 10135 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:02.408676 10266 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:21:02.449055  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 108156us
I20260709 13:21:02.440577 10173 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:02.343988 10224 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.445576 10229 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:02.452427 10276 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:21:02.431420 10312 log.cc:927] Time spent T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.389s	user 0.002s	sys 0.000s
I20260709 13:21:02.397792 10320 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.424486  9948 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:02.454681 10239 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.483361 10276 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:21:02.477686 10307 consensus_meta.cc:287] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.001s
I20260709 13:21:02.414988 10222 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:02.456478  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 62922.5us
I20260709 13:21:02.476231 10229 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:02.471002  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.471690 10052 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:02.471426 10299 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.474313 10224 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:02.519145 10323 log.cc:927] Time spent T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.002s
I20260709 13:21:02.336241 10235 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.462405 10085 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.526028 10085 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.474803 10225 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.484548  9948 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.391815 10298 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:02.533206 10298 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:02.534041  9948 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.535179  4040 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 14 to 17, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 17 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:02.537089  4040 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.501724 10173 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:02.502523 10307 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:02.483865 10276 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:02.480589 10320 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:02.547219  4040 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 15, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.529788 10225 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:02.530285  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47745.8us
I20260709 13:21:02.455464  4218 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:21:02.517174 10229 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.478876 10279 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:02.553274  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 133365us
I20260709 13:21:02.485729 10239 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.556599  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.573973  4287 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:02.558145  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.575299  4293 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
W20260709 13:21:02.565495  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.568981  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.576489  4213 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:02.540529 10173 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:02.580686  4040 catalog_manager.cc:5697] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:02.580915  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:02.592702  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.601953  4213 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:21:02.581755 10212 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:21:02.612425 10119 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:02.612859  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:02.613036 10119 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.615319 10119 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:02.615676 10244 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:21:02.616222 10244 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:02.616149  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:02.620000  4920 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:21:02.622682  4919 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:02.626791  4920 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:21:02.616369  4112 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:02.631266  9900 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:02.631685  9900 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:02.632040  9900 raft_consensus.cc:3060] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:02.636720 10222 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:02.638494 10125 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.638926 10277 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.639268 10125 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.639559 10277 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.641881 10125 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.643340  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:02.644043 10277 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.562187 10325 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:02.652087  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:02.654091  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:21:02.655897  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88732.3us
I20260709 13:21:02.656070  4142 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 22.
I20260709 13:21:02.605037  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:02.662401  4040 catalog_manager.cc:5697] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 10, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:21:02.661907  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 266283us
I20260709 13:21:02.664047 10210 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:21:02.670171  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:02.672266  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:21:02.658413 10322 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:21:02.676923  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:02.676645  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 73077.4us
I20260709 13:21:02.655805 10325 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.683750  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.686463  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.691354  4217 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:21:02.664842 10222 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.692200  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.693774 10325 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.687326  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.689069  4220 raft_consensus.cc:1240] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:02.696888  4218 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 18.
I20260709 13:21:02.697903  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.699020  4220 raft_consensus.cc:2393] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 19: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:02.698961  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:02.700546  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.701148  4222 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 16.
I20260709 13:21:02.701793  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.701963  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.702586  4214 raft_consensus.cc:2393] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:02.703411  4222 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:21:02.701149 10238 consensus_meta.cc:287] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.003s
I20260709 13:21:02.704687 10238 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:02.686803  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.680100 10223 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:21:02.698127  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.700210  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.668614  9900 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.709321 10085 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.710305  9900 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.711609  4217 raft_consensus.cc:2468] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:02.713989  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.714990  4217 raft_consensus.cc:2393] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 16: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:02.712102 10085 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:02.670614 10305 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:21:02.728708  4040 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:02.738859  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:02.743541  9568 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.742260  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:02.748538  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.727603 10222 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.658653 10276 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.757161 10276 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:21:02.758209 10222 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.750867 10307 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:02.740382 10173 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.760214 10307 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:02.760651 10279 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:02.761890 10239 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:02.766289 10334 log.cc:927] Time spent T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:21:02.725641 10330 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:02.767112 10330 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.767498 10330 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.770318  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:02.771406 10248 consensus_meta.cc:287] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.004s
I20260709 13:21:02.772823  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:02.753278 10085 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:21:02.773690 10301 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:21:02.774412 10301 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:02.760746 10307 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:02.753847 10234 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.003s
I20260709 13:21:02.777458 10234 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.777823  4112 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:02.779187 10253 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:02.779513 10234 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.779554 10253 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.619079 10244 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.785094 10253 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:02.744088  9568 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.771559  4295 raft_consensus.cc:2410] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:21:02.791652  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.791981  4221 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:02.792510  4293 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 16.
I20260709 13:21:02.740417 10318 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:02.793228 10318 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.795513  9568 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:02.795320  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:02.790539  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:02.796660 10272 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:21:02.796973 10335 log.cc:927] Time spent T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:21:02.795357 10318 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:02.798813 10298 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.741652  4261 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:02.802588  9568 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:02.818486  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 76920.6us
W20260709 13:21:02.827714  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 76349.4us
I20260709 13:21:02.829036  4187 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:02.831187  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:02.833712  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.835366  4288 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:21:02.835985  4288 pending_rounds.cc:85] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 9
I20260709 13:21:02.836257  4288 pending_rounds.cc:107] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:21:02.836583  4288 raft_consensus.cc:2889] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:02.839555  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.775738 10301 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.840411  4288 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:21:02.844992  9568 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:02.847002  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.850762  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:02.851166  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.851854  4213 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:21:02.797108 10272 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:02.820993 10317 consensus_meta.cc:287] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.000s
I20260709 13:21:02.852690  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:02.861223  4218 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 18: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:02.861047  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:02.852752  4293 raft_consensus.cc:1240] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:21:02.858815  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:02.860088  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.863317  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:02.864029  4296 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:21:02.861857  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
W20260709 13:21:02.864570  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46340.7us
I20260709 13:21:02.844913 10239 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.825076 10248 raft_consensus.cc:2804] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:02.865890  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:02.871366  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:02.871465  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:02.873958  4142 raft_consensus.cc:1240] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:21:02.885563  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:02.886168  4142 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:02.876930  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:02.879040  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:02.880503  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:02.881047  4145 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:02.876930  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:02.887020  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:02.859956 10272 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:02.893424  4142 raft_consensus.cc:1240] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:02.891649  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:02.890549  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:02.896085  4145 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 16.
I20260709 13:21:02.892745 10052 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:21:02.893167 10248 raft_consensus.cc:697] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:02.909778 10248 consensus_queue.cc:237] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.910037 10225 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:02.868461 10299 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:02.917953  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:02.919020  4213 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:02.917171  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:02.923956  4144 raft_consensus.cc:2393] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 17: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:21:02.932132  4220 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 12.
I20260709 13:21:02.866343 10317 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:02.934654  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:02.955123  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:02.923293 10231 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.888576 10239 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:03.009007  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 70253.3us
I20260709 13:21:02.924557 10338 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:03.007892  4040 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.026122  4040 catalog_manager.cc:5697] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:02.985023  4288 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:02.912256 10225 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:02.992460 10318 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:03.030565 10318 consensus_queue.cc:1059] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:03.029899  4040 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:21:03.033061  4041 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 179) took 46053 ms (client timeout 15000 ms). Trace:
I20260709 13:21:03.034799  4287 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:03.034118  4040 catalog_manager.cc:5697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 11 to 18, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 18 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.036209  4040 catalog_manager.cc:5697] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:03.041785  4040 catalog_manager.cc:5697] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 14, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 14 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:02.986097 10298 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:03.033525  4041 rpcz_store.cc:269] 0709 13:20:16.980111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.980370 (+   259us) service_pool.cc:224] Handling call
0709 13:20:18.100529 (+1120159us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:21:03.032785 (+44932256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:57.471295 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:57.500765 (+ 29470us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:57.500805 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:20:57.500821 (+    16us) tablet.cc:662] Decoding operations
0709 13:20:57.641208 (+140387us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:57.650851 (+  9643us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:57.650890 (+    39us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:20:57.652527 (+  1637us) tablet.cc:701] Row locks acquired
0709 13:20:57.652556 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:20:57.652814 (+   258us) write_op.cc:270] Start()
0709 13:20:57.653002 (+   188us) write_op.cc:276] Timestamp: P: 1783603257652732 usec, L: 0
0709 13:20:57.653034 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:20:57.708472 (+ 55438us) log.cc:844] Serialized 6732 byte log entry
0709 13:20:58.300474 (+592002us) op_driver.cc:464] REPLICATION: finished
0709 13:20:58.551143 (+250669us) write_op.cc:301] APPLY: starting
0709 13:20:58.580378 (+ 29235us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:59.117755 (+537377us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:59.134801 (+ 17046us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:00.416284 (+1281483us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:00.457716 (+ 41432us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:21:00.457779 (+    63us) write_op.cc:312] APPLY: finished
0709 13:21:00.458819 (+  1040us) log.cc:844] Serialized 156 byte log entry
0709 13:21:00.633592 (+174773us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:00.735048 (+101456us) write_op.cc:454] Released schema lock
0709 13:21:00.735141 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:00.735735 (+   594us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:00.735770 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2565727,"reported_tablets":54,"spinlock_wait_cycles":585381632,"child_traces":[["op",{"apply.queue_time_us":212873,"apply.run_cpu_time_us":58524,"apply.run_wall_time_us":2207135,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":366229,"prepare.run_cpu_time_us":35482,"prepare.run_wall_time_us":481907,"raft.queue_time_us":162473,"raft.run_cpu_time_us":37614,"raft.run_wall_time_us":210828,"replication_time_us":603102,"thread_start_us":771894,"threads_started":5,"wal-append.queue_time_us":483018,"wal-append.run_cpu_time_us":16894,"wal-append.run_wall_time_us":2246792}]]}
I20260709 13:21:03.045006 10298 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:03.045495 10298 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
W20260709 13:21:03.048959  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.043803  4040 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.063860  4213 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:21:03.028836  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:03.082873  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 253931us
W20260709 13:21:03.085210  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 267996us
W20260709 13:21:03.086130  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.994799 10305 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:03.088725 10299 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:21:03.090132  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 61381.8us
I20260709 13:21:02.993373 10331 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:21:02.942514 10306 consensus_queue.cc:1059] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
W20260709 13:21:03.112505  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.108626  4040 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 11 to 17, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 17 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.118786  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:03.080715 10338 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:21:03.123975  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 134204us
I20260709 13:21:03.046609 10298 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.125125  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:03.092259 10305 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:03.026782 10238 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:21:03.138441  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:03.114336 10223 raft_consensus.cc:993] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:03.011705 10231 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.123423 10299 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:03.153035  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:03.131971 10306 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:03.163420  4213 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:21:03.164294  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.138293 10305 raft_consensus.cc:3060] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.172879  4217 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:21:03.147852 10234 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:03.152464 10298 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:03.135619  4040 catalog_manager.cc:5697] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 10, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:03.177475 10253 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.161123 10223 raft_consensus.cc:1081] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:03.167829 10225 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:03.148533 10224 consensus_queue.cc:1059] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:21:03.143273 10307 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:03.211174  4040 catalog_manager.cc:5697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 11 to 14, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 14 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.216756  4143 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 19.
I20260709 13:21:03.170370 10342 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:03.229627  4140 raft_consensus.cc:2368] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:21:03.234357  9999 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:03.235028  9999 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:03.236639  4040 catalog_manager.cc:5697] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 13, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 13 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:21:03.217048 10337 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
W20260709 13:21:03.246234  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 97920.1us
I20260709 13:21:03.248382  4040 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:03.255110  4040 catalog_manager.cc:5697] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:03.254271  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59970.9us
I20260709 13:21:03.226562 10300 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:03.262156  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:03.269124  4040 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:03.250450 10234 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:03.252916 10338 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.277383  4040 catalog_manager.cc:5697] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 12, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 12 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.259879 10225 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:03.297830  4112 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:03.298573 10225 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:03.236182  9999 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.276701 10234 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:03.296600 10300 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:03.297497 10325 consensus_meta.cc:287] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
W20260709 13:21:03.307049  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.306627  4040 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 9, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 9 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.312323 10229 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:03.277323 10317 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:03.318991  4040 catalog_manager.cc:5697] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:03.333689 10320 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.000s
I20260709 13:21:03.334208 10320 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.335232  4292 raft_consensus.cc:1240] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14. Ops: []
I20260709 13:21:03.314556 10272 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:03.337663 10272 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.338753 10235 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.333092 10234 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.237967 10342 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.344862  4040 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 15, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:03.347314  4040 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 13, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 13 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.324787 10300 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:03.370561  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:03.371277  4215 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:21:03.372290  4217 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:21:03.373699  4147 raft_consensus.cc:1240] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:21:03.383285  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 182273us
I20260709 13:21:03.326447 10325 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.374439 10234 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.394564  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet a35e1cee8a15436dbfaf75dd67824aad with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:56112
I20260709 13:21:03.391561  4112 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:03.389458  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.398108  4217 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:03.396766 10326 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:03.404414 10342 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:03.406206 10223 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:03.408269 10238 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:03.408779 10238 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.409442 10224 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:03.410130 10224 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.410640 10238 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.412114  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:03.412909 10244 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:03.422281  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.470638  4920 raft_consensus.cc:1275] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:21:03.476900  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:03.479517  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:03.480913  4920 raft_consensus.cc:2368] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17.
I20260709 13:21:03.454607  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:03.454627  4215 raft_consensus.cc:2368] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 16. Current term is 17.
I20260709 13:21:03.482139  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:03.482242  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:03.485123  4919 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:03.417557 10346 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:21:03.413200 10307 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:03.397176 10253 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.416657 10326 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:03.464484 10339 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:03.455124 10338 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.513870  4217 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:03.453621 10244 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:03.424196 10320 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:03.487154 10224 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.521508  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:03.532624  4288 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:03.533404  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:21:03.516094 10330 consensus_meta.cc:287] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: Time spent flushing consensus metadata: real 0.748s	user 0.015s	sys 0.000s
I20260709 13:21:03.544564  4294 raft_consensus.cc:1240] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
W20260709 13:21:03.526863  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 45209.3us
I20260709 13:21:03.545466  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:03.543200  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:03.546047  4289 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:21:03.546450  4293 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:21:03.546918  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:03.505251  9900 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:03.549069  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:03.557250  4292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2979) took 1091 ms. Trace:
I20260709 13:21:03.554641  4261 leader_election.cc:400] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:21:03.558334  4261 leader_election.cc:403] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:03.574536  4288 raft_consensus.cc:2468] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 17.
I20260709 13:21:03.485441 10247 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:21:03.523903 10171 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:03.526616 10339 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:03.557752  4292 rpcz_store.cc:276] 0709 13:21:02.551964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.557395 (+  5431us) service_pool.cc:224] Handling call
0709 13:21:02.557643 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:03.335601 (+777958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.556975 (+221374us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400289454. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:21:03.557183 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787874688}
I20260709 13:21:03.594445  4892 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:03.600116  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:03.601678  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:03.602185  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:03.603650  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:03.607694  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:03.608438  4146 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:03.609395  4142 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:03.526298 10244 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:03.531911 10306 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:21:03.637153  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.549387 10341 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:03.641644 10072 raft_consensus.cc:2804] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:21:03.645633 10360 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:21:03.647559 10358 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:21:03.529778 10338 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.610360  9900 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:03.658639 10338 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.658818  9900 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:03.661866 10325 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.663785  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:03.664747  4216 raft_consensus.cc:2393] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 18: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:03.642483 10306 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.665939  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.666585  4219 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.666757 10306 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:03.629112  4291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:21:03.670697  4291 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:03.671177  4291 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:03.676533 10326 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:03.607594 10361 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.680863 10361 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:03.688702  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.555327 10224 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:03.702548  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:03.623864 10339 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.659484 10305 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.610852 10320 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:03.713575  4219 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
W20260709 13:21:03.713589  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 104529us
W20260709 13:21:03.731583  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.724231  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:03.726169  4919 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
W20260709 13:21:03.735690  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 281132us
I20260709 13:21:03.730916  4291 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.743359  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:03.555989 10330 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:03.747254  4292 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:21:03.723047 10301 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:03.748157  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:03.755165  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.755074  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:03.759228  4291 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:03.760689  4919 raft_consensus.cc:2368] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19.
I20260709 13:21:03.762349  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:03.768564  4110 leader_election.cc:400] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17.
I20260709 13:21:03.769306  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:03.742944 10320 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:03.722800 10224 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.752885  9900 consensus_queue.cc:1059] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:21:03.775535 10330 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:03.711151 10341 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.758508  9895 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:03.810246 10341 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.811133 10305 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:03.811829  9999 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:03.812597 10331 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:21:03.813165 10331 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:03.814075 10331 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.814715 10300 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.818763 10224 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.819103  9900 raft_consensus.cc:3055] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:03.819725  9900 raft_consensus.cc:740] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:03.820176 10361 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:03.820559  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:03.798096 10306 consensus_queue.cc:1059] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:21:03.820714  4293 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:03.767047 10247 consensus_queue.cc:1048] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:21:03.791177 10244 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:03.804309  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 48835.2us
I20260709 13:21:03.777021 10340 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:03.821399  4288 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:03.821691 10306 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:21:03.783295  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.848301  4213 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.820969  9900 consensus_queue.cc:260] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.846022  4111 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:03.834550  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:03.843078  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:03.842157 10085 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:21:03.855682 10320 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.857591 10239 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:03.855767 10306 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:03.860098 10306 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.861433 10306 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:03.863988  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.864598 10277 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:03.864851  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:03.865193  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.806078 10333 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:03.865586  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.866282  4214 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:03.867012  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.867105  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:03.857662  4290 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:21:03.868808  4290 pending_rounds.cc:85] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 10
I20260709 13:21:03.869024  4290 pending_rounds.cc:107] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:21:03.869230  4290 raft_consensus.cc:2889] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:03.865799  4222 raft_consensus.cc:2393] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 14: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:03.870977  4222 raft_consensus.cc:1275] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:03.850183  4296 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:03.865818  4221 raft_consensus.cc:2393] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 18: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:03.876988  4893 leader_election.cc:400] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 16. Current term is 17.
I20260709 13:21:03.877367  4893 leader_election.cc:403] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:21:03.883447  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:03.887912  4139 raft_consensus.cc:2368] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:21:03.891045  4111 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:21:03.876492 10235 consensus_meta.cc:287] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.002s
I20260709 13:21:03.908654  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:03.910584  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:03.896683  4185 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:03.898231  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:03.914089  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:03.917836  4293 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:03.923470  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:03.924227  4215 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:03.905329  4213 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 19.
I20260709 13:21:03.936932  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet a35e1cee8a15436dbfaf75dd67824aad (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:03.931895  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:03.938659  4290 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.889451 10119 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 16. Current term is 17.
I20260709 13:21:03.931568  4893 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
W20260709 13:21:03.980218  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 45860.9us
I20260709 13:21:03.905658 10277 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:03.897701 10239 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:21:04.002027  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 70505.4us
I20260709 13:21:03.894881 10125 consensus_queue.cc:1059] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:21:03.894375 10247 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:21:04.038972 10247 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.039479 10247 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.027519  4141 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:04.012790 10354 raft_consensus.cc:2804] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:03.928309 10305 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:21:03.929138  9953 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:04.052230  9953 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:04.052428  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52146 (request call id 2514) took 1181 ms. Trace:
I20260709 13:21:03.927976 10342 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:04.045671 10333 consensus_queue.cc:1048] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:04.053155  4141 rpcz_store.cc:276] 0709 13:21:02.870956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.871080 (+   124us) service_pool.cc:224] Handling call
0709 13:21:04.052139 (+1181059us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540038ed54. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece62fa 00007fee43ca7b17 00007fee3d2226d4 00007fee3d222662 00007fee3d222591 00007fee3d22250c 00007fee3d2217c2 00007fee3d01d48c 00007fee3d01c8c6 00007fee3d01c26f
0709 13:21:04.052291 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391182720}
I20260709 13:21:04.047857 10125 raft_consensus.cc:3055] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:04.055485 10125 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:04.056432 10125 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.897670 10278 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:21:04.057696 10125 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:04.050292  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:04.062464 10305 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:04.063059 10305 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:04.052723  9953 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:04.066668 10244 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.065260 10305 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:04.049610 10239 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:04.069516 10298 consensus_meta.cc:287] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.004s
I20260709 13:21:04.050225 10277 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:04.071118 10277 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:03.926975 10224 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.146s
I20260709 13:21:04.041803 10300 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.076032 10354 raft_consensus.cc:697] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 19 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:21:04.077173 10354 consensus_queue.cc:237] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:03.929347 10072 raft_consensus.cc:697] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 17 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:21:04.088184  4215 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 20.
I20260709 13:21:04.089357  4214 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:04.093331  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:04.089061  9999 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:04.097918  9999 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.100178  9999 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:04.101204 10072 consensus_queue.cc:237] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:04.109843 10339 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.111426  4219 raft_consensus.cc:1240] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 21. Current term is 23. Ops: []
I20260709 13:21:04.112839 10333 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:04.113499 10333 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:04.113562  9953 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.114532 10333 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:04.122174 10377 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:21:04.130473 10247 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:04.134884  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:04.178067  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:04.180176  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 190147us
I20260709 13:21:04.182374  9953 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:04.185937  4261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.179975 10244 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:04.185022 10326 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:04.197144  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.199527  4144 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:04.197979  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.202006  4146 raft_consensus.cc:2393] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 16: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:04.202226  4142 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:04.206537  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.207396  4143 raft_consensus.cc:2410] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:21:04.214970  4296 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:21:04.220103  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.221055  4146 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
W20260709 13:21:04.224642  4260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.228682  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:04.229374  4143 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:04.214690 10361 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:04.234759  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:04.235515  4142 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:04.202647 10244 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.217756 10339 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.204661 10326 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:04.228230 10338 raft_consensus.cc:493] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:04.257233 10326 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:04.262097 10239 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.272471 10338 raft_consensus.cc:515] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:04.288740  4147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52146 (request call id 2517) took 1415 ms. Trace:
I20260709 13:21:04.289345  4147 rpcz_store.cc:276] 0709 13:21:02.872949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.877857 (+  4908us) service_pool.cc:224] Handling call
0709 13:21:02.878224 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:03.374250 (+496026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.288372 (+914122us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b5400265054. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:21:04.288646 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1139057536}
I20260709 13:21:04.299366 10247 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:04.301810 10247 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:04.324632 10380 log.cc:927] Time spent T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:21:04.326133 10325 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:04.326620 10325 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:04.333564 10231 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.335714 10222 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:04.336373 10222 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:04.343221  4143 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 23.
I20260709 13:21:04.348575  4142 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 21.
I20260709 13:21:04.327587 10325 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.358807 10173 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:04.345201 10248 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:04.373045  4920 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 17 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:04.377897  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:04.380962  4261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.243.65:36237 timed out after 1.714s (SENT) [suppressed 6 similar messages]
I20260709 13:21:04.384743  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:04.385253  4925 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:21:04.388741 10244 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.390213  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.390594 10222 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.392767  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.393810  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:04.394577  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.394919  4920 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:21:04.392868  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:04.397873  4147 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:04.398006  4290 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:21:04.398307  4147 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:04.399534  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.400136  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:04.399168  4147 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.400158  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:04.402070  4141 raft_consensus.cc:3060] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:21:04.410641  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:04.415030  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 211473us
I20260709 13:21:04.416621  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:04.417485  4295 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:04.420668  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:04.421622  4288 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:04.423530  4296 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:04.425714  4141 raft_consensus.cc:2468] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 19.
I20260709 13:21:04.415902  4112 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:04.429811  4139 raft_consensus.cc:2468] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:04.429908  4187 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:04.403431 10135 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:04.421801 10325 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:04.443943  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.445497  4295 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 21.
I20260709 13:21:04.432955 10338 leader_election.cc:290] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:04.437326 10305 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:04.453493  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:04.453856 10305 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:04.454459  4290 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:21:04.454704 10354 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:21:04.456028 10305 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:04.456643 10247 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:04.398813 10248 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.479910  4110 leader_election.cc:400] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19.
I20260709 13:21:04.457230 10231 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:04.429230 10339 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:04.480870 10339 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.474961 10277 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:21:04.436147 10394 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:21:04.483353 10277 raft_consensus.cc:3055] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:04.483773 10277 raft_consensus.cc:740] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:04.455003  4290 pending_rounds.cc:85] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 10
I20260709 13:21:04.437326 10381 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:21:04.484547  4290 pending_rounds.cc:107] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:21:04.428911 10348 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:21:04.465466 10383 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:04.487766  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 71957.9us
I20260709 13:21:04.489149  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:04.490065 10231 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:04.454844  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:04.444801  4187 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:04.469748 10135 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.490661 10231 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
W20260709 13:21:04.496536  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 51804.8us
I20260709 13:21:04.475980  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:04.496759 10231 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.497406  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:04.497731  4291 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:21:04.499796 10338 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:04.500555 10367 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:04.500751  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:04.501092 10367 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:04.501566 10367 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:04.501796  4187 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:04.502995 10214 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:04.503556 10214 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:04.503623 10339 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.504526 10214 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.508860  4112 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:04.510221 10235 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:04.510841 10235 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:04.506340  9895 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:04.513504 10235 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.497428 10135 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.515908  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:04.507980  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:04.480271  4110 leader_election.cc:403] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:04.523159  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:04.484917  4290 raft_consensus.cc:2889] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:04.523973  4221 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:04.471460  4288 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 23.
I20260709 13:21:04.484678 10125 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
W20260709 13:21:04.532184  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 52407us
I20260709 13:21:04.536319  4219 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:21:04.539562  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:04.539841 10125 consensus_queue.cc:1243] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer b81584b21ed144698954548303f1e507 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:21:04.540513 10061 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693) with higher term. Message: Invalid argument: T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 18. Current term is 19.
I20260709 13:21:04.543409 10383 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:04.546058  4291 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:04.544435 10239 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:04.506225 10248 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:04.548945  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:04.527381 10173 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.553668  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:04.555727  4217 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:21:04.552145  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 171206us
I20260709 13:21:04.566718  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:04.561214  4221 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:04.569217  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:04.567564  4214 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 12: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:04.572873  4213 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:04.576535  4219 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:21:04.576745  4261 leader_election.cc:400] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:21:04.577054  4261 leader_election.cc:403] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:04.578150  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:04.583647 10253 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:04.584256 10253 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:04.585052  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.585112 10253 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.586179  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.588243  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.589000  4143 raft_consensus.cc:2393] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 17: Already voted for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in this term.
I20260709 13:21:04.590060  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:04.593281  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.595628  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:04.597929  4261 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:04.600025  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:04.596495 10248 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15.
I20260709 13:21:04.602763 10324 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:21:04.609617  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:04.614758  4296 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:21:04.577721 10339 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.617465  4261 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:04.593010 10239 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:04.657064 10333 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:04.571550 10173 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.645395 10248 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:04.614478 10306 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:21:04.673838 10248 raft_consensus.cc:2804] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:04.674412 10248 raft_consensus.cc:697] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:04.658257 10339 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.659701 10223 consensus_queue.cc:1059] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:21:04.707341 10248 consensus_queue.cc:237] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:04.703694  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 86310.4us
I20260709 13:21:04.737323  4261 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:04.746238 10411 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:04.747344  4139 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:21:04.752813 10367 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.674401 10239 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.756656 10411 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:04.757222 10411 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.758987  4141 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:04.762944  4139 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:21:04.739009 10306 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:04.765473  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.816042 10367 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:04.783434 10306 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.802003 10248 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:21:04.783383 10333 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:04.822021  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:04.824793  4139 raft_consensus.cc:2376] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16. Re-sending same reply.
I20260709 13:21:04.825085  4295 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:04.831393 10382 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:21:04.833264 10333 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:04.857223 10411 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:04.871773  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 104780us
I20260709 13:21:04.874044  4261 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:21:04.899941 10417 log.cc:927] Time spent T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:21:04.905922 10333 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:04.907019 10306 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:04.907358 10395 log.cc:927] Time spent T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.483s	user 0.007s	sys 0.005s
W20260709 13:21:04.920838  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46897.8us
I20260709 13:21:04.926100  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:04.924875 10305 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:04.989701  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.993011  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:04.995733  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:04.998741  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:04.999544  4215 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:05.013288  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:05.013547  4214 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:04.924320 10427 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:05.014523  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.019289  4139 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:05.005076 10306 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:05.067849  4139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:05.068624  4139 raft_consensus.cc:606] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.069029  4139 raft_consensus.cc:614] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:05.071842  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.072696  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.073459  4290 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
I20260709 13:21:05.073194  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:05.076625  4293 raft_consensus.cc:2393] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 15: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:05.072180  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002295ea4e164178a447d55ccde98422" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.081364  4296 raft_consensus.cc:2393] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:05.067570  9886 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:21:05.083868 10423 log.cc:927] Time spent T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:21:05.094424  4139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:05.095228  4139 raft_consensus.cc:606] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.095820  4139 raft_consensus.cc:614] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:05.105922  9900 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:05.107363 10292 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:05.087463  9886 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.116559  4186 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:05.118546  4186 leader_election.cc:304] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:05.130511  4220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da0810d325774d7181018ff01e71333a"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:05.131537  4220 raft_consensus.cc:606] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.125669 10348 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:05.127676 10361 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.126562 10367 raft_consensus.cc:2749] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:05.176980 10361 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.169200 10348 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:05.180269 10173 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:05.185076  4296 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:21:05.185281 10348 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:05.136726 10214 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.192735 10214 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:05.194779 10214 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:05.198681 10352 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:05.200618 10214 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:05.201205 10214 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.204353  4139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6478d83fa954184a297fb7466378df1"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:05.205039  4139 raft_consensus.cc:606] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.209518  4142 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:05.212179  4293 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:21:05.219749  4293 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:05.223623  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.224777  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:05.224287  4144 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 12.
I20260709 13:21:05.229676  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.237671  4287 raft_consensus.cc:1240] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:21:05.246426  4146 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:21:05.249770 10214 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.261682  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:05.264577 10412 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:05.265918 10331 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:05.267459 10072 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:05.267716 10331 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:05.268136 10072 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:05.270702 10072 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.272853  4220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eff857a690104e20896367b8755773e0"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:05.273671  4220 raft_consensus.cc:606] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.274107  4220 raft_consensus.cc:614] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:05.270849  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:05.287555  4147 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:05.303512  9886 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.306238 10338 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:05.306936 10338 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:05.309900 10410 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.568s	user 0.005s	sys 0.003s
W20260709 13:21:05.313920 10409 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.573s	user 0.002s	sys 0.002s
I20260709 13:21:05.315522  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.319751 10277 consensus_queue.cc:260] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:05.320648 10338 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.321394 10277 raft_consensus.cc:3060] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:05.291436 10339 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:05.332572  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 61766.2us
I20260709 13:21:05.339277  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c130eddd78204cee994818f0043bf88c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:05.340885  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:05.346889  4221 raft_consensus.cc:1275] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:05.347139  4215 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:05.348176  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:05.350551  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:05.335282 10430 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:05.352483  4214 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:21:05.356449  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:05.355468  4147 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:05.335036 10305 raft_consensus.cc:493] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:05.344816 10052 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:05.338941 10338 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:05.345482 10331 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:05.350001 10396 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:05.362262 10305 raft_consensus.cc:515] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:05.363085 10052 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:05.358500 10430 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.368609 10430 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:05.369390  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:05.370054 10361 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.338268 10348 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.371883  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.356580 10298 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:21:05.357854 10432 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:05.377292  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.378465  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f9faaf59648debe160e6df5d91fcd" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:05.380225  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.368270 10305 leader_election.cc:290] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:05.364712 10431 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:21:05.376005 10052 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.384719  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.388712  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.364264 10338 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.374562 10247 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:21:05.387624 10072 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:05.397188  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.405508  4145 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:05.406020  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:05.408190  4287 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:05.412971 10339 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:21:05.413456 10339 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.413829 10339 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:05.392241 10352 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:21:05.422142  4147 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:05.412559  4187 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.424736  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.426579  4140 raft_consensus.cc:1275] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:05.428545 10437 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:05.426502  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.429255 10437 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:05.430326 10437 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.437461 10338 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.437306 10223 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:05.439420 10422 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:05.439882 10422 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:05.399317 10331 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.454200 10125 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:05.456805 10430 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.459719 10430 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:05.447245 10351 consensus_queue.cc:1048] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:21:05.435667 10374 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:05.463377 10374 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.464654 10348 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.466158 10374 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.477644  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:05.478673  9900 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:05.479369 10324 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:05.479051 10223 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:05.478863  4112 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:05.484225  4112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:05.498540  4222 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:21:05.500408  4222 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:05.510035  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:05.510617  4145 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:05.508286  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.519604  4222 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:05.528506  4222 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:21:05.531801  4187 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:05.504006 10247 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:21:05.545509  4141 raft_consensus.cc:1275] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:21:05.545953  4141 pending_rounds.cc:85] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting all ops after (but not including) 13
I20260709 13:21:05.546178  4141 pending_rounds.cc:107] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:21:05.546398  4141 raft_consensus.cc:2889] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:05.544615  4187 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:05.547719  4145 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:05.522285 10430 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.529016 10381 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:21:05.548952  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:05.520928 10431 consensus_queue.cc:1048] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:21:05.557767 10331 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:05.545622 10367 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:05.567724 10171 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:05.582927 10171 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:05.583370 10171 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:05.557507 10430 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.590405 10430 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:05.592473  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.593387  4144 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:05.549417 10441 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:21:05.598912 10331 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:05.599886 10331 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.596168  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:21:05.748154  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 152046us
W20260709 13:21:05.770617  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 226044us
I20260709 13:21:05.771677  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:05.772749  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 127852us
I20260709 13:21:05.775082  4261 leader_election.cc:304] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:05.777133  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:05.777947  4147 raft_consensus.cc:2368] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 17. Current term is 18.
I20260709 13:21:05.778923  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.779675  4140 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:21:05.761142 10325 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.760548 10383 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:05.768119 10430 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:05.791213  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:05.789397  4147 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:21:05.773670 10368 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:05.776958 10247 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:05.801849  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:05.802484  4215 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:05.803712  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:05.782128 10324 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:05.782461 10320 raft_consensus.cc:2749] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:05.794018 10430 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.793015 10325 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.814581 10324 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:05.865370 10443 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:21:05.827812 10449 log.cc:927] Time spent T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:21:05.809068 10368 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:05.796209 10383 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.824607 10430 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:05.872735 10339 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:05.875329  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:05.877961  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.945303  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.833853  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:05.885171  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.888849  4215 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
W20260709 13:21:05.946250  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 112476us
W20260709 13:21:05.888815  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 115102us
I20260709 13:21:05.946998  4187 leader_election.cc:400] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 17. Current term is 18.
I20260709 13:21:05.947305  4187 leader_election.cc:403] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:21:05.944380  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 54732.9us
I20260709 13:21:05.952837  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.962662  4221 raft_consensus.cc:1240] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:21:05.965059  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:05.953799 10348 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:21:05.961493 10448 log.cc:927] Time spent T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.084s	user 0.000s	sys 0.003s
I20260709 13:21:05.949558 10450 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 17. Current term is 18.
I20260709 13:21:06.008157 10331 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:06.008853 10331 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.010531  4287 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:21:06.010891 10331 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:06.010563 10339 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.012313 10171 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.016719 10171 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.013293  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:06.014042  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.021598 10368 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:06.022606  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:05.987112 10348 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:06.048671 10348 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:06.056008 10324 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:05.991880 10298 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:06.057341 10298 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.014459  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.060038 10298 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:06.065433 10444 log.cc:927] Time spent T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:21:06.070417  4290 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:06.002120 10452 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:21:06.070991 10298 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.079216 10298 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.013509 10383 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.014313 10325 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.080408 10247 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:06.145527 10298 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:06.154728  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 206825us
I20260709 13:21:06.115128 10463 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:06.157569 10298 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:06.189528  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.192214  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:06.190965  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:06.212891  4290 raft_consensus.cc:2393] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:06.158686 10247 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.291483 10348 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.191989 10298 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:06.297765 10298 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:06.280665 10361 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:06.301581 10247 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:06.167948 10463 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.283726 10469 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.294548 10348 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.321977  4186 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:06.306260 10474 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.324752 10474 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.327474 10474 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:06.306023 10361 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.330421 10361 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.289012 10430 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.340480  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:06.321122 10383 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:06.322860 10450 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:06.351480  4288 raft_consensus.cc:2368] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16.
I20260709 13:21:06.334116  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:06.363741  4186 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:06.334085 10463 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:06.334825 10348 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:06.315551 10469 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.371646 10171 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:06.383984 10469 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.353900 10383 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.374161 10361 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:06.367848 10450 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.386662 10430 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:06.393936  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:06.395066 10348 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:21:06.400156 10361 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:06.400372 10450 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.397967 10383 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.405784  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:06.402100 10447 log.cc:927] Time spent T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.630s	user 0.000s	sys 0.005s
I20260709 13:21:06.408440  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.409402  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.411881  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.413280  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.419765  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.420605  4221 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:21:06.422391  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.412842 10325 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:21:06.423275  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.424844 10412 consensus_queue.cc:1243] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 20.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:21:06.428046  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:06.429107  4290 raft_consensus.cc:2393] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 in current term 18: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:06.432085  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.433579  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.437984  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.436354  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.439730  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.410807 10383 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:06.450181  4215 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:21:06.455754  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44652.3us
I20260709 13:21:06.452596 10475 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.459757 10231 raft_consensus.cc:993] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:06.467844  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.462628  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.470126  4217 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:06.480787  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:06.481839  4215 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:06.484486  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:06.488816 10466 consensus_queue.cc:1059] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:21:06.485477 10481 raft_consensus.cc:1081] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:06.497714 10333 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:06.498427 10333 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:06.498963  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:06.499809 10333 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:06.500504 10412 raft_consensus.cc:3055] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:21:06.500893 10412 raft_consensus.cc:740] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:06.501718 10412 consensus_queue.cc:260] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.502955 10412 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:06.510165  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.510795  4291 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:21:06.511665  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.515267  4293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6478d83fa954184a297fb7466378df1"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:21:06.516021  4293 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.516636  4293 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.488030  4217 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:06.531735  4215 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:06.540648 10381 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:06.500175 10333 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:06.563781  4186 leader_election.cc:400] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16.
I20260709 13:21:06.564150  4186 leader_election.cc:403] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:21:06.559309  4293 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.472617 10325 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:21:06.473217 10475 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:06.551354 10428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.018s
I20260709 13:21:06.568480  4261 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:06.550163 10171 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.560287 10333 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.547454 10374 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.565706 10173 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.512792 10231 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:21:06.590843 10487 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:06.576663 10428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.007s	sys 0.018s
I20260709 13:21:06.593849  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:06.595872  4213 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.596709  4293 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 23 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:06.601199  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 115341us
I20260709 13:21:06.609701  4213 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 23.
I20260709 13:21:06.576155 10085 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:21:06.619673  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 58097.4us
I20260709 13:21:06.597043 10348 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 15. Current term is 16.
I20260709 13:21:06.618821  4261 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:06.593037 10173 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.588871 10171 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.598639 10486 raft_consensus.cc:2804] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:06.630209  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:06.633044 10475 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.638697 10173 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:06.592365 10374 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.597720 10487 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.655540 10487 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.656591 10487 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.631296 10431 raft_consensus.cc:2804] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:06.657419 10431 raft_consensus.cc:697] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:06.657032 10487 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.658425 10431 consensus_queue.cc:237] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.659418 10487 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.660290  4925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42922 (request call id 896) took 1082 ms. Trace:
I20260709 13:21:06.660678  4925 rpcz_store.cc:276] 0709 13:21:05.577396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.577555 (+   159us) service_pool.cc:224] Handling call
0709 13:21:05.577917 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.597154 (+ 19237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.597201 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:05.597256 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:05.597315 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.660050 (+1062735us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5400315bd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:21:06.660102 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.660215 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43659520}
I20260709 13:21:06.661953  4217 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:21:06.662787 10324 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.663478 10324 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:06.664347 10486 raft_consensus.cc:697] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:06.665369 10486 consensus_queue.cc:237] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.667398  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:06.669332 10324 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:06.674067  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:06.676581  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:06.677922  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:06.659463  4141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37124 (request call id 720) took 1452 ms. Trace:
I20260709 13:21:06.680130  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:06.680423  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:06.679922  4141 rpcz_store.cc:276] 0709 13:21:05.207063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.207177 (+   114us) service_pool.cc:224] Handling call
0709 13:21:05.207419 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.546921 (+339502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.659217 (+1112296us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400069354. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:21:06.659402 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773239040}
I20260709 13:21:06.683663  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:06.684942  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:06.693873  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:06.699026  4140 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:21:06.699501  4144 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:06.647994  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.649348  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:21:06.710582  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61503.1us
I20260709 13:21:06.724220  4145 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:21:06.747066  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.680377 10244 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:21:06.729897 10483 log.cc:927] Time spent T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:21:06.755906  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.725473 10394 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:06.763064  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:06.738425  9895 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:06.755245 10244 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:06.738966 10381 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:06.728832 10085 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:06.756140 10325 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:06.795431 10374 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.692132 10422 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.760957 10489 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:06.798493 10325 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:06.820462  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 66025.2us
I20260709 13:21:06.780817 10394 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:06.814304 10085 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:06.829823 10325 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.830502 10085 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:06.784978 10244 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:21:06.834839 10412 consensus_queue.cc:1175] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34e6205f3c1d434193126fef20d73800" responder_term: 20 status { last_received { term: 18 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: [19.9-19.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:21:06.848449  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:06.854354  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 87202.1us
I20260709 13:21:06.845184 10486 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:06.851316 10422 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:06.853747 10489 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:06.849995 10224 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:06.783573  9895 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:06.878707 10394 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:06.889386  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:06.894483 10486 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:06.891569  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:06.884814 10324 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:06.909276 10224 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:06.909314 10431 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:21:06.928872  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:06.920408 10394 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:06.921557 10472 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:06.935050  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:06.940316  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:06.943913 10224 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:06.961067  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:06.974483  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.928872 10325 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:06.977617  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:06.978730  4288 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:21:06.992739  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:06.997347  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 217989us
I20260709 13:21:06.924600 10324 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.004725  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.013664  4143 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:21:07.014627  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.015385  4143 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 21.
I20260709 13:21:07.005066  4141 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:21:07.017494  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:07.018201  4141 raft_consensus.cc:3055] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:07.018623  4141 raft_consensus.cc:740] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:07.005481  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:07.019919  4139 raft_consensus.cc:3060] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:07.006078  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.020715  4142 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:21:07.006475  4138 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:07.006757  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.022491  4146 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:06.968537 10244 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.009312 10489 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:07.034189  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.037202  4146 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:21:07.031847  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.042078  4140 raft_consensus.cc:2410] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:21:07.044927  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.046236  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:21:07.033248 10459 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:21:06.937461 10431 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.051676 10502 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:07.056615 10502 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:07.058777 10222 consensus_queue.cc:1048] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:06.942137 10472 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.053154  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:07.066326  4147 raft_consensus.cc:2368] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15.
I20260709 13:21:07.067879  4139 raft_consensus.cc:2468] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:07.069254  4261 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:07.012609 10349 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.035339 10173 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.052186 10342 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.046598 10497 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:07.041071 10430 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.048403 10466 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.059657 10502 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.108808  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:06.998507 10325 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.075583 10396 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:07.114027  4187 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.076751  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:07.115998 10085 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:21:07.116555 10085 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:07.117039 10085 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:07.091217 10298 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:07.125020  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48369.5us
I20260709 13:21:07.148738  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.043380  4141 consensus_queue.cc:260] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.095454 10401 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.098117 10342 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.099570 10173 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.121912 10486 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:07.148747  4187 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.089511 10333 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.155431  9895 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:07.155974 10401 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:07.156543  4295 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 9. (term mismatch)
I20260709 13:21:07.170863  4295 pending_rounds.cc:85] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting all ops after (but not including) 8
I20260709 13:21:07.171288  4295 pending_rounds.cc:107] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: Aborting uncommitted NO_OP operation due to leader change: 19.9
I20260709 13:21:07.171612  4295 raft_consensus.cc:2889] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:07.172670 10480 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:07.156840  4259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:07.176688 10462 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.177495 10462 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.185012  4291 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:07.111227 10466 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.111106 10497 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:07.159236 10342 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.161509 10244 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.134922 10383 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:21:07.096465 10349 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.109512 10430 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:07.165580  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 119125us
I20260709 13:21:07.149315  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:07.167567  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:07.168896  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 119522us
I20260709 13:21:07.189167  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:07.191458  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.203550  4293 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 21.
W20260709 13:21:07.204941  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 44370.1us
I20260709 13:21:07.205246 10173 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.192694  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.162873 10472 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.197976  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.206615 10367 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:21:07.207823  4187 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.206655  4112 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
W20260709 13:21:07.209014  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59806.7us
I20260709 13:21:07.212138  4187 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.212505  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:07.209303  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.218120 10349 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.218621  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.210863 10464 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.219389 10464 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:07.220181  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.220973 10401 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:07.221488 10464 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.214059 10383 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:07.225083 10383 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:07.226691 10383 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:07.228708 10422 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:07.229614 10324 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.229094 10333 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.231529 10430 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.214339 10472 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:07.232362 10472 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.232740 10472 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:07.237849 10497 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:07.238740  4291 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:07.245656 10466 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.246253 10173 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:07.246781  4295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3056) took 1748 ms. Trace:
I20260709 13:21:07.247123  4295 rpcz_store.cc:276] 0709 13:21:05.498082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.499592 (+  1510us) service_pool.cc:224] Handling call
0709 13:21:05.499880 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:07.172211 (+1672331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:07.246546 (+ 74335us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400374954. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ece2e01 00007fee3ece183e 00007fee43ca6419 00007fee3d21dbd4 00007fee3d21db62 00007fee3d21da91 00007fee3d21da0c 00007fee3d21ccc2 00007fee3d01d48c 00007fee3d01c8c6
0709 13:21:07.246701 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3809112448}
I20260709 13:21:07.250347  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.254451  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.264547 10498 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:21:07.266703  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49702.3us
I20260709 13:21:07.267508 10171 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.269708 10325 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.218657 10471 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:07.226917 10342 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:21:07.283964  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.274467  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.275022  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:07.275122  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:07.286566  4216 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:21:07.277535 10431 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.224026  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.300541  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.301322  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.304144  4110 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:07.301857  4292 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:07.311761  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:07.312479  4925 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:21:07.311897  9568 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:07.283618 10342 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:07.315582  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:07.322952  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 98982.5us
I20260709 13:21:07.323977  4187 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.317507 10342 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:07.328914 10171 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:07.318390 10239 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:21:07.326231 10490 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:07.358103  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.387336  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.392156  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.392910  4218 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:21:07.399617  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.344043 10085 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.414667 10085 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:07.403185 10516 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:21:07.410130 10472 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.421953  4216 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:07.398918 10490 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:07.435362  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:07.443929 10490 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.449044  4296 raft_consensus.cc:1240] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 13:21:07.450131  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.450629  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.456086 10368 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.458684 10368 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.460747 10342 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.461504 10368 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.461855  4287 raft_consensus.cc:1240] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:21:07.463738 10342 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.467062  4215 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:21:07.468112  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.468747  4214 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:07.469579  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:07.478577  4218 raft_consensus.cc:1240] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:07.480093  4112 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:07.482682  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:07.486821 10462 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.488511 10481 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:07.489038 10481 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:07.489428 10342 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:07.490156  4141 raft_consensus.cc:3060] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:07.489876 10481 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.498574 10472 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 22 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:07.503032  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:07.503690 10342 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:21:07.504191 10476 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:07.504684 10476 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.505075 10476 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:07.509773  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:07.511755  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.512955 10338 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:07.513382 10338 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.514549 10450 consensus_queue.cc:1059] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:07.515476 10450 consensus_queue.cc:1059] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:07.517360 10450 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:07.517781 10450 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:07.518806  4139 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:07.518543 10450 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.519790 10450 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:07.520552 10135 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:07.520926 10135 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:07.521502  4292 raft_consensus.cc:1240] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 13. Current term is 14. Ops: []
I20260709 13:21:07.521651 10135 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.522856 10135 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:07.513751 10338 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:07.530647  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.531981  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:07.516059  4259 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:07.537729  4259 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:07.540513 10462 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:21:07.540930 10462 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:07.541270 10462 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:21:07.541951 10468 consensus_queue.cc:1059] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:07.542996 10468 raft_consensus.cc:3055] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:07.543327 10468 raft_consensus.cc:740] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:07.544843 10342 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:07.544112 10468 consensus_queue.cc:260] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.549424 10468 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:07.553969  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:07.554857  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50890.4us
I20260709 13:21:07.562914  4141 raft_consensus.cc:2468] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 23.
I20260709 13:21:07.565502  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.566157  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:07.585765  4293 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:07.585664  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.569092  4261 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:07.596293  4293 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:07.599889  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:07.605398  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.605500  4261 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:07.610567  4187 leader_election.cc:400] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15.
I20260709 13:21:07.611651  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.619372  4187 leader_election.cc:403] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:07.623776 10339 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237) with higher term. Message: Invalid argument: T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34e6205f3c1d434193126fef20d73800 for earlier term 14. Current term is 15.
I20260709 13:21:07.629768 10338 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.635978  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:07.614532  4111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:07.616091  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:07.617424 10085 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:21:07.657830 10342 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:07.684247  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:07.688143  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:21:07.675769 10531 log.cc:927] Time spent T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:21:07.690024  4111 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.689090 10061 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:07.701436 10338 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.704495 10278 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:07.718356  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.718854  9568 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:07.672466 10224 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:07.722805  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.738240  9568 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:07.738406  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:07.739462  9568 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:21:07.717332 10061 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:07.742728 10061 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:07.742899  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:07.743534 10498 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:07.680508 10452 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:21:07.737865 10224 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.735796 10324 raft_consensus.cc:2749] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:07.834801  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:07.835646  4288 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:07.858771 10224 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.865334  4288 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 21.
I20260709 13:21:07.882028  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:07.886237 10462 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:07.892002  4186 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:07.895033  4219 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
W20260709 13:21:07.905826  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 165474us
I20260709 13:21:07.913335  4111 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:07.907068 10374 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:21:07.928968 10529 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:21:07.931093 10061 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:07.931798 10325 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:07.942476 10061 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:07.954550  4216 raft_consensus.cc:2410] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 for term 22 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 13:21:07.962882  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:07.959448 10374 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:07.978729 10374 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:08.037900  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 120466us
I20260709 13:21:08.038740  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:21:08.049669  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49623.7us
W20260709 13:21:08.048434 10532 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:21:08.075259  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.068951 10537 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.083142  4111 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:08.088681  4043 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 162) took 64818 ms (client timeout 15000 ms). Trace:
W20260709 13:21:08.089128  4043 rpcz_store.cc:269] 0709 13:20:03.269833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.304456 (+ 34623us) service_pool.cc:224] Handling call
0709 13:20:03.750471 (+446015us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5400030890. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbdb71 00007fee3bbbe0b2 00007fee44b37a89 00007fee44acfda6 00007fee44aa1088 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc
0709 13:20:03.927155 (+176684us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5400030890. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ba7ddb1 00007fee3bbbde9c 00007fee3bbbe0f6 00007fee44b37a89 00007fee44acfda6 00007fee44aa1088 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc
0709 13:21:08.088488 (+64161333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1312172,"reported_tablets":51,"spinlock_wait_cycles":84795008}
I20260709 13:21:08.098423  4040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 177) took 10952 ms. Trace:
I20260709 13:21:08.101001  4045 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.111382  4287 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:08.078688 10537 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.119451  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.119943  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.122262  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.123188  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.080267 10224 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:08.130460  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:08.132513  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.121531 10368 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.117619 10488 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:08.138618 10537 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.128243 10462 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:08.121382 10348 consensus_queue.cc:1059] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 13:21:08.152490 10476 consensus_meta.cc:287] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.000s
I20260709 13:21:08.152985 10476 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.159384 10476 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:08.161172 10468 consensus_meta.cc:287] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.000s
I20260709 13:21:08.164113 10533 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:08.164660 10533 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:08.165474 10533 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.166385 10533 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:08.047360  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:08.098819  4040 rpcz_store.cc:276] 0709 13:20:57.146285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.146529 (+   244us) service_pool.cc:224] Handling call
0709 13:21:08.098336 (+10951807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:04.184315 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:04.211986 (+ 27671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:04.212039 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:21:04.212057 (+    18us) tablet.cc:662] Decoding operations
0709 13:21:04.256213 (+ 44156us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:04.256474 (+   261us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:04.256514 (+    40us) tablet.cc:685] Acquiring locks for 36 operations
0709 13:21:04.391120 (+134606us) tablet.cc:701] Row locks acquired
0709 13:21:04.391194 (+    74us) write_op.cc:260] PREPARE: finished
0709 13:21:04.391415 (+   221us) write_op.cc:270] Start()
0709 13:21:04.391604 (+   189us) write_op.cc:276] Timestamp: P: 1783603264391341 usec, L: 0
0709 13:21:04.391626 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:21:04.392391 (+   765us) log.cc:844] Serialized 14013 byte log entry
0709 13:21:04.603690 (+211299us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b18002cf2c0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf5522 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:21:04.728813 (+125123us) op_driver.cc:464] REPLICATION: finished
0709 13:21:04.860521 (+131708us) write_op.cc:301] APPLY: starting
0709 13:21:04.860636 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:05.040909 (+180273us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:05.040937 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:05.177731 (+136794us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:05.178215 (+   484us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=72,key_file_lookups=72,delta_file_lookups=0,mrs_lookups=0
0709 13:21:05.178261 (+    46us) write_op.cc:312] APPLY: finished
0709 13:21:05.178830 (+   569us) log.cc:844] Serialized 308 byte log entry
0709 13:21:05.179628 (+   798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:05.179941 (+   313us) write_op.cc:454] Released schema lock
0709 13:21:05.180009 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:05.186064 (+  6055us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:05.186095 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1548300,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":131396,"apply.run_cpu_time_us":48839,"apply.run_wall_time_us":319912,"cfile_cache_hit":146,"cfile_cache_hit_bytes":154679,"num_ops":36,"prepare.queue_time_us":364737,"prepare.run_cpu_time_us":37030,"prepare.run_wall_time_us":257524,"raft.queue_time_us":229517,"raft.run_cpu_time_us":7938,"raft.run_wall_time_us":62127,"replication_time_us":336958,"spinlock_wait_cycles":53618432,"thread_start_us":513327,"threads_started":4,"wal-append.queue_time_us":78685,"wal-append.run_cpu_time_us":45468,"wal-append.run_wall_time_us":1718235}]]}
I20260709 13:21:08.218093  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.220458  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:08.221946  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:08.223901  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.224543  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.225677  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:08.225734  4142 raft_consensus.cc:1275] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:21:08.226094  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:08.224068  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
W20260709 13:21:08.236084  4188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:08.249298  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:08.249910  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.251356  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.252271  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.262435  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:08.263602  4144 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:08.265623  4142 raft_consensus.cc:1275] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:21:08.266847  9568 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.304488 10224 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.305512 10224 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:08.309716  4219 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:08.283334 10488 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.309702 10368 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.312520 10488 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.312664 10368 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.315287 10488 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.315536 10368 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.294943 10324 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.316756  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.317024 10324 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.320422 10352 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:21:08.285727 10231 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.327049 10231 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.329885 10231 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.292920 10498 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.311496  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.336898  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.338001 10488 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.338487  4187 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.339038 10135 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:08.338924 10488 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:08.285233 10544 log.cc:927] Time spent T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:21:08.339762 10338 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:08.344298  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.346079  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.344769  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.345366 10488 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:08.348014  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.346812  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:08.335543 10498 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.354409 10535 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:08.356855  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.297750  9568 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.350708  4296 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 13:21:08.349666  4293 raft_consensus.cc:1240] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:08.285868 10342 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.368132  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.368467 10342 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.356737 10498 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.371245 10342 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:08.348631  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:21:08.377604 10532 log.cc:927] Time spent T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:21:08.294963 10536 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:08.378393  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:08.378391  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:08.379694 10498 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:08.380582  4110 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:08.381903 10498 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:08.382786 10224 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:08.320235 10324 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.387284  4295 raft_consensus.cc:2393] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 22: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:08.406155  9568 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.409673  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:08.396675  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 58427.6us
I20260709 13:21:08.417766  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.418836 10422 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:08.419602  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:08.385651  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66812.2us
I20260709 13:21:08.378551 10536 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.430100  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.431285  4290 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:08.437263  4144 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 19.
I20260709 13:21:08.427136 10422 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:08.447667 10536 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.451041  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.458952  4142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:08.460892  4140 raft_consensus.cc:1240] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Rejecting Update request from peer 34e6205f3c1d434193126fef20d73800 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:08.465758  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:08.475654  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:08.481623  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 45358.2us
I20260709 13:21:08.481467  4288 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 13.
I20260709 13:21:08.506376  4214 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
I20260709 13:21:08.521070  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:08.523106  4185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:08.523217  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:08.525671  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:08.538205  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:08.541431  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.542915 10441 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:08.552635  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:08.556385  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:08.566571  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:08.572403  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.573392 10342 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:21:08.602451 10488 consensus_queue.cc:1059] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:08.603838 10278 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:08.604400 10278 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:08.604970 10488 consensus_queue.cc:1059] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:08.606272 10535 raft_consensus.cc:3055] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:08.606137 10278 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.606716 10535 raft_consensus.cc:740] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:08.607936 10535 consensus_queue.cc:260] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.606773  4111 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.609905 10535 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:08.611567 10488 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:08.615818 10278 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:08.618142  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.614584  4216 raft_consensus.cc:1240] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:08.625160  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.628732 10342 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:08.642580  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.650143 10489 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.677645  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.666512 10476 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:08.671180  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:08.691602  4293 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:21:08.701362  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.702625 10462 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:21:08.703909 10462 consensus_queue.cc:1048] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:08.706538 10342 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:21:08.681581 10489 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:21:08.707852 10239 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:08.725584  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.726781 10476 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:08.732961 10489 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:21:08.733685 10489 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:08.734190 10489 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:08.738780 10171 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.739758 10171 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.754122  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.755395 10476 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:08.756983 10171 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.758891  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:08.762194  4290 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:21:08.764726  4186 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:08.759865  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:08.764895  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 95295us
I20260709 13:21:08.769037 10342 consensus_queue.cc:1048] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:08.769477  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.771710 10536 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:08.773551  4111 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.774698 10171 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:08.782210 10171 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.783015 10171 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:08.784140  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:08.785235 10342 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:08.785892 10342 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:08.776765  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.775544 10536 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:08.787106 10342 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.795589  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.798909  4111 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.801231  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.794634 10536 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:08.801271 10488 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:08.806780 10496 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:08.800243 10278 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:08.822981  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:08.822633 10422 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:08.837996  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:08.843127  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.852165 10422 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.855229 10422 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:08.830227 10324 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:08.859462 10489 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.889864 10476 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:08.908222  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:08.910509  4145 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 13.
W20260709 13:21:08.952554  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 53228.4us
I20260709 13:21:08.974859  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:08.948755 10422 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:21:08.979360 10422 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.979908 10422 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:08.985226 10489 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:08.986236 10171 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:08.989449  4138 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:21:09.002769  4146 raft_consensus.cc:2468] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:09.012658 10535 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:09.013429 10535 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.016242 10171 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:09.016003 10535 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:09.030066  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:09.031230  4218 raft_consensus.cc:2393] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 13: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:09.031270  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:09.053313  4216 raft_consensus.cc:2368] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15.
I20260709 13:21:09.061919  4039 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.064610  4290 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 9. Current term is 10. Ops: []
I20260709 13:21:09.065412  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:09.069078  4144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:09.069954  4144 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:21:09.076205 10422 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.085227 10348 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.085973 10348 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.091331  4261 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:21:09.093346  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 64994us
I20260709 13:21:09.094576  4112 leader_election.cc:400] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15.
I20260709 13:21:09.095000  4112 leader_election.cc:403] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:09.097435 10422 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:09.099550  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49574us
I20260709 13:21:09.108474  4144 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
W20260709 13:21:09.127853  4893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:09.109735 10348 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:09.115406  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:09.099689 10558 raft_consensus.cc:2804] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:21:09.133533  4045 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 88) took 57209 ms (client timeout 15000 ms). Trace:
I20260709 13:21:09.138602  4296 raft_consensus.cc:2368] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14.
I20260709 13:21:09.101743 10239 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:21:09.142937  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:09.118067 10535 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005) with higher term. Message: Invalid argument: T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15.
I20260709 13:21:09.148087  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:09.155083  4295 raft_consensus.cc:2393] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in current term 14: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:09.156452  4293 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:21:09.154385  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:09.164009  4292 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:09.149786 10558 raft_consensus.cc:697] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:09.169420 10558 consensus_queue.cc:237] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:09.134438  4045 rpcz_store.cc:269] 0709 13:20:11.923532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.923763 (+   231us) service_pool.cc:224] Handling call
0709 13:21:09.133249 (+57209486us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:08.400832 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:08.402146 (+  1314us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:08.402210 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:21:08.402234 (+    24us) tablet.cc:662] Decoding operations
0709 13:21:08.402714 (+   480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:08.402800 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:08.402833 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:08.403174 (+   341us) tablet.cc:701] Row locks acquired
0709 13:21:08.403238 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:21:08.403411 (+   173us) write_op.cc:270] Start()
0709 13:21:08.403588 (+   177us) write_op.cc:276] Timestamp: P: 1783603268403350 usec, L: 0
0709 13:21:08.403634 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:21:08.429248 (+ 25614us) log.cc:844] Serialized 533 byte log entry
0709 13:21:08.765606 (+336358us) op_driver.cc:464] REPLICATION: finished
0709 13:21:08.842890 (+ 77284us) write_op.cc:301] APPLY: starting
0709 13:21:08.843030 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:08.845400 (+  2370us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:08.845526 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:08.854510 (+  8984us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:08.854875 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:21:08.854951 (+    76us) write_op.cc:312] APPLY: finished
0709 13:21:08.855306 (+   355us) log.cc:844] Serialized 25 byte log entry
0709 13:21:08.879916 (+ 24610us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:08.882518 (+  2602us) write_op.cc:454] Released schema lock
0709 13:21:08.882613 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:08.883216 (+   603us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:08.883259 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":270187,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":76870,"apply.run_cpu_time_us":5522,"apply.run_wall_time_us":40292,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":154983,"prepare.run_cpu_time_us":25569,"prepare.run_wall_time_us":127836,"raft.queue_time_us":72698,"raft.run_cpu_time_us":4446,"raft.run_wall_time_us":67153,"replication_time_us":361769,"thread_start_us":158858,"threads_started":4,"wal-append.queue_time_us":146497}]]}
I20260709 13:21:09.192581  9568 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:09.202533  4039 catalog_manager.cc:5697] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.204275  4927 consensus_queue.cc:237] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:09.224784  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 66671.3us
I20260709 13:21:09.212649 10498 raft_consensus.cc:3055] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:21:09.234699 10498 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:09.243181  4187 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:09.243646  4186 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:09.247154  4039 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 10 to 14, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 14 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.287330  4111 leader_election.cc:400] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14.
I20260709 13:21:09.287823  4111 leader_election.cc:403] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:21:09.290014  9568 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:09.292390  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:09.299788  4292 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
W20260709 13:21:09.305418  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 62350.5us
I20260709 13:21:09.235898 10498 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:09.319118 10498 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:21:09.330811  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 87276.6us
I20260709 13:21:09.331383 10568 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:21:09.331728  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 53324.7us
I20260709 13:21:09.332104 10568 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:09.333335 10568 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:09.331074  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88008.4us
I20260709 13:21:09.338676 10135 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.339383 10135 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.342195 10135 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:09.331048 10339 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:09.346024 10339 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.346817 10339 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:09.345999  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:09.349561  4296 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 22.
I20260709 13:21:09.361191  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:09.382619  4141 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:09.391357  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:09.399518  4292 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:21:09.404592  4145 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:21:09.422127  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:09.433725  4215 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:21:09.434365  4215 pending_rounds.cc:85] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Aborting all ops after (but not including) 10
I20260709 13:21:09.434605  4215 pending_rounds.cc:107] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:21:09.434938  4215 raft_consensus.cc:2889] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:09.419662 10570 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:21:09.444115 10422 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:09.453718  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:09.454777  4216 raft_consensus.cc:3060] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:21:09.459188  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 106228us
I20260709 13:21:09.467067  9568 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 13. Current term is 14.
W20260709 13:21:09.488629  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 124129us
I20260709 13:21:09.508812  4138 raft_consensus.cc:1275] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:21:09.518258  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:09.519842 10533 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:09.520328 10533 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.520783 10533 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:09.537228  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:09.538204  4143 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 22.
I20260709 13:21:09.539515  4139 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
W20260709 13:21:09.531152 10572 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:21:09.496780 10352 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:21:09.569697  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 153800us
I20260709 13:21:09.580276  4261 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:09.592586 10422 raft_consensus.cc:2804] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:21:09.610229 10547 consensus_queue.cc:1048] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:21:09.636576 10422 raft_consensus.cc:697] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:09.652817 10339 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.663261 10422 consensus_queue.cc:237] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.690035  4216 raft_consensus.cc:2468] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:21:09.703786 10339 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:09.724649 10582 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.725656 10582 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.737213  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:09.738144  4296 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:09.757920 10582 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:09.762466 10533 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.763074 10570 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:09.765038 10533 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:09.778628  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:09.779470  4145 raft_consensus.cc:3060] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:21:09.804986  4215 raft_consensus.cc:3060] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:09.804805  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:09.807029  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:09.808897  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:09.809639  4293 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:09.830204  4141 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:09.842010  4293 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 23.
I20260709 13:21:09.849723  4145 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:09.852804  4215 raft_consensus.cc:1275] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:09.852824  4187 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:09.851588  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:09.864624 10568 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:09.865406 10568 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:09.866465 10568 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:09.868829  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:09.869632  4145 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:09.869408 10587 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:09.881538  4145 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 23.
I20260709 13:21:09.890077  4296 raft_consensus.cc:2468] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:09.890473  4187 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:09.898900 10576 raft_consensus.cc:2804] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:09.907346 10547 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 5 to 9, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:09.905956 10587 consensus_queue.cc:1048] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
W20260709 13:21:09.951184  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52843.3us
I20260709 13:21:09.910277  4295 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 5 to 9, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:09.959060 10348 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:09.973414  4043 catalog_manager.cc:5697] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:09.965693 10576 raft_consensus.cc:697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:09.997304  4043 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:09.999056  4043 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.020008  4043 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.021919  4043 catalog_manager.cc:5697] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 10, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.023931  4043 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 11 to 13, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 13 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.032495  4043 catalog_manager.cc:5697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:10.031080  4039 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 89) took 37460 ms (client timeout 15000 ms). Trace:
I20260709 13:21:10.045686  4293 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:10.046873  4043 catalog_manager.cc:5697] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.062281  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:10.070804  4043 catalog_manager.cc:5697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.073117  4043 catalog_manager.cc:5697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.074851 10533 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:21:10.077004  4043 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.103214  4043 catalog_manager.cc:5697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 6 to 13, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 13 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.114185  4138 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:10.122812  4043 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 11 to 15, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 15 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.135838  4043 catalog_manager.cc:5697] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 18, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 18 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.137360  4043 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 15, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.169328  4043 catalog_manager.cc:5697] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 19, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.165454 10348 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:21:10.181679  4043 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 16 to 19, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:10.038475  4039 rpcz_store.cc:269] 0709 13:20:32.570527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.570858 (+   331us) service_pool.cc:224] Handling call
0709 13:20:33.193544 (+622686us) spinlock_profiling.cc:243] Waited 57.2 ms on lock 0x7b54000dacd4. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4c090 00007fee3eceaf3a 00007fee44aa11cc 00007fee44b9f37e 00007fee430602a4 00007fee43060232 00007fee43060161 00007fee430600dc 00007fee4305f392 00007fee3d01d48c 00007fee3d01c8c6
0709 13:21:10.030959 (+36837415us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:09.356860 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:09.481409 (+124549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:09.481456 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:21:09.481477 (+    21us) tablet.cc:662] Decoding operations
0709 13:21:09.482229 (+   752us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:09.482337 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:09.482379 (+    42us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:21:09.482782 (+   403us) tablet.cc:701] Row locks acquired
0709 13:21:09.482804 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:21:09.482994 (+   190us) write_op.cc:270] Start()
0709 13:21:09.483146 (+   152us) write_op.cc:276] Timestamp: P: 1783603269482926 usec, L: 0
0709 13:21:09.483173 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:21:09.484047 (+   874us) log.cc:844] Serialized 1293 byte log entry
0709 13:21:09.728870 (+244823us) op_driver.cc:464] REPLICATION: finished
0709 13:21:09.780086 (+ 51216us) write_op.cc:301] APPLY: starting
0709 13:21:09.780186 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:09.875663 (+ 95477us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:09.875798 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:09.920956 (+ 45158us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:09.921239 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:21:09.921299 (+    60us) write_op.cc:312] APPLY: finished
0709 13:21:09.921592 (+   293us) log.cc:844] Serialized 41 byte log entry
0709 13:21:09.921813 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:09.921970 (+   157us) write_op.cc:454] Released schema lock
0709 13:21:09.922022 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:09.922537 (+   515us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:09.922575 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":283439,"reported_tablets":19,"spinlock_wait_cycles":131600256,"child_traces":[["op",{"apply.queue_time_us":50848,"apply.run_cpu_time_us":7593,"apply.run_wall_time_us":142400,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16673,"num_ops":3,"prepare.queue_time_us":36980,"prepare.run_cpu_time_us":4774,"prepare.run_wall_time_us":131383,"replication_time_us":245442,"thread_start_us":90728,"threads_started":2}]]}
I20260709 13:21:10.200867 10576 consensus_queue.cc:237] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:10.210780 10591 log.cc:927] Time spent T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:21:10.226625 10339 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:10.247133 10339 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:10.194998  4043 catalog_manager.cc:5697] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 18, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 18 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.253589  4043 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 16 to 19, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.255957  4043 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.269039 10339 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:10.284263  4043 catalog_manager.cc:5697] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.286155  4043 catalog_manager.cc:5697] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:10.288806  4043 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 18 to 20, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 20 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.291759 10455 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:10.320771 10455 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:10.295326  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:10.304109  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:10.323931 10455 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:10.325554  4138 raft_consensus.cc:2955] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 5 to 9, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:10.327194  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:10.328141  4296 raft_consensus.cc:2393] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 in current term 10: Already voted for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in this term.
I20260709 13:21:10.328557  4043 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.330547  4043 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.334896  4043 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:10.343729 10547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44870 (request call id 1) took 1262 ms. Trace:
I20260709 13:21:10.374118  4043 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 17, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 17 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.380707  4187 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:10.362535  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:10.382766  4145 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:21:10.395053  4218 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:10.395738  4139 raft_consensus.cc:1275] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:10.388942 10339 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:10.405086 10587 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.375504 10547 rpcz_store.cc:276] 0709 13:21:09.081275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:09.086854 (+  5579us) service_pool.cc:224] Handling call
0709 13:21:09.173925 (+ 87071us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b58009125d0. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee3ec4b571 00007fee3ec3e0aa 00007fee3ecc0447 00007fee3ecdd70a 00007fee3ecde76a 00007fee3ecdd91b 00007fee3ece903c 00007fee3ece86b3 00007fee3ece09fa 00007fee43ca84c9 00007fee3d224c54
0709 13:21:09.265657 (+ 91732us) log.cc:844] Serialized 494 byte log entry
0709 13:21:09.386605 (+120948us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b1800053020. stack: 00007fee3bbc3343 00007fee3bbc3240 00007fee3b5521d4 00007fee45290304 00007fee45290299 00007fee44abdde1 00007fee44aca5b1 00007fee3bbf53f3 00007fee3bbf77c1 00007fee3bbf7779 00007fee3bbf7709 00007fee3bbf76d1 00007fee3bbf69cd 000000000038f354 000000000038f199 00007fee3bbd883a
0709 13:21:10.343266 (+956661us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":476,"raft.run_cpu_time_us":1683,"raft.run_wall_time_us":37650,"spinlock_wait_cycles":38257664,"thread_start_us":83916,"threads_started":1,"wal-append.queue_time_us":192073}
I20260709 13:21:10.423444  4029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a767a88581024d12b14e9f965193d404 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:10.405839 10587 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:10.428767 10587 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:10.437631  4139 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:21:10.442127  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:10.443835 10222 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:21:10.444342 10222 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:10.444797 10222 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:21:10.459427 10599 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:21:10.476769  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:10.488153  4295 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:21:10.492645 10222 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:10.510948  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:10.512084  4139 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:21:10.530591  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:10.526046 10462 consensus_queue.cc:1048] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:21:10.545042 10348 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:21:10.557708 10222 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:10.562427  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:10.576848  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:10.570962 10342 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:21:10.588277 10342 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.593827 10342 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:21:10.719877  4140 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:21:10.722173  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:10.746431  4140 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:10.744531 10455 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:21:10.757743  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:10.751157 10135 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:21:10.753022 10455 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:21:10.772280 10455 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:10.785676 10342 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:10.787307  4295 raft_consensus.cc:2368] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11.
I20260709 13:21:10.786814  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:10.790686  4140 raft_consensus.cc:606] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:10.791919  4892 leader_election.cc:400] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 election: Vote denied by peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585) with higher term. Message: Invalid argument: T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11.
I20260709 13:21:10.796783  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:10.798148  4140 raft_consensus.cc:606] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:10.803162  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:10.803164 10231 raft_consensus.cc:993] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:10.804847  9568 raft_consensus.cc:1081] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:10.804955  4140 raft_consensus.cc:606] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:10.805932  4140 raft_consensus.cc:614] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:10.804603 10567 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:10.812589 10481 raft_consensus.cc:993] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:10.816144 10481 raft_consensus.cc:1081] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:10.813436  4140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6478d83fa954184a297fb7466378df1"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:10.818535  4140 raft_consensus.cc:606] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:10.819360  4140 raft_consensus.cc:614] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:10.834138 10342 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:10.840830  4296 raft_consensus.cc:1275] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:10.840708  4287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:21:10.841856  4287 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.842275  4287 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:10.840643  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:10.844587  4146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:10.840611  4218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:10.845741  4146 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:21:10.846294  4218 raft_consensus.cc:606] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 17 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:10.854377  4288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:21:10.855278  4288 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.856510  4288 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:10.868305  4288 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:10.883496 10135 consensus_queue.cc:1048] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:10.880296  4287 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:10.894411  4145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:10.899120  4145 raft_consensus.cc:606] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:10.899575  4145 raft_consensus.cc:614] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:10.900449  4146 raft_consensus.cc:2468] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 11.
I20260709 13:21:10.902933  4296 raft_consensus.cc:1240] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:10.904090  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:10.909353  4287 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:10.911321  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:10.912942  4261 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: b81584b21ed144698954548303f1e507
I20260709 13:21:10.914300  4288 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:10.917620  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:10.918344  4138 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:10.918630  4138 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:10.919417  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:10.920058  4140 raft_consensus.cc:3055] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:10.920403  4140 raft_consensus.cc:740] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:10.921918  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:10.922389  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:10.924573  4216 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:10.922492 10342 raft_consensus.cc:2804] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:21:10.931859 10342 raft_consensus.cc:697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:10.933168 10342 consensus_queue.cc:237] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:10.937595  4138 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:10.939249  4138 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:10.921221  4140 consensus_queue.cc:260] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:10.946961  9568 consensus_queue.cc:1059] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:10.948899  4218 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:10.973289  4216 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:21:10.975327  4138 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 14.
I20260709 13:21:10.976270  4140 raft_consensus.cc:3060] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:10.982052  4218 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:10.976720  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:10.985848 10601 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:21:10.992908  4261 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:10.996709 10562 raft_consensus.cc:2804] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:10.998004 10562 raft_consensus.cc:697] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:10.999050 10562 consensus_queue.cc:237] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:11.040870 10601 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:11.042213 10601 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:11.040639  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 43483us
I20260709 13:21:11.076926  4140 raft_consensus.cc:2468] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:11.106302 10563 raft_consensus.cc:993] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:11.106913 10563 raft_consensus.cc:1081] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 17 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:11.109220  4295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:21:11.109884  4295 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.110239  4295 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:11.206177  4295 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:11.216964  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:11.217759  4145 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:11.226950  4145 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:11.231599  4288 raft_consensus.cc:1240] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Rejecting Update request from peer b81584b21ed144698954548303f1e507 for earlier term 10. Current term is 11. Ops: []
I20260709 13:21:11.237622 10577 consensus_queue.cc:1059] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:11.238940 10577 consensus_queue.cc:1243] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [LEADER]: Peer 6f753b799f924bacb0a0f0f6e0068ee9 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:21:11.241942 10578 raft_consensus.cc:3055] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:21:11.242383 10578 raft_consensus.cc:740] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:21:11.243346  4261 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:11.245508 10476 raft_consensus.cc:2804] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:11.246155 10476 raft_consensus.cc:697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:11.247167 10476 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:11.243420 10578 consensus_queue.cc:260] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:11.261293 10578 raft_consensus.cc:3060] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:21:11.286141  4295 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:11.300721  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:11.301607  4218 raft_consensus.cc:3055] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:11.302084  4218 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
W20260709 13:21:11.302938  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 60318.1us
I20260709 13:21:11.310423  4218 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:11.312284  4218 raft_consensus.cc:3060] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:11.352881  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 108718us
I20260709 13:21:11.401883  4138 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:21:11.403374  4218 raft_consensus.cc:2468] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:11.414552  4037 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 12 to 14, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 14 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:11.442001 10476 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:11.447978  4037 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:11.462267  4138 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:11.466492  4218 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:11.467221  4043 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42412 (request call id 178) took 2336 ms. Trace:
I20260709 13:21:11.468245 10570 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:11.467684  4043 rpcz_store.cc:276] 0709 13:21:09.130439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:09.137750 (+  7311us) service_pool.cc:224] Handling call
0709 13:21:11.467111 (+2329361us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:10.626940 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:10.627623 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:10.627674 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:21:10.627695 (+    21us) tablet.cc:662] Decoding operations
0709 13:21:10.681695 (+ 54000us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:10.681771 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:10.681802 (+    31us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:21:10.684269 (+  2467us) tablet.cc:701] Row locks acquired
0709 13:21:10.684289 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:21:10.737739 (+ 53450us) write_op.cc:270] Start()
0709 13:21:10.739029 (+  1290us) write_op.cc:276] Timestamp: P: 1783603270724059 usec, L: 0
0709 13:21:10.739057 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:21:10.758233 (+ 19176us) log.cc:844] Serialized 10521 byte log entry
0709 13:21:10.852571 (+ 94338us) op_driver.cc:464] REPLICATION: finished
0709 13:21:10.981894 (+129323us) write_op.cc:301] APPLY: starting
0709 13:21:10.981998 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:11.240921 (+258923us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:11.241040 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:11.337240 (+ 96200us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:11.337719 (+   479us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 13:21:11.337778 (+    59us) write_op.cc:312] APPLY: finished
0709 13:21:11.338426 (+   648us) log.cc:844] Serialized 236 byte log entry
0709 13:21:11.357194 (+ 18768us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:11.357472 (+   278us) write_op.cc:454] Released schema lock
0709 13:21:11.357577 (+   105us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:11.364796 (+  7219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:11.364840 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46949,"reported_tablets":40,"spinlock_wait_cycles":9472,"child_traces":[["op",{"apply.queue_time_us":129031,"apply.run_cpu_time_us":42506,"apply.run_wall_time_us":382843,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117041,"num_ops":27,"prepare.queue_time_us":132156,"prepare.run_cpu_time_us":9335,"prepare.run_wall_time_us":137206,"replication_time_us":111829,"thread_start_us":215872,"threads_started":2}]]}
I20260709 13:21:11.486057 10570 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:11.502089  4218 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:11.505203  4925 raft_consensus.cc:1275] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:21:11.505718  4925 pending_rounds.cc:85] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Aborting all ops after (but not including) 10
I20260709 13:21:11.505991  4925 pending_rounds.cc:107] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:21:11.506235  4925 raft_consensus.cc:2889] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:11.508141 10570 consensus_queue.cc:1048] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:11.514889 10570 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:11.590745  4138 raft_consensus.cc:1275] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:21:11.599053  4029 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet a767a88581024d12b14e9f965193d404 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b81584b21ed144698954548303f1e507 (127.2.243.68:35693) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 9
I20260709 13:21:11.595619  4927 consensus_queue.cc:237] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:11.580122  4037 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 90) took 23629 ms (client timeout 15000 ms). Trace:
W20260709 13:21:11.620633  4037 rpcz_store.cc:269] 0709 13:20:47.951118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:47.951512 (+   394us) service_pool.cc:224] Handling call
0709 13:21:11.579997 (+23628485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:11.471809 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:11.472499 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:11.472541 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:21:11.472571 (+    30us) tablet.cc:662] Decoding operations
0709 13:21:11.480743 (+  8172us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:11.480855 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:11.480896 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:21:11.481256 (+   360us) tablet.cc:701] Row locks acquired
0709 13:21:11.481275 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:21:11.481449 (+   174us) write_op.cc:270] Start()
0709 13:21:11.481586 (+   137us) write_op.cc:276] Timestamp: P: 1783603271481393 usec, L: 0
0709 13:21:11.481613 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:21:11.482573 (+   960us) log.cc:844] Serialized 913 byte log entry
0709 13:21:11.491643 (+  9070us) op_driver.cc:464] REPLICATION: finished
0709 13:21:11.492630 (+   987us) write_op.cc:301] APPLY: starting
0709 13:21:11.492754 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:11.494553 (+  1799us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:11.494646 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:11.496208 (+  1562us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:11.499335 (+  3127us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:21:11.499395 (+    60us) write_op.cc:312] APPLY: finished
0709 13:21:11.499676 (+   281us) log.cc:844] Serialized 33 byte log entry
0709 13:21:11.501307 (+  1631us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:11.501414 (+   107us) write_op.cc:454] Released schema lock
0709 13:21:11.501469 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:11.502119 (+   650us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:11.502155 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11147,"reported_tablets":19,"spinlock_wait_cycles":5504,"child_traces":[["op",{"apply.queue_time_us":676,"apply.run_cpu_time_us":4992,"apply.run_wall_time_us":9241,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":4930,"prepare.run_cpu_time_us":3777,"prepare.run_wall_time_us":30287,"replication_time_us":9824,"thread_start_us":5653,"threads_started":1}]]}
I20260709 13:21:11.629005 10562 consensus_queue.cc:1048] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:11.643431  4295 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:11.646467 10622 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:11.657292  4218 raft_consensus.cc:1275] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:11.658939 10622 consensus_queue.cc:1048] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:11.708921  4141 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:11.752635  4219 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 5 to 11, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:11.737134 10622 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 5 to 11, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:11.759266 10570 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:21:11.792124  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 60987.8us
W20260709 13:21:11.797534  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 68069us
I20260709 13:21:11.865247  4296 raft_consensus.cc:2955] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 5 to 11, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:11.869325  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50377.3us
I20260709 13:21:11.872924  4043 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 17 to 19, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 19 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:11.877372  4043 catalog_manager.cc:5697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 23, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 23 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:11.879204  4043 catalog_manager.cc:5697] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 9 to 11, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 11 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:11.888598  4043 catalog_manager.cc:5697] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 7 to 14, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 14 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:11.890650  4043 catalog_manager.cc:5697] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 14 to 23, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 23 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:21:11.903151  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 78241.9us
I20260709 13:21:11.896797  4043 catalog_manager.cc:5697] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 5 to 9, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 10 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:11.908980  4029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d9ed971e9cd64f17bc8646a1d19e3622 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:11.921798  4216 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:11.933156 10342 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:11.912945  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:11.984812  4043 catalog_manager.cc:5697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:11.986482  4043 catalog_manager.cc:5697] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:11.987982  4043 catalog_manager.cc:5697] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 18 to 21, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 21 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:11.992050  4043 catalog_manager.cc:5697] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:11.993682  4043 catalog_manager.cc:5697] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 14 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
W20260709 13:21:12.015106  4044 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 164) took 19083 ms (client timeout 15000 ms). Trace:
W20260709 13:21:12.030545  4044 rpcz_store.cc:269] 0709 13:20:52.931736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.931932 (+   196us) service_pool.cc:224] Handling call
0709 13:21:12.014840 (+19082908us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":365435,"reported_tablets":53}
I20260709 13:21:12.302779  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet a767a88581024d12b14e9f965193d404 with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:56112
I20260709 13:21:12.341665 10651 tablet_replica.cc:333] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:12.387034  4036 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 13 to 15, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:12.395835  4036 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 13 to 15, leader changed from b81584b21ed144698954548303f1e507 (127.2.243.68) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:12.406756  4036 catalog_manager.cc:5697] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:12.474061  4043 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 13 to 14, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 14 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:12.476032  4043 catalog_manager.cc:5697] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 17 to 18, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 18 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:12.477727  4043 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 17 to 18, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 18 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } }
I20260709 13:21:12.483395 10339 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:12.484236 10339 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:12.489019  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:12.491004  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:12.493122  4186 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:12.494215 10581 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:12.496202  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:12.499029 10339 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:12.510627 10651 raft_consensus.cc:2243] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.512006 10651 raft_consensus.cc:2272] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.516291 10651 ts_tablet_manager.cc:1916] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:12.617182  4036 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 181) took 9852 ms. Trace:
W20260709 13:21:12.669301  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 99894.8us
I20260709 13:21:12.671209 10651 ts_tablet_manager.cc:1929] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:21:12.728463 10651 log.cc:1199] T a767a88581024d12b14e9f965193d404 P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/a767a88581024d12b14e9f965193d404
I20260709 13:21:12.617901  4036 rpcz_store.cc:276] 0709 13:21:02.765387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.768576 (+  3189us) service_pool.cc:224] Handling call
0709 13:21:12.617072 (+9848496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:12.430251 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:12.430854 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:12.430913 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:21:12.430926 (+    13us) tablet.cc:662] Decoding operations
0709 13:21:12.431517 (+   591us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:12.431575 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:12.431609 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:21:12.431951 (+   342us) tablet.cc:701] Row locks acquired
0709 13:21:12.431964 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:21:12.432126 (+   162us) write_op.cc:270] Start()
0709 13:21:12.432255 (+   129us) write_op.cc:276] Timestamp: P: 1783603272432077 usec, L: 0
0709 13:21:12.432271 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:21:12.433055 (+   784us) log.cc:844] Serialized 1293 byte log entry
0709 13:21:12.435707 (+  2652us) op_driver.cc:464] REPLICATION: finished
0709 13:21:12.436699 (+   992us) write_op.cc:301] APPLY: starting
0709 13:21:12.436796 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:12.438856 (+  2060us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:12.438952 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:12.441693 (+  2741us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:12.442058 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:21:12.442129 (+    71us) write_op.cc:312] APPLY: finished
0709 13:21:12.442431 (+   302us) log.cc:844] Serialized 41 byte log entry
0709 13:21:12.446649 (+  4218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:12.446758 (+   109us) write_op.cc:454] Released schema lock
0709 13:21:12.446807 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:12.456755 (+  9948us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:12.456789 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4745,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":730,"apply.run_cpu_time_us":6504,"apply.run_wall_time_us":19983,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":140,"prepare.run_cpu_time_us":3138,"prepare.run_wall_time_us":5074,"replication_time_us":3242}]]}
W20260709 13:21:12.828434  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 121054us
I20260709 13:21:13.009366  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet a767a88581024d12b14e9f965193d404 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:13.013681 10324 raft_consensus.cc:493] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:13.014540 10324 raft_consensus.cc:515] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:13.229943  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 145546us
W20260709 13:21:13.221127  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 183503us
I20260709 13:21:13.304306 10324 leader_election.cc:290] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:13.319118  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:13.327507  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 52908.3us
W20260709 13:21:13.337898  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 102647us
I20260709 13:21:13.372797  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:13.385639  4110 leader_election.cc:304] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:13.391784 10670 raft_consensus.cc:2749] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:13.393332  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50486.5us
I20260709 13:21:13.404374  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ed971e9cd64f17bc8646a1d19e3622" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:13.434772  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:13.439775  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62290.2us
W20260709 13:21:13.517419  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 165249us
W20260709 13:21:13.522137  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67396.2us
I20260709 13:21:13.652076  4041 catalog_manager.cc:5697] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 14 to 15, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 15 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:13.763713  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet a767a88581024d12b14e9f965193d404 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:56112
I20260709 13:21:13.765400  4209 tablet_service.cc:1558] Processing DeleteTablet for tablet a35e1cee8a15436dbfaf75dd67824aad with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:56112
W20260709 13:21:13.805377  4038 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42420 (request call id 180) took 31283 ms (client timeout 15000 ms). Trace:
I20260709 13:21:13.821699  4041 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet a767a88581024d12b14e9f965193d404 with cas_config_opid_index 5: aborting the task: latest config opid_index 9; task opid_index 5
W20260709 13:21:13.823756  4029 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet d9ed971e9cd64f17bc8646a1d19e3622 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b81584b21ed144698954548303f1e507 (127.2.243.68:35693) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 11
I20260709 13:21:13.831272  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet a767a88581024d12b14e9f965193d404 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:13.832319  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet a35e1cee8a15436dbfaf75dd67824aad (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
W20260709 13:21:13.808529  4038 rpcz_store.cc:269] 0709 13:20:42.735206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.735585 (+   379us) service_pool.cc:224] Handling call
0709 13:21:13.805256 (+31069671us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":482451,"reported_tablets":54}
I20260709 13:21:13.848629  4041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41016 (request call id 91) took 9244 ms. Trace:
I20260709 13:21:13.849179  4041 rpcz_store.cc:276] 0709 13:21:04.604210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.604718 (+   508us) service_pool.cc:224] Handling call
0709 13:21:13.848558 (+9243840us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:13.709360 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:13.711388 (+  2028us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:13.711433 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:21:13.711466 (+    33us) tablet.cc:662] Decoding operations
0709 13:21:13.711877 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:13.711963 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:13.711988 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:13.712211 (+   223us) tablet.cc:701] Row locks acquired
0709 13:21:13.712231 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:21:13.712465 (+   234us) write_op.cc:270] Start()
0709 13:21:13.712603 (+   138us) write_op.cc:276] Timestamp: P: 1783603273712390 usec, L: 0
0709 13:21:13.712627 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:21:13.713675 (+  1048us) log.cc:844] Serialized 533 byte log entry
0709 13:21:13.756876 (+ 43201us) op_driver.cc:464] REPLICATION: finished
0709 13:21:13.770371 (+ 13495us) write_op.cc:301] APPLY: starting
0709 13:21:13.770464 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:13.771636 (+  1172us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:13.771743 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:13.780965 (+  9222us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:13.781192 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:21:13.781244 (+    52us) write_op.cc:312] APPLY: finished
0709 13:21:13.781463 (+   219us) log.cc:844] Serialized 25 byte log entry
0709 13:21:13.781635 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:13.781721 (+    86us) write_op.cc:454] Released schema lock
0709 13:21:13.781768 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:13.782203 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:13.782236 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28678,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":13200,"apply.run_cpu_time_us":3420,"apply.run_wall_time_us":11813,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":27458,"prepare.run_cpu_time_us":4125,"prepare.run_wall_time_us":15919,"raft.queue_time_us":31138,"raft.run_cpu_time_us":2023,"raft.run_wall_time_us":20327,"replication_time_us":44039,"thread_start_us":94266,"threads_started":4,"wal-append.queue_time_us":4389}]]}
I20260709 13:21:13.925710  4036 catalog_manager.cc:5697] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 5 to 11, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 15 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:13.949455  4218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:13.950085  4218 raft_consensus.cc:606] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:13.958869  4216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:13.959507  4216 raft_consensus.cc:606] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:13.962265  4216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:13.962942  4216 raft_consensus.cc:606] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:13.966173  4216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:13.975351 10652 raft_consensus.cc:993] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:13.975924 10652 raft_consensus.cc:1081] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:13.978404  4292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:21:13.978960  4292 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:13.979287  4292 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:13.983111  4216 raft_consensus.cc:606] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:13.987936  4216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da0810d325774d7181018ff01e71333a"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:13.988652  4216 raft_consensus.cc:606] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:13.989953  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:14.003660  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:13.990149  4292 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.009619  4292 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:14.010561  4040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 165) took 5196 ms. Trace:
I20260709 13:21:14.010653  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:14.011317  4139 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:14.015661  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:14.016302  4216 raft_consensus.cc:3055] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:14.016613  4216 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:14.017570  4216 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.021173  4216 raft_consensus.cc:3060] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:14.011023  4040 rpcz_store.cc:276] 0709 13:21:08.814529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:08.814772 (+   243us) service_pool.cc:224] Handling call
0709 13:21:14.010397 (+5195625us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105349,"reported_tablets":53}
I20260709 13:21:14.130632  4139 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 21.
W20260709 13:21:14.141202  4042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42424 (request call id 163) took 46572 ms (client timeout 15000 ms). Trace:
W20260709 13:21:14.141646  4042 rpcz_store.cc:269] 0709 13:20:27.568983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.569308 (+   325us) service_pool.cc:224] Handling call
0709 13:21:14.140999 (+46571691us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17096,"reported_tablets":53,"spinlock_wait_cycles":1792}
I20260709 13:21:14.155200  4216 raft_consensus.cc:2468] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 21.
I20260709 13:21:14.174126  4261 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:14.177860 10342 raft_consensus.cc:2804] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:14.178457 10342 raft_consensus.cc:697] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:14.179399 10342 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.197930  4137 tablet_service.cc:1558] Processing DeleteTablet for tablet d9ed971e9cd64f17bc8646a1d19e3622 with delete_type TABLET_DATA_TOMBSTONED (TS 32ebd3bc4af5446f94d9f3ac7c8cf53c not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:43494
I20260709 13:21:14.213217 10696 tablet_replica.cc:333] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:14.226156 10696 raft_consensus.cc:2243] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.237423 10696 raft_consensus.cc:2272] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.256793 10696 ts_tablet_manager.cc:1916] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:14.280901 10696 ts_tablet_manager.cc:1929] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:21:14.281458 10696 log.cc:1199] T d9ed971e9cd64f17bc8646a1d19e3622 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/wals/d9ed971e9cd64f17bc8646a1d19e3622
I20260709 13:21:14.283279  4031 catalog_manager.cc:5028] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): tablet d9ed971e9cd64f17bc8646a1d19e3622 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:14.298923  4042 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 20 to 21, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 21 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.302274 10664 raft_consensus.cc:993] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:14.302835 10652 raft_consensus.cc:1081] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:14.304515  4139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da0810d325774d7181018ff01e71333a"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:21:14.305020  4139 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:14.305353  4139 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:14.315207  4139 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.320394  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:14.320959  4216 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:14.321235  4216 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:14.321925  4216 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.322933  4216 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:14.331673  4216 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 24.
I20260709 13:21:14.333047  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:14.334952 10677 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:14.335480 10677 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:14.336369 10677 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.344506 10664 raft_consensus.cc:993] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:14.345017 10664 raft_consensus.cc:1081] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:14.347718  4140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:21:14.348491  4140 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:14.348919  4140 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:14.351627 10652 raft_consensus.cc:993] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:14.352173 10652 raft_consensus.cc:1081] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:14.354391  4143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:21:14.354977  4143 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:14.355363  4143 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:14.389087  4139 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:14.389348  4042 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 23 to 24, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 24 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.398130  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:14.398787  4292 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:14.390403  4143 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.401906  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:14.402486  4216 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:14.402810  4216 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:14.403606  4216 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.406589  4143 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:14.407820  4216 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:14.421519  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:14.421839  4216 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:14.422243  4296 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:14.433445 10684 raft_consensus.cc:993] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:14.434032 10684 raft_consensus.cc:1081] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:14.435201  4292 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 24.
I20260709 13:21:14.435920  4288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:21:14.439720  4288 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:14.440102  4288 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:14.447391  4288 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.450601  4288 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:14.438205  4112 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:14.375500  4140 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.456426 10660 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:14.457479  4140 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:14.460070  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:14.460685  4219 raft_consensus.cc:3055] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:14.460963  4219 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:14.461642  4219 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.462687  4219 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:14.437067  4296 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:14.452647  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:14.475310  4143 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:14.452648  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:14.480657  4216 raft_consensus.cc:3055] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:14.481034  4216 raft_consensus.cc:740] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:14.481837  4216 consensus_queue.cc:260] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.483258  4216 raft_consensus.cc:3060] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:14.492082  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:14.492949  4288 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:14.494910  4143 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 20.
I20260709 13:21:14.506039  4216 raft_consensus.cc:2468] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 20.
I20260709 13:21:14.507362  4261 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:14.508276 10686 raft_consensus.cc:2804] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:14.508819 10686 raft_consensus.cc:697] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:14.509761 10686 consensus_queue.cc:237] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.534065  4219 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:21:14.541322  4112 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:14.543321 10677 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:14.543777 10677 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:14.544641 10677 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.543883  4042 catalog_manager.cc:5697] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 19 to 20, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 20 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.577189 10660 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:14.578356 10660 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:14.584619  4288 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 19.
I20260709 13:21:14.609747  4042 catalog_manager.cc:5697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 16, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 16 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.647423  4215 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:14.649060 10686 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:14.667156  4042 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 18 to 19, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.676123  4143 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:14.678427 10686 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:14.878768  4215 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:21:14.881074 10698 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:14.914916  4288 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:21:14.917105 10677 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:14.981240  4139 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:14.984579 10342 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:15.004822  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:15.106485  4290 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:15.117915  4215 raft_consensus.cc:1275] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:15.133419  4219 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:15.136915 10660 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:15.144284  4215 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:21:15.136943 10657 consensus_queue.cc:1048] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:21:15.165282 10660 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:15.192030 10699 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:15.193753  4295 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:21:15.268071  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 49268.2us
I20260709 13:21:15.290004 10700 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:21:15.319676  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 219398us
W20260709 13:21:15.424904  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 115901us
W20260709 13:21:15.476009  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 73937.4us
I20260709 13:21:15.500185  4218 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:15.584614  4185 consensus_peers.cc:597] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9ebd7fa04d4401f96670bd2866c719c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.596748  4288 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:15.621591 10664 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:21:15.680152  4139 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:15.693691 10684 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:15.698591  4288 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:21:15.715986  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 93459.5us
W20260709 13:21:15.721793  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 76622.7us
I20260709 13:21:15.731993 10684 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:15.733611  4042 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:15.763890  4143 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:15.887755  4143 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:15.945020  4110 consensus_peers.cc:597] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10d1753ccc1e4c2d98ff3195cd6bb590. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.945429  4218 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:15.945953  4288 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:15.947386 10699 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:15.962736 10660 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:16.040899 10699 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:16.046738 10736 ts_tablet_manager.cc:933] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:16.047248  4216 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:16.078490  4288 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:16.096882  4036 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:16.110882 10736 tablet_copy_client.cc:323] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:21:16.113505  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet b9ebd7fa04d4401f96670bd2866c719c from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:21:16.114288  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet b9ebd7fa04d4401f96670bd2866c719c from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-b9ebd7fa04d4401f96670bd2866c719c
I20260709 13:21:16.125722  4232 tablet_copy_source_session.cc:215] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:16.251094  4288 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:16.254287 10736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ebd7fa04d4401f96670bd2866c719c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:16.366235  4259 consensus_peers.cc:597] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 033774cd1e264e69977f9f6f2e5a42e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.393859  4216 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:16.397257 10736 tablet_copy_client.cc:806] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:16.397526  4141 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:16.413863 10736 tablet_copy_client.cc:670] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:16.416095 10740 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:16.430409  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:16.432986 10736 tablet_copy_client.cc:538] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:16.461997 10342 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:16.468758 10741 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:21:16.489008 10736 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:16.507161 10657 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:16.531368  4219 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:16.562671 10744 ts_tablet_manager.cc:933] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:21:16.576207 10744 tablet_copy_client.cc:323] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:21:16.578843  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet 10d1753ccc1e4c2d98ff3195cd6bb590 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:21:16.579752  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet 10d1753ccc1e4c2d98ff3195cd6bb590 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-10d1753ccc1e4c2d98ff3195cd6bb590
I20260709 13:21:16.590430  4156 tablet_copy_source_session.cc:215] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:16.600518  4146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:16.601349  4146 raft_consensus.cc:606] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:21:16.617971 10744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d1753ccc1e4c2d98ff3195cd6bb590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.655027  4036 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 13, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 21 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:21:16.686964  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 71232.5us
W20260709 13:21:16.701323  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 92132.1us
I20260709 13:21:16.703330  4146 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:16.847525  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 80946.5us
W20260709 13:21:16.870257  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 55334.1us
W20260709 13:21:16.874208  4110 consensus_peers.cc:597] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e7cd0a583da4bb18010d5a62595ea88. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.892688  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 195176us
I20260709 13:21:16.896456  4144 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:21:16.923120  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50149.7us
I20260709 13:21:16.968292 10770 ts_tablet_manager.cc:933] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:16.998281  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 72638.4us
W20260709 13:21:16.998886  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 74269.6us
I20260709 13:21:17.005041  4296 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:21:17.068667  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 44645.1us
W20260709 13:21:17.075843  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 155374us
I20260709 13:21:17.028041 10720 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
W20260709 13:21:17.170711  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 52236.4us
I20260709 13:21:17.196645 10748 raft_consensus.cc:993] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:17.210788 10748 raft_consensus.cc:1081] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
W20260709 13:21:17.214942  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 122565us
W20260709 13:21:17.222708  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 120822us
I20260709 13:21:17.304288  4215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44160
I20260709 13:21:17.305090  4215 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:17.305517  4215 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:17.285630 10770 tablet_copy_client.cc:323] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.67:40585
I20260709 13:21:17.311225 10736 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:17.312547 10736 tablet_bootstrap.cc:492] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:17.313494 10736 ts_tablet_manager.cc:1403] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.825s	user 0.053s	sys 0.011s
I20260709 13:21:17.321745  4222 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:17.332101  4215 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:17.343811 10785 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 13:21:17.360679  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 57762.6us
I20260709 13:21:17.369946  4215 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:17.378782  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:17.379670  4925 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:17.394892  4306 tablet_copy_service.cc:140] P 6f753b799f924bacb0a0f0f6e0068ee9: Received BeginTabletCopySession request for tablet 033774cd1e264e69977f9f6f2e5a42e8 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:47710)
I20260709 13:21:17.395687  4306 tablet_copy_service.cc:161] P 6f753b799f924bacb0a0f0f6e0068ee9: Beginning new tablet copy session on tablet 033774cd1e264e69977f9f6f2e5a42e8 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:47710: session id = b81584b21ed144698954548303f1e507-033774cd1e264e69977f9f6f2e5a42e8
I20260709 13:21:17.395938 10736 raft_consensus.cc:359] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:17.395689 10744 tablet_copy_client.cc:806] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:17.401815  4222 raft_consensus.cc:1240] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:17.409883  4925 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:17.413786 10744 tablet_copy_client.cc:670] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:17.423027  4306 tablet_copy_source_session.cc:215] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:17.430183 10770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033774cd1e264e69977f9f6f2e5a42e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.397104 10736 raft_consensus.cc:740] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:17.424698  4185 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:17.435006 10725 raft_consensus.cc:2804] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:17.435618 10725 raft_consensus.cc:697] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:17.437903 10725 consensus_queue.cc:237] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:17.440466  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:17.441558  4139 raft_consensus.cc:3055] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:17.442016  4139 raft_consensus.cc:740] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:17.443250  4139 consensus_queue.cc:260] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:17.445230  4139 raft_consensus.cc:3060] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:17.454931  4295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:57280
I20260709 13:21:17.455730  4295 raft_consensus.cc:606] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:17.467388  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:17.469318  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:17.485244  4139 raft_consensus.cc:2468] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:17.488742  4038 catalog_manager.cc:5697] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 14 to 15, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.463167 10736 consensus_queue.cc:260] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:17.537797 10779 raft_consensus.cc:993] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:17.538460 10779 raft_consensus.cc:1081] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:17.540251 10736 ts_tablet_manager.cc:1434] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.226s	user 0.012s	sys 0.000s
I20260709 13:21:17.559700  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-b9ebd7fa04d4401f96670bd2866c719c received from {username='slave'} at 127.0.0.1:54764
I20260709 13:21:17.560386  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-b9ebd7fa04d4401f96670bd2866c719c on tablet b9ebd7fa04d4401f96670bd2866c719c with peer b81584b21ed144698954548303f1e507
I20260709 13:21:17.564570 10744 tablet_copy_client.cc:538] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:17.563899 10750 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:17.573488  4222 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:17.607249  4139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52146
I20260709 13:21:17.607992  4139 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:17.608461  4139 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:17.648887 10736 ts_tablet_manager.cc:933] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:21:17.667156  4139 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:17.676226  4927 raft_consensus.cc:1217] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:21:17.678151  4295 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:17.656792 10744 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:17.684553  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:17.685272  4222 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:17.687541  4139 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:17.688221  4143 raft_consensus.cc:1240] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:17.689141  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:17.689885  4292 raft_consensus.cc:3055] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:17.690205  4292 raft_consensus.cc:740] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:17.691010  4292 consensus_queue.cc:260] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:17.694099  4292 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:17.695653  4222 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:17.700203  4112 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:17.678526 10770 tablet_copy_client.cc:806] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:17.705451  4042 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 14, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.729321  4292 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 16.
I20260709 13:21:17.724941 10770 tablet_copy_client.cc:670] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:17.727227 10660 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:17.747888 10736 tablet_copy_client.cc:323] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:21:17.786831 10770 tablet_copy_client.cc:538] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:17.771003 10660 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:17.798033 10660 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:17.825827  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet 9e7cd0a583da4bb18010d5a62595ea88 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:21:17.827952  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet 9e7cd0a583da4bb18010d5a62595ea88 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-9e7cd0a583da4bb18010d5a62595ea88
I20260709 13:21:17.851101  4156 tablet_copy_source_session.cc:215] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:21:17.869961  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 105123us
I20260709 13:21:17.904953 10770 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:17.928586 10736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7cd0a583da4bb18010d5a62595ea88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.955585  4140 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:18.006742 10762 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:18.026871  4925 raft_consensus.cc:1275] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:18.056358 10776 consensus_queue.cc:1048] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:21:18.078707 10736 tablet_copy_client.cc:806] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:18.096794 10736 tablet_copy_client.cc:670] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:18.150993 10736 tablet_copy_client.cc:538] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:18.187359 10736 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:18.215090  4036 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 15 to 16, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 16 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:18.257786  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 60508.7us
W20260709 13:21:18.347962  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 78363.8us
W20260709 13:21:18.377878  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 98836.9us
W20260709 13:21:18.411768 10744 log.cc:927] Time spent T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:21:18.441301  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 152381us
I20260709 13:21:18.542114 10744 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:18.543263 10744 tablet_bootstrap.cc:492] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:18.544675 10744 ts_tablet_manager.cc:1403] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.889s	user 0.075s	sys 0.049s
I20260709 13:21:18.576776  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:18.609315  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 120038us
I20260709 13:21:18.708019  4288 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:21:18.736550  4112 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.2.243.126:38007, user_credentials={real_user=slave}} blocked reactor thread for 85962.8us
I20260709 13:21:18.757048 10777 raft_consensus.cc:1064] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:21:18.799674 10744 raft_consensus.cc:359] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:18.801141 10744 raft_consensus.cc:740] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:18.802148 10744 consensus_queue.cc:260] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:18.838393 10744 ts_tablet_manager.cc:1434] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.293s	user 0.012s	sys 0.000s
I20260709 13:21:18.862418  4216 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:21:18.863157 10770 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 13:21:18.916879 10699 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:21:18.939577 10777 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:19.040836  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-10d1753ccc1e4c2d98ff3195cd6bb590 received from {username='slave'} at 127.0.0.1:37124
I20260709 13:21:19.041680  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-10d1753ccc1e4c2d98ff3195cd6bb590 on tablet 10d1753ccc1e4c2d98ff3195cd6bb590 with peer b81584b21ed144698954548303f1e507
I20260709 13:21:19.165634  4919 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:19.198964 10776 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:21:19.210289  4295 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:19.232161  4919 raft_consensus.cc:1217] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:21:19.235076 10736 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.238466 10736 tablet_bootstrap.cc:492] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:19.242949 10736 ts_tablet_manager.cc:1403] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.056s	user 0.061s	sys 0.014s
I20260709 13:21:19.252323 10736 raft_consensus.cc:359] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:19.256441 10736 raft_consensus.cc:740] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:19.264799 10720 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:19.265831 10720 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:19.271955  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:19.223402 10776 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:21:19.279709  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:19.280532 10720 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:19.283480  4110 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:19.286496 10815 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:19.288044 10770 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=3 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.302593 10815 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:19.292054 10736 consensus_queue.cc:260] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:19.305485 10736 ts_tablet_manager.cc:1434] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:21:19.307549 10770 tablet_bootstrap.cc:492] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:19.308884 10770 ts_tablet_manager.cc:1403] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.404s	user 0.065s	sys 0.022s
W20260709 13:21:19.312851  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 71357.6us
W20260709 13:21:19.325394  4186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:19.353060  4146 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:19.366204 10770 raft_consensus.cc:359] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:19.367504 10770 raft_consensus.cc:740] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:19.368412 10770 consensus_queue.cc:260] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:19.509919 10770 ts_tablet_manager.cc:1434] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.201s	user 0.009s	sys 0.001s
I20260709 13:21:19.531764 10765 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:19.510855 10789 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.540846 10789 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:19.521297 10816 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:19.542245 10816 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:19.545148 10816 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:19.551442  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:19.549538  4919 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:19.551600  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:19.554039  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:19.556407  4140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:19.549675 10789 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:19.623422 10776 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:19.629252  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:19.643723 10657 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:19.644162  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:19.643785  4042 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.639189  4295 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:19.733230  4306 tablet_copy_service.cc:342] P 6f753b799f924bacb0a0f0f6e0068ee9: Request end of tablet copy session b81584b21ed144698954548303f1e507-033774cd1e264e69977f9f6f2e5a42e8 received from {username='slave'} at 127.0.0.1:47710
I20260709 13:21:19.734133  4306 tablet_copy_service.cc:434] P 6f753b799f924bacb0a0f0f6e0068ee9: ending tablet copy session b81584b21ed144698954548303f1e507-033774cd1e264e69977f9f6f2e5a42e8 on tablet 033774cd1e264e69977f9f6f2e5a42e8 with peer b81584b21ed144698954548303f1e507
I20260709 13:21:19.766225 10657 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:19.774842 10815 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:19.833195 10764 raft_consensus.cc:1064] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:21:19.843636  4919 raft_consensus.cc:1217] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:21:19.796581 10815 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:19.851001 10815 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:19.853274  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 47696us
I20260709 13:21:19.889714  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:19.893486  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-9e7cd0a583da4bb18010d5a62595ea88 received from {username='slave'} at 127.0.0.1:37124
I20260709 13:21:19.894155  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-9e7cd0a583da4bb18010d5a62595ea88 on tablet 9e7cd0a583da4bb18010d5a62595ea88 with peer b81584b21ed144698954548303f1e507
I20260709 13:21:19.898455 10764 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:19.900746  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:19.913378  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:19.914702 10699 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:19.972911  4920 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:19.975145  4217 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:19.976926 10841 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:19.988761 10840 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:21:19.991595  4145 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:19.993476  4919 raft_consensus.cc:1217] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 13:21:20.080484 10841 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:20.090831  4919 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:20.122220  4222 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:20.144093  4920 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:20.146584 10812 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:20.150985  4287 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:20.152729 10812 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:20.153398  4042 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:20.164485  4287 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:20.173786 10776 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:20.177825  4288 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:20.210631  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9ebd7fa04d4401f96670bd2866c719c with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:20.227917  4042 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 11 to 12, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:20.238020  4217 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:20.213363  4920 raft_consensus.cc:2955] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:20.530771  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 112244us
W20260709 13:21:20.540709  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 136355us
W20260709 13:21:20.568537  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 123935us
I20260709 13:21:20.582561 10784 raft_consensus.cc:1064] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:21:20.615041 10784 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:20.623912  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 230870us
I20260709 13:21:20.636790 10657 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:20.637660 10657 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:20.632951  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 62987.5us
I20260709 13:21:20.645152  4137 tablet_service.cc:1558] Processing DeleteTablet for tablet b9ebd7fa04d4401f96670bd2866c719c with delete_type TABLET_DATA_TOMBSTONED (TS 32ebd3bc4af5446f94d9f3ac7c8cf53c not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:43494
I20260709 13:21:20.657143 10657 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:20.656862 10857 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:20.695417  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 156658us
I20260709 13:21:20.722841  4145 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:20.746594  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:20.758710  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52367.8us
I20260709 13:21:20.797695 10864 tablet_replica.cc:333] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:20.804833  4920 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:21:20.799727 10864 raft_consensus.cc:2243] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:20.843806 10851 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:20.848806 10864 raft_consensus.cc:2272] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:20.856009  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 93519.9us
W20260709 13:21:20.860628  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 98020.7us
W20260709 13:21:20.860802  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 104352us
I20260709 13:21:20.878513 10815 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:20.888252  4919 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:20.908773 10864 ts_tablet_manager.cc:1916] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:20.941690  4218 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:21:20.964279 10869 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:21:20.991884 10699 raft_consensus.cc:1064] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
W20260709 13:21:20.994511 10849 consensus_queue.cc:1175] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34e6205f3c1d434193126fef20d73800" responder_term: 19 status { last_received { term: 19 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 19 index: 14 } }
I20260709 13:21:20.995026  4040 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 12 to 13, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.001825 10699 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:21.017033  4218 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.042582  4919 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 LEARNER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:21:21.050668  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:21.055842  4217 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:21:21.064149 10850 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:21.069397  4295 raft_consensus.cc:2955] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.075933  4145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:21.081267  4140 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:21:21.082332  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10d1753ccc1e4c2d98ff3195cd6bb590 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:21.105363  4920 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:21:21.105069 10868 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:21.125011  4217 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:21:21.126673 10849 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:21.128753 10869 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:21.145054  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:21.156869  4261 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:21.158797 10868 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:21.156518 10850 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:21:21.209565  4292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:57280
I20260709 13:21:21.214972  4295 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:21:21.221294 10699 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:21.245672  4292 raft_consensus.cc:606] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:21.332499 10864 ts_tablet_manager.cc:1929] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:21:21.333376 10864 log.cc:1199] T b9ebd7fa04d4401f96670bd2866c719c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/wals/b9ebd7fa04d4401f96670bd2866c719c
I20260709 13:21:21.339242  4031 catalog_manager.cc:5028] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): tablet b9ebd7fa04d4401f96670bd2866c719c (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:21.399109  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ca04a09529497898d86f573a0e1189"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:21.402592  4144 raft_consensus.cc:606] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:21.491484  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 83050.9us
W20260709 13:21:21.506619  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 111966us
W20260709 13:21:21.518078  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 114254us
I20260709 13:21:21.526578  4144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da0810d325774d7181018ff01e71333a"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:21.532516  4217 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.527616  4144 raft_consensus.cc:606] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:21:21.569342 10849 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:21.585150 10880 log.cc:927] Time spent T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:21:21.586325 10832 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.590818  4216 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.667662  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:21.668516  4219 raft_consensus.cc:606] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:21.640960  4919 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.676137 10889 raft_consensus.cc:993] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:21.678336 10657 raft_consensus.cc:1081] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:21.711360  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:21:21.728045  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:21.750695  4147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52146
I20260709 13:21:21.751636  4147 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:21.752403  4147 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:21.751554  4141 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.765697 10870 raft_consensus.cc:993] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:21.766405 10870 raft_consensus.cc:1081] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:21.787804  4215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da0810d325774d7181018ff01e71333a"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44160
I20260709 13:21:21.788621  4215 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:21.789093  4215 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:21.785218  4042 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.835541  4147 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:21.871485  4147 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:21.856900  4040 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 14 to 15, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:21.876745  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:21.877810  4217 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:21.883252  4925 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.916060  4215 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:21.925427  4217 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:21.954210  4290 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:21.958105  4215 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 25 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:21.934705  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:21.965139  4141 raft_consensus.cc:3055] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:21:21.965556  4141 raft_consensus.cc:740] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:21.974195 10888 raft_consensus.cc:993] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:21.969977  4112 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:21.976187 10861 raft_consensus.cc:1081] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:21.976855  4141 consensus_queue.cc:260] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:21.978274  4141 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:21.980607  4147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:21:21.981418  4147 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:21.981858  4147 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:21.986582 10840 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:21.987347 10840 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:21.988374 10840 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:22.007689  4138 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:22.013490  4147 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:22.029366  4147 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:22.034534  4143 raft_consensus.cc:1240] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Rejecting Update request from peer 6f753b799f924bacb0a0f0f6e0068ee9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:22.044667  4141 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 25.
I20260709 13:21:22.054203  4187 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:22.055881 10895 raft_consensus.cc:2804] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:22.056911 10895 raft_consensus.cc:697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 25 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:22.058359 10895 consensus_queue.cc:237] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:22.069020  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 54323.9us
I20260709 13:21:22.072914  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:22.074944  4219 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:22.076301 10868 consensus_queue.cc:1059] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:22.077522 10868 consensus_queue.cc:1243] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:21:22.078399 10868 raft_consensus.cc:3055] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:22.078754 10868 raft_consensus.cc:740] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:22.079738 10868 consensus_queue.cc:260] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:22.082832  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:22.087437  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
W20260709 13:21:22.088583  4110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:22.088634  4292 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:22.092814  4217 raft_consensus.cc:3055] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:22.084067 10868 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:22.097741  4036 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 14 to 15, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.093600  4217 raft_consensus.cc:740] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:22.109731  4217 consensus_queue.cc:260] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:22.111369  4217 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:22.115849  4292 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:21:22.129043  4217 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 14.
I20260709 13:21:22.136292 10865 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:21:22.140661 10902 log.cc:927] Time spent T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.083s	user 0.001s	sys 0.001s
I20260709 13:21:22.147535  4925 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:22.151290  4112 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:22.154950 10849 raft_consensus.cc:993] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:22.154640 10841 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:22.155534 10857 raft_consensus.cc:1081] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:22.161047  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:22.161846  4295 raft_consensus.cc:3060] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:22.173380  4040 catalog_manager.cc:5697] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 24 to 25, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 25 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.173869  4925 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:22.171679 10849 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:22.193950 10840 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:21:22.194149  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet 10d1753ccc1e4c2d98ff3195cd6bb590 with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:57284
I20260709 13:21:22.194826 10840 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:22.200778  4292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ca04a09529497898d86f573a0e1189"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:21:22.201509  4292 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:22.201908  4292 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:22.207701  4290 consensus_queue.cc:237] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:22.196036 10840 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:22.233063  4141 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:22.241175  4919 raft_consensus.cc:1275] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:22.241012 10832 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:22.244413  4295 raft_consensus.cc:2468] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 25.
I20260709 13:21:22.234632  4292 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:22.246528 10896 consensus_queue.cc:1048] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:22.270118  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e7cd0a583da4bb18010d5a62595ea88 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:22.268169  4219 raft_consensus.cc:2955] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:22.273886  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:22.265524  4042 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 15 to 16, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 19 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:22.273869  4292 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:22.280727 10886 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:22.286623  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:22.291335  4217 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:22.293118  4141 raft_consensus.cc:3055] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:22.295472  4141 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:22.294602  4925 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:22.287838 10904 tablet_replica.cc:333] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:22.320302  4141 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:22.323632  4040 catalog_manager.cc:5697] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 13 to 14, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 14 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.328444  4141 raft_consensus.cc:3060] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:22.343350  4141 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:22.346760  4217 raft_consensus.cc:2468] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:22.348073  4261 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:22.350704 10894 raft_consensus.cc:2804] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:22.351323 10894 raft_consensus.cc:697] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:22.352299 10894 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:22.359905 10904 raft_consensus.cc:2243] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.361313 10904 raft_consensus.cc:2272] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.363417  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e7cd0a583da4bb18010d5a62595ea88 with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:57284
I20260709 13:21:22.365828 10904 ts_tablet_manager.cc:1916] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:22.373615  4042 catalog_manager.cc:5697] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 14 to 15, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 21 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:22.417413  4143 raft_consensus.cc:2955] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:22.450863  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet 033774cd1e264e69977f9f6f2e5a42e8 with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:56112
I20260709 13:21:22.454310  4287 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:22.524680  4215 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:22.526445  4042 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 14 to 15, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 15 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:22.533342 10869 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:22.541884 10907 tablet_replica.cc:333] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:22.569178 10907 raft_consensus.cc:2243] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.570456 10907 raft_consensus.cc:2272] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.574591  4287 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:21:22.576749 10765 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:22.585870 10904 ts_tablet_manager.cc:1929] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 13:21:22.586638 10904 log.cc:1199] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/10d1753ccc1e4c2d98ff3195cd6bb590
I20260709 13:21:22.589427  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet 10d1753ccc1e4c2d98ff3195cd6bb590 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:22.592759  4141 raft_consensus.cc:1275] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 25 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:21:22.595646 10884 consensus_queue.cc:1048] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:22.613226 10904 tablet_replica.cc:333] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:22.597000 10907 ts_tablet_manager.cc:1916] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:22.620313  4030 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 033774cd1e264e69977f9f6f2e5a42e8 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:22.624058  4295 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:22.633656 10870 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:22.688313  4295 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:22.691896 10870 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:21:22.737474  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:22.783432  4147 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:22.772178 10904 raft_consensus.cc:2243] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.794725 10896 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:21:22.816550 10904 raft_consensus.cc:2272] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.844514  4217 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:22.852586 10840 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:22.891525 10904 ts_tablet_manager.cc:1916] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:22.909614  4215 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:22.928704 10896 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:22.933736 10907 ts_tablet_manager.cc:1929] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.14
I20260709 13:21:22.956125 10907 log.cc:1199] T 033774cd1e264e69977f9f6f2e5a42e8 P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/033774cd1e264e69977f9f6f2e5a42e8
W20260709 13:21:23.040127  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 49770.2us
W20260709 13:21:23.106964  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 109709us
W20260709 13:21:23.114138  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 119691us
I20260709 13:21:23.214830 10904 ts_tablet_manager.cc:1929] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 13:21:23.215544 10904 log.cc:1199] T 9e7cd0a583da4bb18010d5a62595ea88 P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/9e7cd0a583da4bb18010d5a62595ea88
I20260709 13:21:23.217818  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet 9e7cd0a583da4bb18010d5a62595ea88 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:23.219830  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet 033774cd1e264e69977f9f6f2e5a42e8 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:23.752377  4215 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:23.790654  4143 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:23.797634 10932 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:21:23.807617  4185 consensus_peers.cc:597] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78c7d9fa8715457fb7cd31f0ea47ae92. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:23.816879  4295 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:23.820931 10893 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:23.859076  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:23.925371  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61890us
I20260709 13:21:23.976631 10884 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
W20260709 13:21:23.991511  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 59465.2us
I20260709 13:21:24.044853  4290 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:24.054487  4142 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:24.060688  4147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:24.061491  4147 raft_consensus.cc:606] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:21:24.091562  4292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:57280
I20260709 13:21:24.092316  4292 raft_consensus.cc:606] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:21:24.118580  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:24.119345  4219 raft_consensus.cc:606] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:24.121430  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:24.123768  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:24.136405 10938 raft_consensus.cc:993] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:24.137068 10938 raft_consensus.cc:1081] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:24.145623  4142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52134
W20260709 13:21:24.148576  4093 auto_rebalancer.cc:629] Failed to schedule move for tablet 7abf29f1bff94e6397d4a2561e35ef1b: Remote error: Service unavailable: leader transfer in progress
I20260709 13:21:24.165867  4036 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.167889  4219 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:24.170957  4142 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.171612  4142 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:24.149248  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 178383us
I20260709 13:21:24.206494 10922 raft_consensus.cc:993] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:24.207221 10922 raft_consensus.cc:1081] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:24.225008  4142 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.233639 10947 raft_consensus.cc:993] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:24.234870 10947 raft_consensus.cc:1081] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:24.246939  4218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44154
I20260709 13:21:24.247598  4218 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.248005  4218 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:24.259017  4218 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.271966  4218 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:24.284996  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:24.285887  4292 raft_consensus.cc:3055] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:24.286259  4292 raft_consensus.cc:740] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:24.287160  4292 consensus_queue.cc:260] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.314635  4292 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:24.324427  4139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:24.328575  4139 raft_consensus.cc:3060] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:24.329882  4142 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:24.337891  4185 consensus_peers.cc:597] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a1f1fbec3b44838ed91074017003db. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.339838  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:24.340385  4295 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:21:24.340660  4288 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:24.348696  4142 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:21:24.351788  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:24.352113  4218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44160
I20260709 13:21:24.367844  4219 raft_consensus.cc:3055] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:24.370136  4219 raft_consensus.cc:740] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:24.356215  4218 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.371174  4218 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:24.353219 10893 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:21:24.374626  4288 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:21:24.378619  4139 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:21:24.381220  4187 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:24.382361 10920 raft_consensus.cc:2804] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:24.382988 10920 raft_consensus.cc:697] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:24.388737  4218 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.379128  4219 consensus_queue.cc:260] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.395323 10812 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:21:24.388157 10920 consensus_queue.cc:237] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.405088 10952 ts_tablet_manager.cc:933] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:24.409664  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:24.410367  4143 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:24.410676  4143 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:24.411682  4143 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.412582  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:24.413237  4290 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:24.414506  4219 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:24.415378  4143 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:24.408959  4218 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:24.424875  4290 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:21:24.432782 10952 tablet_copy_client.cc:323] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:21:24.433023  4143 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:21:24.437633  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 78c7d9fa8715457fb7cd31f0ea47ae92 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:21:24.438416  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 78c7d9fa8715457fb7cd31f0ea47ae92 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-78c7d9fa8715457fb7cd31f0ea47ae92
I20260709 13:21:24.434734  4111 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:24.447561 10941 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:24.448238 10941 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:24.449297 10941 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.455225  4186 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:24.462656  4292 raft_consensus.cc:2468] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:21:24.469127  4219 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:21:24.477607 10812 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:21:24.478578 10812 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:24.482070 10812 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:24.511852  4232 tablet_copy_source_session.cc:215] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:24.539450 10952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c7d9fa8715457fb7cd31f0ea47ae92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:24.548082  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 90535.2us
I20260709 13:21:24.565253 10932 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:24.577994  4036 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 16 to 17, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 17 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.593565  4287 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:24.603976  4143 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:24.662190  4036 catalog_manager.cc:5697] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index -1 to 7, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:24.675694  4143 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:24.707302  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 82002.5us
I20260709 13:21:24.711252 10952 tablet_copy_client.cc:806] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:24.714479  4040 catalog_manager.cc:5697] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 18 to 19, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 19 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.712239 10952 tablet_copy_client.cc:670] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:24.721024  4040 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 13 to 14, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 14 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:24.754020  4110 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40b291caa9a64e83948693294f96069d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.772773 10952 tablet_copy_client.cc:538] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:24.837213  4219 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:24.862053 10870 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:24.867816  4147 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:24.872080  4292 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:24.883334  4292 raft_consensus.cc:1275] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:24.890615 10922 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:21:24.917353  4288 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:24.892526 10812 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:21:24.923914 10893 consensus_queue.cc:1048] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:24.927326  4143 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:21:24.930672 10812 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:24.932307 10941 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:24.945840 10952 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:24.998064  4219 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:25.004400  4216 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:25.007468 10943 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:24.998065 10870 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:25.030102 10965 ts_tablet_manager.cc:933] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:25.054572  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 73967.5us
I20260709 13:21:25.082347  4288 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:21:25.120961  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 76277.4us
W20260709 13:21:25.202018  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 79887.7us
W20260709 13:21:25.192469 10953 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:21:25.142180 10893 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:21:25.144691  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:25.211655 10952 tablet_bootstrap.cc:700] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: Time spent opening tablet: real 0.194s	user 0.003s	sys 0.001s
W20260709 13:21:25.281064  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 188094us
W20260709 13:21:25.291802  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 88574.8us
W20260709 13:21:25.317139 10967 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
W20260709 13:21:25.337415 10978 log.cc:927] Time spent T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.193s	user 0.002s	sys 0.000s
W20260709 13:21:25.369410  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 275018us
W20260709 13:21:25.374984 10973 log.cc:927] Time spent T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:21:25.446365  4042 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:25.457901 10965 tablet_copy_client.cc:323] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
W20260709 13:21:25.497524  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 278154us
I20260709 13:21:25.500684  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 11a1f1fbec3b44838ed91074017003db from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:21:25.501482  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 11a1f1fbec3b44838ed91074017003db from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-11a1f1fbec3b44838ed91074017003db
I20260709 13:21:25.511567  4232 tablet_copy_source_session.cc:215] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:21:25.541540 10870 consensus_meta.cc:287] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 13:21:25.559362 10965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a1f1fbec3b44838ed91074017003db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:25.751590  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 163584us
W20260709 13:21:25.801210  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 48627.5us
I20260709 13:21:25.785298 11012 ts_tablet_manager.cc:933] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
W20260709 13:21:25.852836  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 50831.2us
W20260709 13:21:25.857000  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 56855.4us
W20260709 13:21:25.919726  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 104997us
I20260709 13:21:26.124372 11012 tablet_copy_client.cc:323] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.65:36237
I20260709 13:21:26.130795 10965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42908 (request call id 950) took 1275 ms. Trace:
I20260709 13:21:26.165376  4156 tablet_copy_service.cc:140] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Received BeginTabletCopySession request for tablet 40b291caa9a64e83948693294f96069d from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:37124)
I20260709 13:21:26.189783  4287 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:26.184720  4156 tablet_copy_service.cc:161] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Beginning new tablet copy session on tablet 40b291caa9a64e83948693294f96069d from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:37124: session id = b81584b21ed144698954548303f1e507-40b291caa9a64e83948693294f96069d
I20260709 13:21:26.174431 10965 rpcz_store.cc:276] 0709 13:21:24.855402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:24.889430 (+ 34028us) service_pool.cc:224] Handling call
0709 13:21:25.032651 (+143221us) ts_tablet_manager.cc:934] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
0709 13:21:25.557840 (+525189us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:21:25.974050 (+416210us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:25.974217 (+   167us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:21:26.129839 (+155622us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:21:26.130144 (+   305us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:26.130499 (+   355us) ts_tablet_manager.cc:989] Replica registered.
0709 13:21:26.130556 (+    57us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":129273,"tablet-copy.queue_time_us":98471,"thread_start_us":339497,"threads_started":2}
I20260709 13:21:26.212131 10965 tablet_copy_client.cc:806] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:26.212850 10965 tablet_copy_client.cc:670] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:26.274572  4156 tablet_copy_source_session.cc:215] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:26.304932 10965 tablet_copy_client.cc:538] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:26.365661 11012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b291caa9a64e83948693294f96069d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:26.445712  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 67175.2us
W20260709 13:21:26.499112  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 68576.8us
I20260709 13:21:26.504498  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:26.511653  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 57791.7us
W20260709 13:21:26.514669  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 315525us
W20260709 13:21:26.573321  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 47571.8us
W20260709 13:21:26.638691  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62744.3us
I20260709 13:21:26.654950 10965 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: Bootstrap starting.
W20260709 13:21:26.647231  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 71107.4us
W20260709 13:21:26.686964  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46607.6us
I20260709 13:21:26.707896 11012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42922 (request call id 1050) took 1143 ms. Trace:
I20260709 13:21:26.781482 11012 rpcz_store.cc:276] 0709 13:21:25.564871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:25.565000 (+   129us) service_pool.cc:224] Handling call
0709 13:21:25.881684 (+316684us) ts_tablet_manager.cc:934] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
0709 13:21:26.354546 (+472862us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:21:26.625457 (+270911us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:26.625627 (+   170us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:21:26.706870 (+ 81243us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:21:26.707297 (+   427us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:26.707704 (+   407us) ts_tablet_manager.cc:989] Replica registered.
0709 13:21:26.707796 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":45044,"tablet-copy.queue_time_us":219589,"thread_start_us":367420,"threads_started":2}
I20260709 13:21:26.793442 11012 tablet_copy_client.cc:806] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:26.797746  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:26.798629  4142 raft_consensus.cc:606] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:26.804569 11012 tablet_copy_client.cc:670] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:26.808218 10952 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:26.837805  4218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:26.838860  4218 raft_consensus.cc:606] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:26.865346  4218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:26.866586  4218 raft_consensus.cc:606] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:26.858639 11012 tablet_copy_client.cc:538] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:26.863847 10952 tablet_bootstrap.cc:492] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:26.876739  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:26.880558  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:21:26.889631  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 46825.7us
I20260709 13:21:26.899199 10952 ts_tablet_manager.cc:1403] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.954s	user 0.061s	sys 0.051s
I20260709 13:21:26.983480 11012 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:26.996658 10952 raft_consensus.cc:359] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:27.010648 10952 raft_consensus.cc:740] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:27.016189 10952 consensus_queue.cc:260] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:27.065227 10952 ts_tablet_manager.cc:1434] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.112s	user 0.010s	sys 0.000s
I20260709 13:21:27.160192  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-78c7d9fa8715457fb7cd31f0ea47ae92 received from {username='slave'} at 127.0.0.1:54764
I20260709 13:21:27.160864  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-78c7d9fa8715457fb7cd31f0ea47ae92 on tablet 78c7d9fa8715457fb7cd31f0ea47ae92 with peer b81584b21ed144698954548303f1e507
I20260709 13:21:27.251392  4919 raft_consensus.cc:1217] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:21:27.246090 10987 raft_consensus.cc:993] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:27.254123 10987 raft_consensus.cc:1081] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:27.268852  4142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:21:27.269675  4142 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:27.270226  4142 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:27.285861 10986 raft_consensus.cc:993] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:27.286667 10986 raft_consensus.cc:1081] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:27.301126 10922 raft_consensus.cc:993] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:27.301873 10994 raft_consensus.cc:1081] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:27.303192  4292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:21:27.304921  4292 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:27.305318  4292 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:27.360956  4288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:21:27.361763  4288 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:27.362411  4288 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:27.390084 10965 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:27.392616 10965 tablet_bootstrap.cc:492] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:27.412367  4288 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.414803  4288 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:27.416203  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:27.417215  4216 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:27.426414  4142 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.393604 10965 ts_tablet_manager.cc:1403] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.774s	user 0.050s	sys 0.075s
I20260709 13:21:27.429047  4292 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.438418  4292 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:27.439594  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:27.440265  4218 raft_consensus.cc:3055] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:27.440587  4218 raft_consensus.cc:740] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:27.441418  4218 consensus_queue.cc:260] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.442610  4218 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:27.443866  4141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:27.451720  4141 raft_consensus.cc:3055] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:27.452118  4141 raft_consensus.cc:740] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:27.453009  4141 consensus_queue.cc:260] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.454272  4141 raft_consensus.cc:3060] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:27.459909  4218 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:27.448647  4147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:27.447583  4216 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:27.472895  4147 raft_consensus.cc:3060] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:27.473189  4215 raft_consensus.cc:1240] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Rejecting Update request from peer 32ebd3bc4af5446f94d9f3ac7c8cf53c for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:27.469501  4141 raft_consensus.cc:2468] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:27.478157  4261 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:27.479347 10981 raft_consensus.cc:2804] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:27.480014 10981 raft_consensus.cc:697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:27.481072 10981 consensus_queue.cc:237] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.488241  4147 raft_consensus.cc:2468] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:27.490039  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:27.489116  4142 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:27.491245  4216 raft_consensus.cc:3055] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:27.489367  4261 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:27.491878  4216 raft_consensus.cc:740] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:27.492867  4216 consensus_queue.cc:260] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.493432 11026 raft_consensus.cc:2804] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:27.494175  4216 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:27.494131 11026 raft_consensus.cc:697] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:27.495862 11026 consensus_queue.cc:237] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.491191  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:27.501909  4292 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:27.517174  4292 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:27.520998  4216 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 15.
I20260709 13:21:27.524269  4112 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:27.525374 11010 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:27.526170 11010 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:27.528859 11010 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:27.476577 10965 raft_consensus.cc:359] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:27.543831 10965 raft_consensus.cc:740] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:27.544924 10965 consensus_queue.cc:260] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:27.568558 10965 ts_tablet_manager.cc:1434] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.134s	user 0.010s	sys 0.000s
I20260709 13:21:27.570758  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-11a1f1fbec3b44838ed91074017003db received from {username='slave'} at 127.0.0.1:54764
I20260709 13:21:27.571285  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-11a1f1fbec3b44838ed91074017003db on tablet 11a1f1fbec3b44838ed91074017003db with peer b81584b21ed144698954548303f1e507
I20260709 13:21:27.582741  4036 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 14 to 15, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.604796  4040 catalog_manager.cc:5697] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 15 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.687340 11023 raft_consensus.cc:1064] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:21:27.705614 11023 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:27.721896  4919 raft_consensus.cc:1217] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
W20260709 13:21:27.852454 11012 log.cc:927] Time spent T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.061s	user 0.004s	sys 0.000s
I20260709 13:21:27.892843  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:27.928740  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 97180.5us
W20260709 13:21:27.953163 11033 log.cc:927] Time spent T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:21:27.958949  4288 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:21:27.970991  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 143540us
I20260709 13:21:27.981313 11012 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:27.982764 11012 tablet_bootstrap.cc:492] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:27.983925 11012 ts_tablet_manager.cc:1403] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.001s	user 0.044s	sys 0.019s
W20260709 13:21:27.993139  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 170980us
I20260709 13:21:28.036898  4919 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:28.037283  4288 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:28.039237 10987 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:28.034873 11042 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:21:28.041749 10987 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:28.049261  4147 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:28.051084 10970 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:28.133883  4218 raft_consensus.cc:1275] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:28.148110  4142 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:28.156334  4216 raft_consensus.cc:1275] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:28.182045  4215 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:28.158353 10947 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:21:28.252260 10986 raft_consensus.cc:1064] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
W20260709 13:21:28.265446  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 77787.7us
W20260709 13:21:28.269122 11046 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:21:28.261713 10986 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:28.156936 11012 raft_consensus.cc:359] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:28.281011 11012 raft_consensus.cc:740] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:28.282032 11012 consensus_queue.cc:260] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:28.284679 11012 ts_tablet_manager.cc:1434] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.296s	user 0.009s	sys 0.000s
W20260709 13:21:28.285272  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 62242.8us
W20260709 13:21:28.285303  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 62184.5us
I20260709 13:21:28.298334  4156 tablet_copy_service.cc:342] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Request end of tablet copy session b81584b21ed144698954548303f1e507-40b291caa9a64e83948693294f96069d received from {username='slave'} at 127.0.0.1:37124
I20260709 13:21:28.299037  4156 tablet_copy_service.cc:434] P 32ebd3bc4af5446f94d9f3ac7c8cf53c: ending tablet copy session b81584b21ed144698954548303f1e507-40b291caa9a64e83948693294f96069d on tablet 40b291caa9a64e83948693294f96069d with peer b81584b21ed144698954548303f1e507
I20260709 13:21:28.311889  4919 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:28.322238  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 53406.8us
I20260709 13:21:28.333184  4141 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:21:28.334899  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46882.9us
W20260709 13:21:28.400404  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 50301.9us
W20260709 13:21:28.425184  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 65167.3us
I20260709 13:21:28.387300 10922 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:21:28.311501 11043 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:28.469300  4040 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:28.478727 11055 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:28.479413  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 70229us
I20260709 13:21:28.501994 10947 consensus_queue.cc:1048] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:28.506750  4036 catalog_manager.cc:5697] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 16 to 17, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 17 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:28.516301  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 127316us
I20260709 13:21:28.515436 11034 consensus_queue.cc:1048] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 13:21:28.597744  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 210110us
W20260709 13:21:28.656313  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 57303.9us
I20260709 13:21:28.677152  4292 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:28.732882  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67337.3us
W20260709 13:21:28.751751 11066 log.cc:927] Time spent T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:21:28.846899  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 184778us
W20260709 13:21:28.919548 11082 log.cc:927] Time spent T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:21:28.946723  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 294047us
I20260709 13:21:28.979676  4919 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:21:29.014460  4919 raft_consensus.cc:1217] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:21:29.034554  4292 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:21:29.113095 11035 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:29.114413 11035 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:29.120271 11035 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:29.126312  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 117502us
I20260709 13:21:29.130826  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:29.132611 11039 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:29.161841  4147 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:21:29.166519 11083 raft_consensus.cc:1064] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:21:29.192230  4141 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.232211 11083 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:29.242483 11023 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:29.370772  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:29.372694  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:29.396687  4220 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:29.415292 10939 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:29.452543  4925 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:29.438838 11083 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:21:29.503355 11042 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:29.555917  4111 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:29.590873 11042 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:29.597640  4288 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:21:29.606938 11098 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:21:29.630641 11096 log.cc:927] Time spent T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:21:29.634416 11035 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:21:29.650487  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 74049.3us
I20260709 13:21:29.639679 11035 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:29.690485 11035 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:29.703724  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:29.718919  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:29.723506 11040 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:29.719101 11099 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:29.722498 11086 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.735958 11099 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:29.743037  4112 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:29.746043  4920 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.778110 11099 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:29.791257  4288 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.824752 11040 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:29.830605 11040 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.868098  4219 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.882037  4216 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:29.898582  4143 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.925297  4920 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:21:29.928193 11023 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:21:29.925663  4042 catalog_manager.cc:5697] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 7 to 8, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.918449  4295 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.972033  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" is_pre_election: true
I20260709 13:21:29.981572  4927 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:29.994729  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:30.000917  4288 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:21:30.005478 11077 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:30.026535  4036 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:30.096626  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 46552.8us
W20260709 13:21:30.158797 11106 log.cc:927] Time spent T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:21:30.169561 11055 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.212601  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:30.214214 11099 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:30.242945  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78c7d9fa8715457fb7cd31f0ea47ae92 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:30.266358  4288 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.289311  4920 raft_consensus.cc:2955] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.468860  4042 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 12 to 13, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.560642  4137 tablet_service.cc:1558] Processing DeleteTablet for tablet 78c7d9fa8715457fb7cd31f0ea47ae92 with delete_type TABLET_DATA_TOMBSTONED (TS 32ebd3bc4af5446f94d9f3ac7c8cf53c not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:43494
I20260709 13:21:30.580924  4219 consensus_queue.cc:237] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:30.576164  4143 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:30.589675  4920 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:21:30.594250  4147 raft_consensus.cc:1275] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:21:30.605587  4288 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:30.610806  4920 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:30.613330 10922 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:30.622287 11055 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:30.626149 11040 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:30.631778 11115 tablet_replica.cc:333] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:30.631074 11042 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.633332 11115 raft_consensus.cc:2243] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:30.634229 11115 raft_consensus.cc:2272] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:30.640153  4927 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.666689 11023 consensus_queue.cc:1048] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:30.671834  4288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:57280
I20260709 13:21:30.672818  4288 raft_consensus.cc:606] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:30.674499 11115 ts_tablet_manager.cc:1916] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:30.679610 11039 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.691311  4143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:30.697937  4143 raft_consensus.cc:606] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:21:30.702950  4292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
mode: GRACEFUL
new_leader_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:57280
I20260709 13:21:30.703859  4292 raft_consensus.cc:606] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Received request to transfer leadership to TS 34e6205f3c1d434193126fef20d73800
I20260709 13:21:30.705782  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:30.712073  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40b291caa9a64e83948693294f96069d with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:30.721052  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11a1f1fbec3b44838ed91074017003db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:30.716264  4292 raft_consensus.cc:2955] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.724795  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:30.709014  4925 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:30.726095  4042 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: config changed from index 11 to 12, VOTER 34e6205f3c1d434193126fef20d73800 (127.2.243.66) evicted. New cstate: current_term: 15 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.757598  4212 tablet_service.cc:1558] Processing DeleteTablet for tablet 40b291caa9a64e83948693294f96069d with delete_type TABLET_DATA_TOMBSTONED (TS 34e6205f3c1d434193126fef20d73800 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:56112
I20260709 13:21:30.796069  4038 catalog_manager.cc:5697] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 8 to 9, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.828015  4142 raft_consensus.cc:2955] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:30.865758  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 47526.3us
I20260709 13:21:30.876502 11116 tablet_replica.cc:333] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:30.878629 11116 raft_consensus.cc:2243] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:30.880081 11116 raft_consensus.cc:2272] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:31.009548  4283 tablet_service.cc:1558] Processing DeleteTablet for tablet 11a1f1fbec3b44838ed91074017003db with delete_type TABLET_DATA_TOMBSTONED (TS 6f753b799f924bacb0a0f0f6e0068ee9 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:57284
W20260709 13:21:31.017308  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 132432us
W20260709 13:21:31.054404  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 101101us
I20260709 13:21:31.091825 11116 ts_tablet_manager.cc:1916] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:21:31.130146  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 68221.4us
W20260709 13:21:31.132688  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 114749us
I20260709 13:21:31.128494 11135 tablet_replica.cc:333] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
W20260709 13:21:31.214255  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 83089.9us
W20260709 13:21:31.226574  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 83321.8us
I20260709 13:21:31.308881 11133 raft_consensus.cc:993] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:31.231647 11115 ts_tablet_manager.cc:1929] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:21:31.310261 11115 log.cc:1199] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/wals/78c7d9fa8715457fb7cd31f0ea47ae92
I20260709 13:21:31.312693 11133 raft_consensus.cc:1081] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:31.340723 11135 raft_consensus.cc:2243] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:31.358186 10998 raft_consensus.cc:993] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:31.358898 10998 raft_consensus.cc:1081] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Signalling peer 34e6205f3c1d434193126fef20d73800 to start an election
I20260709 13:21:31.358925 11135 raft_consensus.cc:2272] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:31.405361  4216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44160
I20260709 13:21:31.406565  4216 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.407112  4216 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:21:31.443511  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59222.9us
I20260709 13:21:31.427888 11135 ts_tablet_manager.cc:1916] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:31.437808  4031 catalog_manager.cc:5028] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): tablet 78c7d9fa8715457fb7cd31f0ea47ae92 (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:31.477679 11116 ts_tablet_manager.cc:1929] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:21:31.493340 11116 log.cc:1199] T 40b291caa9a64e83948693294f96069d P 34e6205f3c1d434193126fef20d73800: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/wals/40b291caa9a64e83948693294f96069d
W20260709 13:21:31.504693  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 165047us
I20260709 13:21:31.520790  4031 catalog_manager.cc:5028] TS 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): tablet 40b291caa9a64e83948693294f96069d (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:31.521214  4216 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.521888 11131 raft_consensus.cc:993] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:31.522706 11131 raft_consensus.cc:1081] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:31.524538  4216 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:31.553685  4147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52146
I20260709 13:21:31.554446  4147 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.554860  4147 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:31.555490  4219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
 from {username='slave'} at 127.0.0.1:44154
I20260709 13:21:31.556164  4219 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.556617  4219 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:31.570593  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:31.571349  4295 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:31.573913  4219 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.579420  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:31.580235  4138 raft_consensus.cc:3055] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:21:31.580701  4138 raft_consensus.cc:740] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:31.582050  4219 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:31.582693  4138 consensus_queue.cc:260] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.584085  4138 raft_consensus.cc:3060] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:31.587797  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:31.588577  4296 raft_consensus.cc:3055] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:31.588938  4296 raft_consensus.cc:740] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:31.589871  4296 consensus_queue.cc:260] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.593135  4296 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:31.619421  4296 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:31.621330  4186 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:31.622591 11136 raft_consensus.cc:2804] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:31.623193 11136 raft_consensus.cc:697] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:31.624205 11136 consensus_queue.cc:237] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.580232  4295 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:21:31.630028  4186 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:31.629987  4147 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.631397 11128 raft_consensus.cc:2804] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:21:31.631973 11128 raft_consensus.cc:697] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:31.632699  4147 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:31.632989 11128 consensus_queue.cc:237] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.633672  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:31.634359  4219 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:31.643836  4219 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:21:31.665638  4112 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:31.668316  4138 raft_consensus.cc:2468] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 13.
I20260709 13:21:31.667237  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:31.669317  4295 raft_consensus.cc:3055] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:31.670116  4295 raft_consensus.cc:740] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:31.670900  4143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:31.672696  4143 raft_consensus.cc:3060] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:31.672863  4295 consensus_queue.cc:260] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.677768 11133 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:31.678454 11133 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:31.682832 11133 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:31.669286  4042 catalog_manager.cc:5697] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 19 to 20, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 20 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.694964  4295 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:31.722553  4295 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 17.
I20260709 13:21:31.723596  4143 raft_consensus.cc:2468] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:31.732359  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:31.763958 11135 ts_tablet_manager.cc:1929] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:21:31.775986 11135 log.cc:1199] T 11a1f1fbec3b44838ed91074017003db P 6f753b799f924bacb0a0f0f6e0068ee9: Deleting WAL directory at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/wals/11a1f1fbec3b44838ed91074017003db
I20260709 13:21:31.789494  4030 catalog_manager.cc:5028] TS 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): tablet 11a1f1fbec3b44838ed91074017003db (table test-workload [id=9a0caedf3a024fefb7621a3cab9a50b3]) successfully deleted
I20260709 13:21:31.805462  4036 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 16 to 17, leader changed from 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 17 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.005796  4042 catalog_manager.cc:5697] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 12 to 13, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 13 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.030644  4296 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:32.035050 11128 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:32.095212  4219 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:32.099910 11042 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:32.162705  4143 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:21:32.165726 11128 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:21:32.175437  4138 raft_consensus.cc:1275] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:32.189662 11136 consensus_queue.cc:1048] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:32.248013  4295 raft_consensus.cc:1275] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:21:32.250136 11055 consensus_queue.cc:1048] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:21:32.415043  4296 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:21:32.433208 11161 log.cc:927] Time spent T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:21:32.522465  4295 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:32.540855 11042 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:21:32.781414  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 55205.8us
W20260709 13:21:32.791010  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 73706.7us
W20260709 13:21:32.795910  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 70754.3us
I20260709 13:21:32.813275  4219 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:21:32.830173  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46455.4us
W20260709 13:21:32.833000  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 43958.3us
I20260709 13:21:32.835565  4140 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:21:32.836963 11164 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:32.848356 11144 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:32.854122  4259 consensus_peers.cc:597] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee822f7cf89d49cb90b5fa2997ef4f4f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.879648 11164 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:32.884769  4219 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:32.917323  4142 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:32.917910  4036 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 13, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 18 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:32.984256  4219 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:33.030368  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 105578us
I20260709 13:21:33.034073  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:33.056654  4288 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:21:33.060246 11166 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:33.061758  4142 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:21:33.063314  4185 consensus_peers.cc:597] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ccbf9cc060a440feab4ab0c62d18794f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.065074 11166 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:33.132354  4294 raft_consensus.cc:2955] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.127521 11055 raft_consensus.cc:2955] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.181072  4142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:35142
I20260709 13:21:33.183058  4142 raft_consensus.cc:606] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:33.185209  4140 raft_consensus.cc:2955] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.194582  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:33.201835  4219 raft_consensus.cc:606] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Received request to transfer leadership to TS 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:33.208108  4219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9"
dest_uuid: "34e6205f3c1d434193126fef20d73800"
mode: GRACEFUL
new_leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:21:33.221627  4219 raft_consensus.cc:606] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Received request to transfer leadership to TS 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:33.226543  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:33.228828  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:33.228772  4294 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:33.238480  4259 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95ca04a09529497898d86f573a0e1189. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.239048  4222 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:33.241191 11164 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:33.244221  4138 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:33.249094 11173 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:33.277173 11164 raft_consensus.cc:2955] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.283231  4222 raft_consensus.cc:2955] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.295584 11055 raft_consensus.cc:993] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:33.296243 11055 raft_consensus.cc:1081] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:33.285238  4038 catalog_manager.cc:5697] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 8, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.298578  4294 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46846
I20260709 13:21:33.304777  4294 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:33.300937 11178 ts_tablet_manager.cc:933] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:33.305223  4294 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:33.336946  4294 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:33.342916  4294 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 22 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:33.343359  4219 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:33.350003  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:33.351343  4216 raft_consensus.cc:3055] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:33.351857  4216 raft_consensus.cc:740] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:33.354830  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:33.356053  4138 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:33.363965  4140 raft_consensus.cc:2955] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.372685  4216 consensus_queue.cc:260] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:33.373991 11178 tablet_copy_client.cc:323] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.67:40585
I20260709 13:21:33.370929  4138 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 22.
I20260709 13:21:33.383597  4216 raft_consensus.cc:3060] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:33.393739  4036 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 11, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 15 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.408867  4216 raft_consensus.cc:2468] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 22.
I20260709 13:21:33.404902  4261 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:33.412873  4306 tablet_copy_service.cc:140] P 6f753b799f924bacb0a0f0f6e0068ee9: Received BeginTabletCopySession request for tablet ee822f7cf89d49cb90b5fa2997ef4f4f from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:47710)
I20260709 13:21:33.413982  4306 tablet_copy_service.cc:161] P 6f753b799f924bacb0a0f0f6e0068ee9: Beginning new tablet copy session on tablet ee822f7cf89d49cb90b5fa2997ef4f4f from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:47710: session id = b81584b21ed144698954548303f1e507-ee822f7cf89d49cb90b5fa2997ef4f4f
W20260709 13:21:33.415237  4185 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 584cfa5b7a8849d1bb573f5304d7cce9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.429355  4294 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:33.435376 11055 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:21:33.461318  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 56544.1us
I20260709 13:21:33.440034  4306 tablet_copy_source_session.cc:215] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:33.474576 11167 raft_consensus.cc:2804] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:33.548163 11178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee822f7cf89d49cb90b5fa2997ef4f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:33.583846  4296 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.579456 11166 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.607462 11133 raft_consensus.cc:993] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: : Instructing follower 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:33.608191 11133 raft_consensus.cc:1081] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Signalling peer 6f753b799f924bacb0a0f0f6e0068ee9 to start an election
I20260709 13:21:33.614641  4138 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:33.618957 11178 tablet_copy_client.cc:806] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:33.619856 11178 tablet_copy_client.cc:670] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
W20260709 13:21:33.634683  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 46407.2us
I20260709 13:21:33.637454 11178 tablet_copy_client.cc:538] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:33.639494 11185 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:33.643847 11167 raft_consensus.cc:697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:33.645546 11167 consensus_queue.cc:237] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:33.647146  4294 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7"
dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:21:33.647912  4294 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:33.648279  4294 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:33.686530  4042 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.699672  4294 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:33.724797  4142 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b81584b21ed144698954548303f1e507 (127.2.243.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } } }
I20260709 13:21:33.734061 11193 ts_tablet_manager.cc:933] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:33.770464  4294 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:33.771706 11178 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:33.773485  4138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
I20260709 13:21:33.774267  4138 raft_consensus.cc:3055] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:33.774575  4138 raft_consensus.cc:740] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:33.775481  4138 consensus_queue.cc:260] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:33.778568  4138 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:33.787246  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 97469.8us
I20260709 13:21:33.788661  4036 catalog_manager.cc:5697] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 21 to 22, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 22 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:33.801397  4138 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:33.806439  4261 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:33.846443 11193 tablet_copy_client.cc:323] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:21:33.850615 11164 raft_consensus.cc:2804] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:33.867861  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:33.872598  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet ccbf9cc060a440feab4ab0c62d18794f from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:21:33.873353  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet ccbf9cc060a440feab4ab0c62d18794f from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-ccbf9cc060a440feab4ab0c62d18794f
I20260709 13:21:33.878288 11164 raft_consensus.cc:697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:33.879561 11164 consensus_queue.cc:237] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:33.891644  4216 raft_consensus.cc:3060] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:33.908252  4216 raft_consensus.cc:2468] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:33.951084  4232 tablet_copy_source_session.cc:215] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:33.959398 11189 raft_consensus.cc:993] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: : Instructing follower 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:33.960382 11199 raft_consensus.cc:1081] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Signalling peer 32ebd3bc4af5446f94d9f3ac7c8cf53c to start an election
I20260709 13:21:33.999408 11202 ts_tablet_manager.cc:933] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:34.010483  4140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9"
dest_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:21:34.011216  4140 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:34.011629  4140 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:34.008365 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbf9cc060a440feab4ab0c62d18794f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:34.031770  4140 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:34.049520  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:34.050136  4216 raft_consensus.cc:3055] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:34.051570  4216 raft_consensus.cc:740] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:34.051003  4140 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:34.054611  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:34.055658  4296 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:34.091740 11201 ts_tablet_manager.cc:933] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:34.122479  4216 consensus_queue.cc:260] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:34.124857  4296 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 24.
I20260709 13:21:34.142179 11201 tablet_copy_client.cc:323] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.66:45005
I20260709 13:21:34.142977  4216 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:34.145931  4232 tablet_copy_service.cc:140] P 34e6205f3c1d434193126fef20d73800: Received BeginTabletCopySession request for tablet 584cfa5b7a8849d1bb573f5304d7cce9 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:54764)
I20260709 13:21:34.146639  4232 tablet_copy_service.cc:161] P 34e6205f3c1d434193126fef20d73800: Beginning new tablet copy session on tablet 584cfa5b7a8849d1bb573f5304d7cce9 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:54764: session id = b81584b21ed144698954548303f1e507-584cfa5b7a8849d1bb573f5304d7cce9
W20260709 13:21:34.138904  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 100758us
I20260709 13:21:34.159543  4216 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32ebd3bc4af5446f94d9f3ac7c8cf53c in term 24.
I20260709 13:21:34.161374  4112 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800; no voters: 
I20260709 13:21:34.163178 11190 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:34.164134 11190 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 LEADER]: Becoming Leader. State: Replica: 32ebd3bc4af5446f94d9f3ac7c8cf53c, State: Running, Role: LEADER
I20260709 13:21:34.138237 11202 tablet_copy_client.cc:323] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: tablet copy: Beginning tablet copy session from remote peer at address 127.2.243.67:40585
I20260709 13:21:34.167598 11190 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:34.170231  4232 tablet_copy_source_session.cc:215] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:34.170097  4306 tablet_copy_service.cc:140] P 6f753b799f924bacb0a0f0f6e0068ee9: Received BeginTabletCopySession request for tablet 95ca04a09529497898d86f573a0e1189 from peer b81584b21ed144698954548303f1e507 ({username='slave'} at 127.0.0.1:47710)
I20260709 13:21:34.182160  4306 tablet_copy_service.cc:161] P 6f753b799f924bacb0a0f0f6e0068ee9: Beginning new tablet copy session on tablet 95ca04a09529497898d86f573a0e1189 from peer b81584b21ed144698954548303f1e507 at {username='slave'} at 127.0.0.1:47710: session id = b81584b21ed144698954548303f1e507-95ca04a09529497898d86f573a0e1189
I20260709 13:21:34.189514  4042 catalog_manager.cc:5697] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 16 to 17, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 17 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:34.199352  4306 tablet_copy_source_session.cc:215] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:34.206544 11201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584cfa5b7a8849d1bb573f5304d7cce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:34.212625 11202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca04a09529497898d86f573a0e1189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:34.232717  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:34.241006 11193 tablet_copy_client.cc:806] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:34.241809 11193 tablet_copy_client.cc:670] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:34.244833  4140 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:21:34.263535 11193 tablet_copy_client.cc:538] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:34.288563  4042 catalog_manager.cc:5697] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c reported cstate change: term changed from 23 to 24, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65). New cstate: current_term: 24 leader_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.332768  4216 raft_consensus.cc:1275] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:21:34.372679 11188 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:34.382781  4216 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:21:34.386281 11202 tablet_copy_client.cc:806] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:34.387072 11202 tablet_copy_client.cc:670] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:34.401444 11202 tablet_copy_client.cc:538] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:34.404255 11188 consensus_queue.cc:1048] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:34.417696 11202 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:34.425014 11188 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:34.441577 11193 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: Bootstrap starting.
I20260709 13:21:34.471765  4138 raft_consensus.cc:1275] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:21:34.473652 11201 tablet_copy_client.cc:806] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:34.474633 11201 tablet_copy_client.cc:670] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:34.567222 11167 consensus_queue.cc:1048] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:34.620396 11201 tablet_copy_client.cc:538] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:34.658970 11178 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:21:34.685395  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 117627us
W20260709 13:21:34.697616  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 59937.3us
I20260709 13:21:34.709635 11178 tablet_bootstrap.cc:492] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:34.711200 11178 ts_tablet_manager.cc:1403] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 0.940s	user 0.044s	sys 0.030s
W20260709 13:21:34.735877  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 52233.2us
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 3
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:21:34.840729  3021 tablet_server.cc:179] TabletServer@127.2.243.65:0 shutting down...
W20260709 13:21:34.852762  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 80804.7us
W20260709 13:21:34.906243  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 81130.6us
W20260709 13:21:35.114398 11204 log.cc:927] Time spent T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:21:35.218604 11178 raft_consensus.cc:359] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:35.241261 11211 log.cc:927] Time spent T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:21:35.375000  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 372716us
W20260709 13:21:35.401351  4113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.007s	sys 0.049s
W20260709 13:21:35.402285  4113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.007s	sys 0.050s
W20260709 13:21:35.383490  4893 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:35.365309 11178 raft_consensus.cc:740] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:35.437779  4214 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 13:21:35.442896  4259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 114181us
W20260709 13:21:35.462865  4142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.055s	sys 0.066s
W20260709 13:21:35.463342  4142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.055s	sys 0.066s
I20260709 13:21:35.444175 11201 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: Bootstrap starting.
W20260709 13:21:35.468361  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84749us
I20260709 13:21:35.472271 11178 consensus_queue.cc:260] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:35.501509 11178 ts_tablet_manager.cc:1434] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.790s	user 0.019s	sys 0.004s
W20260709 13:21:35.502014 11178 ts_tablet_manager.cc:1467] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Tablet startup took 790ms
W20260709 13:21:35.526001  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 103629us
I20260709 13:21:35.534426  4296 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Refusing update from remote peer 32ebd3bc4af5446f94d9f3ac7c8cf53c: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:21:35.541941 11133 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:35.607775 11133 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:35.502431 11178 ts_tablet_manager.cc:1469] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Trace:
0709 13:21:33.187595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:33.187755 (+   160us) service_pool.cc:224] Handling call
0709 13:21:33.305449 (+117694us) ts_tablet_manager.cc:934] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: Initiating tablet copy from peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
0709 13:21:33.491124 (+185675us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:21:33.594864 (+103740us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:33.595240 (+   376us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:21:33.611950 (+ 16710us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:21:33.612313 (+   363us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:33.612709 (+   396us) ts_tablet_manager.cc:989] Replica registered.
0709 13:21:33.612772 (+    63us) inbound_call.cc:177] Queueing success response
0709 13:21:33.771230 (+158458us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:21:34.711666 (+940436us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:21:34.840559 (+128893us) tablet_replica.cc:261] Starting instrumentation
0709 13:21:35.003577 (+163018us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":20017,"mutex_wait_us":20942,"raft.queue_time_us":2789,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":14074,"tablet-copy.queue_time_us":101202,"tablet-download-pool.queue_time_us":167,"tablet-download-pool.run_cpu_time_us":1477,"tablet-download-pool.run_wall_time_us":4698,"thread_start_us":149573,"threads_started":2}
I20260709 13:21:35.631937 11190 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:35.633050 11190 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:35.636299 11190 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:35.642057 11168 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:35.643111 11168 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:35.646311 11168 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:35.647166 11168 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:35.648480 11168 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.652812 11190 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:35.654107 11190 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:35.657604 11239 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:35.658376 11239 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.673908  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:35.686266  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:35.697350  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7d207ddadd4505a2b62ff61258cff1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:35.705081  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:35.707187  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:35.706048  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.710389  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 244605us
I20260709 13:21:35.710970  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:35.711849  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.694096 11239 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:35.712549  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.717724  4112 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:35.717010  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.729050  4112 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:35.729866 10922 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:35.718127 11216 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:35.734752  4110 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:35.740245 10922 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:35.727751 11239 raft_consensus.cc:493] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:35.744490  4306 tablet_copy_service.cc:342] P 6f753b799f924bacb0a0f0f6e0068ee9: Request end of tablet copy session b81584b21ed144698954548303f1e507-ee822f7cf89d49cb90b5fa2997ef4f4f received from {username='slave'} at 127.0.0.1:47710
I20260709 13:21:35.734793 11219 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:35.757963  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:35.793108 11190 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:35.793488 11168 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:35.761909  4306 tablet_copy_service.cc:434] P 6f753b799f924bacb0a0f0f6e0068ee9: ending tablet copy session b81584b21ed144698954548303f1e507-ee822f7cf89d49cb90b5fa2997ef4f4f on tablet ee822f7cf89d49cb90b5fa2997ef4f4f with peer b81584b21ed144698954548303f1e507
I20260709 13:21:35.796208 11222 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:35.797001 11222 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.799391 11222 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:35.746250 11127 raft_consensus.cc:493] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:35.805529  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:35.806846  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:35.820736  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.821532  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 98560.3us
W20260709 13:21:35.825965  4893 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.827560  4893 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.848605  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:35.848999  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:35.756255 11239 raft_consensus.cc:515] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.868402  4110 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:35.762156 11216 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.846366 11243 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:35.871624 11168 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:21:35.902411  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 67886.8us
I20260709 13:21:35.885803 11042 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:35.920662 11168 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:35.928480  4925 raft_consensus.cc:1217] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:21:35.928987 11042 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.930979 11168 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:35.896001 11223 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:35.931691 11042 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:35.906577 11243 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:35.936892 11243 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:35.940068  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b099e5e28a475fa86a6f1efaa21ed9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:35.945365 11216 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:35.947520 11239 leader_election.cc:290] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:35.847604 11127 raft_consensus.cc:515] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:35.959299  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 149869us
I20260709 13:21:35.967751  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:35.961086 11193 log.cc:927] Time spent T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:21:35.971975  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 103738us
I20260709 13:21:35.973692  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:35.974922  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:35.977779 11222 raft_consensus.cc:493] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:35.978751 11228 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:35.978595 11222 raft_consensus.cc:515] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.979401 11243 raft_consensus.cc:493] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:35.979485 11228 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:35.980196 11243 raft_consensus.cc:515] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.980556 11239 raft_consensus.cc:493] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:35.981051 11216 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:35.981557 11239 raft_consensus.cc:515] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:35.982194 11228 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:35.981678 11216 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:35.982787 11228 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:35.983170 11168 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:35.983453 11228 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:35.984043 11168 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:35.989667  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 82290.5us
I20260709 13:21:35.991535  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:35.990909  4111 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:35.998335  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:35.999460 10922 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:35.999842  4187 consensus_peers.cc:597] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.009589  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:36.010955  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d67bbe0103433095fb80de46cf624d" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:36.007941  4187 consensus_peers.cc:597] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.012665  4187 consensus_peers.cc:597] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.013341  4187 consensus_peers.cc:597] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.013398  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:36.015465  4187 consensus_peers.cc:597] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.015714  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:36.017516  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:36.016177  4187 consensus_peers.cc:597] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.012804  4214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0810d325774d7181018ff01e71333a" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.027702  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.027863 10922 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:21:36.028015  4187 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.030201  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.016796 11193 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:21:36.031824  4187 consensus_peers.cc:597] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.032539  4187 consensus_peers.cc:597] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.031569 11257 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:36.029048 10922 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:36.041842 11228 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.046526 11193 tablet_bootstrap.cc:492] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:36.050184 11193 ts_tablet_manager.cc:1403] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.609s	user 0.095s	sys 0.058s
I20260709 13:21:36.081837 11127 leader_election.cc:290] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:36.084429  4187 consensus_peers.cc:597] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.046695  4111 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:21:36.097816  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 51217.4us
I20260709 13:21:36.099812 11217 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:36.099746 10922 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.106972 11168 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:36.090901 11216 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.113286 11243 leader_election.cc:290] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:36.114598 11239 leader_election.cc:290] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:36.119837  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.121397 11243 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:36.122073 11243 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.124516 11193 raft_consensus.cc:359] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:36.125566 11193 raft_consensus.cc:740] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:36.126458 11193 consensus_queue.cc:260] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:36.134703 11243 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.165490  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:36.166368 11216 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:36.169942 11222 leader_election.cc:290] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:36.170563 11222 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:36.174778  4112 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:36.174891  4925 raft_consensus.cc:1217] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
W20260709 13:21:36.181136  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.196379  4110 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:36.211809  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.211863  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.212091  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:36.212695  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:36.213523  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.213891  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd7c9d3d77844388d8c5138c924c640" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.214843  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.213526  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.226068  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:36.185662 11219 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:36.234021  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.176409 11222 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:36.238817  4293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.239249  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a767a88581024d12b14e9f965193d404" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.217532 11193 ts_tablet_manager.cc:1434] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.167s	user 0.011s	sys 0.001s
I20260709 13:21:36.240886 10922 raft_consensus.cc:493] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.209164 11216 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:21:36.249704  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.247782 10922 raft_consensus.cc:515] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.254633  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cee8a15436dbfaf75dd67824aad" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:36.249605 11042 raft_consensus.cc:493] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.265699 11223 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.259341 11042 raft_consensus.cc:515] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.289498 11236 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.296424 11238 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.297149 11238 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.296945 11236 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.301044 11256 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.301821 11256 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.306867 11239 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.307629 11239 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:36.308475  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.281208 11228 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.284051  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-ccbf9cc060a440feab4ab0c62d18794f received from {username='slave'} at 127.0.0.1:54764
W20260709 13:21:36.313390  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 105872us
I20260709 13:21:36.313766 10922 leader_election.cc:290] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:36.316501  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.323093  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 138284us
W20260709 13:21:36.323846  4261 consensus_peers.cc:597] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.321681 11228 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:36.325320  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-ccbf9cc060a440feab4ab0c62d18794f on tablet ccbf9cc060a440feab4ab0c62d18794f with peer b81584b21ed144698954548303f1e507
I20260709 13:21:36.312292 11223 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
W20260709 13:21:36.324743  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.342229  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.311667 11190 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
W20260709 13:21:36.346207  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.348591  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.351789  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.350872 11223 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:36.353359  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.357353  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:36.357790  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.349447 11190 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.358865 11239 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:36.371798  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.377090  4261 consensus_peers.cc:597] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.391466 11202 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.394807 11202 tablet_bootstrap.cc:492] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:36.396275 11202 ts_tablet_manager.cc:1403] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.979s	user 0.077s	sys 0.040s
W20260709 13:21:36.381960  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.407932 11190 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:36.414176  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.415675  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.416514  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.417451  4261 consensus_peers.cc:597] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.423032 11042 leader_election.cc:290] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.460044  4111 leader_election.cc:304] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:36.461712 11255 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:36.462132 11222 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:36.462670 11255 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:36.469240 11239 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.469488 11216 raft_consensus.cc:2749] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:21:36.470007 11239 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.469272 11236 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.472689  4111 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:36.474349 11042 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:36.478135  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:36.486028  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96704063be1347b0bf621569c72ae1fd" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.486270 11238 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.487300 11256 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.490031  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.491392  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.494168  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.494328  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b9a320ff854b5998471937010702d5" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.499979  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.501194  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.499073  4213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.507440  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.509258 11239 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.509546  4215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.521195  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:36.523532 11264 log.cc:927] Time spent T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.002s
I20260709 13:21:36.541333  4216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:36.503127  4187 consensus_peers.cc:597] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.548859  4111 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:36.553175 11202 raft_consensus.cc:359] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:36.554270 11202 raft_consensus.cc:740] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
I20260709 13:21:36.555162 11202 consensus_queue.cc:260] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:36.542963 11255 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:36.561523 11258 raft_consensus.cc:1064] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
W20260709 13:21:36.592839  4112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 44184.3us
I20260709 13:21:36.592725  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:36.600179  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 122562us
I20260709 13:21:36.594938 11255 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:36.633389  4111 leader_election.cc:304] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
W20260709 13:21:36.634770  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 87229.2us
I20260709 13:21:36.639636 11223 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:36.645622 11202 ts_tablet_manager.cc:1434] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.249s	user 0.013s	sys 0.000s
I20260709 13:21:36.644918 11258 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:36.651430  4111 leader_election.cc:304] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:36.653663 11127 raft_consensus.cc:2749] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:36.652365  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 43581.8us
I20260709 13:21:36.661376  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:36.672231  4112 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:36.675279  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151524a8517e4b8ebc7308777c98105e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.675707 11239 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:36.681545  4111 leader_election.cc:304] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:36.683225  4111 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:36.684046 11243 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:36.684255 11042 raft_consensus.cc:2749] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:36.684804 11243 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:36.665469 11222 raft_consensus.cc:2749] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:36.688680  4112 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:36.638322 11228 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:36.719039  4110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 91845.8us
I20260709 13:21:36.720970  4111 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:36.701181 11222 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:36.787843 11266 raft_consensus.cc:1064] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:21:36.762910 11190 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:36.756203  4111 leader_election.cc:304] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:36.818435 11042 raft_consensus.cc:2749] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:36.825207  4111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 69167.9us
I20260709 13:21:36.839627  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93b2eb873344f43936dabea6e173ea0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.840116  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.849869  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca04a09529497898d86f573a0e1189" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.856052  4290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.865674  4287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94558f1f2d64f6b8e16501cb7d48d78" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.868016  4927 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 LEARNER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:21:36.866613  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.877408 11190 raft_consensus.cc:493] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:36.878046  4292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc0e559b40a475ea99ac69d7dbea6c0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.878427 11190 raft_consensus.cc:515] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:36.880890 11190 leader_election.cc:290] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:36.883037  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:36.895543  4306 tablet_copy_service.cc:342] P 6f753b799f924bacb0a0f0f6e0068ee9: Request end of tablet copy session b81584b21ed144698954548303f1e507-95ca04a09529497898d86f573a0e1189 received from {username='slave'} at 127.0.0.1:47710
I20260709 13:21:36.896219  4306 tablet_copy_service.cc:434] P 6f753b799f924bacb0a0f0f6e0068ee9: ending tablet copy session b81584b21ed144698954548303f1e507-95ca04a09529497898d86f573a0e1189 on tablet 95ca04a09529497898d86f573a0e1189 with peer b81584b21ed144698954548303f1e507
I20260709 13:21:36.899607  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.937781  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:36.962481  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 212961us
I20260709 13:21:36.992424  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:36.980480 11201 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.014401 11201 tablet_bootstrap.cc:492] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: Bootstrap complete.
I20260709 13:21:37.023617  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf26f731cd1d411a93da2187b3452b52" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:37.036008  4927 raft_consensus.cc:1217] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:21:37.040449  4220 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:21:37.046058  4111 leader_election.cc:304] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.015008 11272 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:21:37.052678 11222 raft_consensus.cc:2749] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:37.047734 11201 ts_tablet_manager.cc:1403] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: Time spent bootstrapping tablet: real 1.604s	user 0.064s	sys 0.023s
I20260709 13:21:37.058274  4111 leader_election.cc:304] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:37.058701  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 43856.8us
I20260709 13:21:37.061383 11236 raft_consensus.cc:2749] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:37.063999  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:37.060317  4111 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.065958 11190 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:37.067770  4111 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.068665 11190 raft_consensus.cc:2749] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:37.070228  3021 tablet_replica.cc:333] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.070168  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.078635  4111 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.083559  4111 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:37.089681 11236 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:37.113246  3021 raft_consensus.cc:2243] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.114876  3021 raft_consensus.cc:2272] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.117360 11266 consensus_queue.cc:237] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:37.124050  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.125121 11236 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:37.125921  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.126901 11255 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:37.134016  4111 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.137588 11228 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:37.143146  4111 leader_election.cc:304] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.144127 11255 raft_consensus.cc:2749] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:37.092957 11256 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:21:37.162227 11201 raft_consensus.cc:359] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:37.163282 11201 raft_consensus.cc:740] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b81584b21ed144698954548303f1e507, State: Initialized, Role: LEARNER
W20260709 13:21:37.163467  4185 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 -> Peer b81584b21ed144698954548303f1e507 (127.2.243.68:35693): Couldn't send request to peer b81584b21ed144698954548303f1e507. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:37.190970  3021 tablet_replica.cc:333] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.089308 11190 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:37.214049  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 172410us
I20260709 13:21:37.192216  3021 raft_consensus.cc:2243] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.253650 11191 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:37.164098 11201 consensus_queue.cc:260] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:37.289748  3021 raft_consensus.cc:2272] T e2c23c7c663f4647955b43f85d642e1c P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.310156  4291 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:21:37.298686 11201 ts_tablet_manager.cc:1434] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: Time spent starting tablet: real 0.244s	user 0.005s	sys 0.007s
I20260709 13:21:37.314126  4924 raft_consensus.cc:1275] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:21:37.314116 11267 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:37.317525 11266 consensus_queue.cc:1048] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:37.317952  4232 tablet_copy_service.cc:342] P 34e6205f3c1d434193126fef20d73800: Request end of tablet copy session b81584b21ed144698954548303f1e507-584cfa5b7a8849d1bb573f5304d7cce9 received from {username='slave'} at 127.0.0.1:54764
I20260709 13:21:37.318466  4232 tablet_copy_service.cc:434] P 34e6205f3c1d434193126fef20d73800: ending tablet copy session b81584b21ed144698954548303f1e507-584cfa5b7a8849d1bb573f5304d7cce9 on tablet 584cfa5b7a8849d1bb573f5304d7cce9 with peer b81584b21ed144698954548303f1e507
I20260709 13:21:37.320426  3021 tablet_replica.cc:333] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.321414  3021 raft_consensus.cc:2243] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.322263  3021 raft_consensus.cc:2272] T a35e1cee8a15436dbfaf75dd67824aad P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.322781 11191 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.341331  4218 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.359311  3021 tablet_replica.cc:333] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.360522  3021 raft_consensus.cc:2243] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.370656  4924 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.383714  3021 raft_consensus.cc:2272] T e6b9a320ff854b5998471937010702d5 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.384632  4040 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 reported cstate change: config changed from index 13 to 14, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.387367  3021 tablet_replica.cc:333] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.388197  3021 raft_consensus.cc:2243] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.388725  3021 raft_consensus.cc:2272] T bb7d207ddadd4505a2b62ff61258cff1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.404999  3021 tablet_replica.cc:333] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.405912 11246 raft_consensus.cc:2955] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.405982  3021 raft_consensus.cc:2243] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:21:37.420885  4261 consensus_peers.cc:597] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:37.442397  4187 consensus_peers.cc:597] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:37.446664  3021 raft_consensus.cc:2272] T 40b291caa9a64e83948693294f96069d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.446998  4291 raft_consensus.cc:2955] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.452162  3021 tablet_replica.cc:333] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.467828  3021 raft_consensus.cc:2243] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.477602  3021 raft_consensus.cc:2272] T 17b099e5e28a475fa86a6f1efaa21ed9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.483696  3021 tablet_replica.cc:333] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.484867  3021 raft_consensus.cc:2243] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.489802  3021 raft_consensus.cc:2272] T bf26f731cd1d411a93da2187b3452b52 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.489982  4924 raft_consensus.cc:2955] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.494014  3021 tablet_replica.cc:333] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.497004  3021 raft_consensus.cc:2243] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.499864 11256 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:37.500725 11256 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:37.503099 11256 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:37.504256  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:37.505822  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "527025007d0641e3a50bfc3a9d2e5b80" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:37.507212  4112 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:37.508638 11256 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:37.513617  3021 raft_consensus.cc:2272] T 96704063be1347b0bf621569c72ae1fd P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.537976  3021 tablet_replica.cc:333] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.539016  3021 raft_consensus.cc:2243] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.539884  3021 raft_consensus.cc:2272] T 95ca04a09529497898d86f573a0e1189 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.545081  4924 raft_consensus.cc:1217] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:21:37.561808 11256 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:37.562376 11256 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:37.564642 11256 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:37.566154  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:37.567356  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:37.568884  4110 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:37.571194 11222 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:37.577857  3021 tablet_replica.cc:333] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.579281  3021 raft_consensus.cc:2243] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.580169  3021 raft_consensus.cc:2272] T fcc0e559b40a475ea99ac69d7dbea6c0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.599542  3021 tablet_replica.cc:333] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.600664  3021 raft_consensus.cc:2243] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.601361  3021 raft_consensus.cc:2272] T da0810d325774d7181018ff01e71333a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.630517  3021 tablet_replica.cc:333] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.631556  3021 raft_consensus.cc:2243] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.643563  3021 raft_consensus.cc:2272] T e9d67bbe0103433095fb80de46cf624d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.659699  3021 tablet_replica.cc:333] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.662303  3021 raft_consensus.cc:2243] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.663026  3021 raft_consensus.cc:2272] T 4dd7c9d3d77844388d8c5138c924c640 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.669595 11276 raft_consensus.cc:1064] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:21:37.675712 11276 consensus_queue.cc:237] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:37.688784  4291 consensus_queue.cc:237] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:37.719890  4925 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:21:37.692207  3021 tablet_replica.cc:333] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.694016 11256 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:37.723284  3021 raft_consensus.cc:2243] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.723393 11258 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:37.723935 11256 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:37.730031  3021 raft_consensus.cc:2272] T 729a3ec3cbd04254ac398836ae71b77d P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.735172  3021 tablet_replica.cc:333] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.736133  3021 raft_consensus.cc:2243] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.736826  3021 raft_consensus.cc:2272] T c93b2eb873344f43936dabea6e173ea0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.740182  3021 tablet_replica.cc:333] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.741086  3021 raft_consensus.cc:2243] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.694978  4042 catalog_manager.cc:5697] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 8 to 9, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.742131  3021 raft_consensus.cc:2272] T 151524a8517e4b8ebc7308777c98105e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.746815 11256 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:37.745982 11258 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.747671  4218 raft_consensus.cc:1275] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:21:37.754482  4924 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.758198  4030 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee822f7cf89d49cb90b5fa2997ef4f4f with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:37.760072  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:37.763017  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a1f1fbec3b44838ed91074017003db" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:37.764835  4110 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:37.766273 11222 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:37.767738 11290 consensus_queue.cc:1048] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:37.777112  4218 raft_consensus.cc:2955] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.786566 11256 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:37.787302 11256 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:37.787441  4042 catalog_manager.cc:5697] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 14 to 15, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 18 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:37.790297  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:37.791834  3021 tablet_replica.cc:333] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.801096  3021 raft_consensus.cc:2243] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.802098  3021 raft_consensus.cc:2272] T a767a88581024d12b14e9f965193d404 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.806495  3021 tablet_replica.cc:333] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.822176 11256 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:37.824206  4925 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:37.828914 11276 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:37.839015  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b8745010349f4b91ac3fb893c50d0" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:37.870357  4111 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:37.871340 11256 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:37.890959 11256 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:37.891592 11256 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:37.896428  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:37.897912 11256 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:37.901081  4924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:37.903159  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:37.911626  4110 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:37.912917  3021 raft_consensus.cc:2243] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.914165 11256 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:21:37.914400  4218 raft_consensus.cc:1275] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:37.921953  3021 raft_consensus.cc:2272] T ad5c2c5dc1b340968b54f2a9a970cfce P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:37.916368  4031 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 84898.9us
I20260709 13:21:37.942329 11276 consensus_queue.cc:1048] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:37.946655  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ee822f7cf89d49cb90b5fa2997ef4f4f: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:21:37.957876  3021 tablet_replica.cc:333] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:37.959224  3021 raft_consensus.cc:2243] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.960767  3021 raft_consensus.cc:2272] T f776151073534d2e9012d8a291b66b5a P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.056324  4893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 59324.5us
I20260709 13:21:38.056382  3021 tablet_replica.cc:333] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.062235  3021 raft_consensus.cc:2243] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.062891  3021 raft_consensus.cc:2272] T 527025007d0641e3a50bfc3a9d2e5b80 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.066039  3021 tablet_replica.cc:333] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.066864  3021 raft_consensus.cc:2243] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.068038  3021 raft_consensus.cc:2272] T d2e2dc5c77a5416995232da7a676ae73 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.078189 11276 raft_consensus.cc:2955] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:38.080489  4920 raft_consensus.cc:2955] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:38.103173  4042 catalog_manager.cc:5697] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 reported cstate change: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:38.150686 11256 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:38.151374 11256 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.153772 11256 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:38.154536  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.155787  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033774cd1e264e69977f9f6f2e5a42e8" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:38.157743  4110 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:38.160547 11256 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:38.212586  3021 tablet_replica.cc:333] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.236539  3021 raft_consensus.cc:2243] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.260149  3021 raft_consensus.cc:2272] T f1a8ad10a3aa47109171ff50298ccf9b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.274616  3021 tablet_replica.cc:333] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.275619  3021 raft_consensus.cc:2243] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.281292  3021 raft_consensus.cc:2272] T 70df96ad70f0416db400b7395b0d7b9e P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.301270  4218 raft_consensus.cc:2955] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:38.343604  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:38.369896  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:38.391258  3021 tablet_replica.cc:333] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.392150  3021 raft_consensus.cc:2243] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.392967  3021 raft_consensus.cc:2272] T 584cfa5b7a8849d1bb573f5304d7cce9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.399036 11290 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.399721 11290 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.401842 11290 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:38.441447 11255 raft_consensus.cc:493] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:38.441998 11255 raft_consensus.cc:515] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.444044 11255 leader_election.cc:290] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.445883  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:38.455252  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:38.464067  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:38.469348 11222 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:38.470655 11237 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.470937 11222 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.471187 11237 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.473117 11237 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.474026 11222 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.474145  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.474822  4288 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:21:38.475965  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:38.476931 11305 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:38.477346 11305 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.477705 11305 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:38.481189  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.487083 11305 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.488324  3021 tablet_replica.cc:333] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.528189  3021 raft_consensus.cc:2243] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.528564  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abf29f1bff94e6397d4a2561e35ef1b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:38.529237  3021 raft_consensus.cc:2272] T 434e24168b204a82b4cafcc2cba44c46 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.490376 11295 raft_consensus.cc:1064] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: attempting to promote NON_VOTER b81584b21ed144698954548303f1e507 to VOTER
I20260709 13:21:38.496634  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:38.520752  4187 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:38.526161  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e71d21bb0584872aaf6dcba10ac49fc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:38.532758 11295 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.537496  4112 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:38.538290 11255 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:38.519039 11222 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:38.539569  4112 leader_election.cc:304] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:38.539211 11222 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:38.542187 11222 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.542479  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.543503 11255 raft_consensus.cc:2749] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:38.546188  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:38.547932  4112 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:38.548089 11304 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.548774 11255 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:38.548925 11304 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.550894 11304 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:38.554602  3021 tablet_replica.cc:333] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.555361  3021 raft_consensus.cc:2243] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.555932  3021 raft_consensus.cc:2272] T 1270a058111c4161ba865afa3630bfb7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.569065  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 46153.2us
I20260709 13:21:38.574110  4925 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 LEARNER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:38.575165  4219 raft_consensus.cc:2393] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 15: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:38.577843  3021 tablet_replica.cc:333] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.578442 11306 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:21:38.579484  4187 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:38.581146  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcd7e7f18b74faf9bbcd8060013bfa2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:38.581552  4288 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:38.581758  4289 raft_consensus.cc:3060] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:38.583575 11308 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:21:38.585608  4187 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.589803  4289 raft_consensus.cc:2468] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:38.593981  4186 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:38.600831 11295 raft_consensus.cc:2804] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:38.613036 11295 raft_consensus.cc:697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:38.578733  3021 raft_consensus.cc:2243] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.613955 11295 consensus_queue.cc:237] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.614748  3021 raft_consensus.cc:2272] T 9e7cd0a583da4bb18010d5a62595ea88 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.579879 11305 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:38.621558  4261 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:38.621995  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:38.624611 11307 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:38.626739  3021 tablet_replica.cc:333] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.627635  3021 raft_consensus.cc:2243] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.633855  3021 raft_consensus.cc:2272] T 033774cd1e264e69977f9f6f2e5a42e8 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.634413  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:38.652555  4261 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:38.653046  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:38.653810 11307 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:38.664573 11305 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:38.668668  4288 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:38.669699 11307 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.675040 11307 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.677594 11307 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:38.679509  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:38.685549  4261 leader_election.cc:336] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:38.686036  4261 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:38.686762 11304 raft_consensus.cc:2749] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:38.695132 11266 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.695791 11266 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.699272  4042 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:38.702483 11310 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:38.703150 11310 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: NON_VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: true } }
I20260709 13:21:38.705819 11310 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.706619  4038 catalog_manager.cc:5697] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 14 to 15, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:38.710741 11300 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.711426 11300 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.716727  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:38.718673 11310 raft_consensus.cc:493] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:38.719285 11310 raft_consensus.cc:515] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.721581 11310 leader_election.cc:290] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:38.723428  3021 tablet_replica.cc:333] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.725997 11255 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:38.726640 11255 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:38.728251  4187 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:38.730330 11255 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.736634 11266 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.739375  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.740185  3021 raft_consensus.cc:2243] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.733402  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.740902  4288 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
I20260709 13:21:38.741911  4892 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:38.742571  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.734395  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab416835542d4f11852821a8161b8f7b" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:38.742836  4288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.743106 11122 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:38.743572 11122 raft_consensus.cc:493] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.743968 11122 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:38.733208 11300 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.733528  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:38.740113  4289 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 14.
I20260709 13:21:38.740976  3021 raft_consensus.cc:2272] T 42018491ecaa43a29d99307d7ccd824b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.749776  4187 consensus_peers.cc:597] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:38.753118  4920 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b81584b21ed144698954548303f1e507 (127.2.243.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:38.757436  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:38.759320 11295 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:38.759811 11295 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.760264 11295 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:38.765704 11122 raft_consensus.cc:515] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.766271  3021 tablet_replica.cc:333] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.773023  3021 raft_consensus.cc:2243] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.773649  3021 raft_consensus.cc:2272] T e24b8745010349f4b91ac3fb893c50d0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.773685 11122 leader_election.cc:290] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.773830  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b291caa9a64e83948693294f96069d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:38.774549  4291 raft_consensus.cc:3060] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:38.783252  4291 raft_consensus.cc:2468] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 16.
I20260709 13:21:38.784231  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.784575  4892 leader_election.cc:304] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:38.785544 11302 raft_consensus.cc:2804] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:38.786100 11302 raft_consensus.cc:697] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 16 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:21:38.786190 11300 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.786744 11300 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.787036 11302 consensus_queue.cc:237] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.789363 11300 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.798804  3021 tablet_replica.cc:333] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.799760  3021 raft_consensus.cc:2243] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.806928  4111 leader_election.cc:304] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:38.817793 11255 raft_consensus.cc:2749] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:38.812357  4040 catalog_manager.cc:5697] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 15 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 16 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.815707  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.818059  4111 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:38.818951 11255 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:38.821044  4111 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:38.821743 11255 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:38.823734  4893 leader_election.cc:336] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:38.800311  3021 raft_consensus.cc:2272] T 09ba8b2d18b04025b73da88c20e6dbe0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.826295  4187 consensus_peers.cc:597] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:38.827224  3021 tablet_replica.cc:333] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.828065  3021 raft_consensus.cc:2243] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:38.830104  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 61117.1us
I20260709 13:21:38.849016  3021 raft_consensus.cc:2272] T 11a1f1fbec3b44838ed91074017003db P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.851753  3021 tablet_replica.cc:333] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.862133 11295 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.864897 11295 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.866575  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c23c7c663f4647955b43f85d642e1c" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:38.867063 11311 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:38.867183  4289 raft_consensus.cc:3060] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:38.867651 11311 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:38.869755 11311 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:38.871980  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:38.873440  3021 raft_consensus.cc:2243] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.874078  3021 raft_consensus.cc:2272] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.877408  4289 raft_consensus.cc:2468] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:38.878752  4186 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:38.880259 11295 raft_consensus.cc:2804] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:38.884702  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:38.885304 11295 raft_consensus.cc:697] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:38.886243 11295 consensus_queue.cc:237] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:38.889045  4893 leader_election.cc:336] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:38.890614  4893 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:38.891038  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:38.892222 11122 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:21:38.896574  3021 tablet_replica.cc:333] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.897459  3021 raft_consensus.cc:2243] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.897955  3021 pending_rounds.cc:70] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Trying to abort 1 pending ops.
I20260709 13:21:38.898203  3021 pending_rounds.cc:77] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: Aborting op as it isn't in flight: id { term: 17 index: 12 } timestamp: 7305639091750748160 op_type: NO_OP noop_request { }
I20260709 13:21:38.898662  3021 raft_consensus.cc:2889] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:38.899008  3021 raft_consensus.cc:2272] T 27a95e60f9ae4eea85c4a330ff8078c7 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.906872  3021 tablet_replica.cc:333] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.907771  3021 raft_consensus.cc:2243] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.908933  3021 raft_consensus.cc:2272] T 5985d95b5ba74bed90f719c554bee460 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.911811  3021 tablet_replica.cc:333] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.912670  3021 raft_consensus.cc:2243] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.913339  3021 raft_consensus.cc:2272] T 6091d765c73842c992d8c60523872ccc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.915942  3021 tablet_replica.cc:333] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.923223  4111 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:38.924379  3021 raft_consensus.cc:2243] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.928433  3021 raft_consensus.cc:2272] T a94558f1f2d64f6b8e16501cb7d48d78 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.927626  4111 raft_consensus.cc:2686] T e6478d83fa954184a297fb7466378df1 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:21:38.930853  4187 consensus_peers.cc:597] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:38.931486  4187 consensus_peers.cc:597] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:38.931995  4187 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:38.950871  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:38.956202  3021 tablet_replica.cc:333] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:38.957367  3021 raft_consensus.cc:2243] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.963371 11304 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.966588 11304 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.970528  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:38.971271  4920 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 9.
I20260709 13:21:38.969092 11304 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:38.972312  4259 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:38.973301 11304 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:21:38.973791 11304 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:38.977002 11304 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:21:38.991756 11304 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:38.961073  3021 raft_consensus.cc:2272] T 7abf29f1bff94e6397d4a2561e35ef1b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.027145  3021 tablet_replica.cc:333] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.029918  3021 raft_consensus.cc:2243] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:39.040729 11308 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.042208 11308 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.047107 11308 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:39.043789 11222 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:39.059597  4289 raft_consensus.cc:1275] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:39.061226  4294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:39.068017  3021 raft_consensus.cc:2272] T 38e2ffb00e35435085552a2adb73fcc2 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.084407  3021 tablet_replica.cc:333] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.090416  3021 raft_consensus.cc:2243] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:39.124779 11222 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.129835  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:39.130316  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.143784 11304 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:39.150381  4920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729a3ec3cbd04254ac398836ae71b77d" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:39.150677 11295 consensus_queue.cc:1048] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:39.151544  4920 raft_consensus.cc:3060] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:21:39.155252  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.160692 11222 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:39.160806  4261 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:39.162842  4261 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.163213  4289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:39.163770  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.167881  4111 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:39.169337 11222 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:39.174502  4187 leader_election.cc:336] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.175062  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:39.175455  4261 consensus_peers.cc:597] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.175978 11308 raft_consensus.cc:2749] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:39.176644  3021 raft_consensus.cc:2272] T f61c18f5030a4980bd0f16ae2690b843 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.201467  4920 raft_consensus.cc:2468] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
W20260709 13:21:39.204097  4893 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.215112  4259 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:39.217409 11290 raft_consensus.cc:2804] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:21:39.218036 11290 raft_consensus.cc:697] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:39.223237 11307 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.219432 11290 consensus_queue.cc:237] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 9.12, Last appended by leader: 12, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:39.226204 11307 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.231840 11307 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:39.235323  3021 tablet_replica.cc:333] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.236588  3021 raft_consensus.cc:2243] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.237638  3021 raft_consensus.cc:2272] T 0334f31959bc48878664996813e359b4 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.237673  4294 raft_consensus.cc:1275] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:21:39.240084 11122 consensus_queue.cc:1048] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:39.263329  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.268535  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.279134  4261 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:39.224865  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 50519.3us
W20260709 13:21:39.296152  4187 consensus_peers.cc:597] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.298933  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.298554  4893 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.318262  3021 tablet_replica.cc:333] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.317343  4040 catalog_manager.cc:5697] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 14 to 15, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.319482  3021 raft_consensus.cc:2243] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.320636  3021 raft_consensus.cc:2272] T ab416835542d4f11852821a8161b8f7b P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.326571 11307 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.327374 11307 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:39.328636  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.330636 11307 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:39.339262  3021 tablet_replica.cc:333] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.345885 11305 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.346693 11305 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.347725 11258 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.348361 11258 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.350734 11258 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:39.351061  4261 leader_election.cc:336] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.351246 11258 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.353679 11305 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:39.354017  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:39.354653  4296 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:21:39.351900 11258 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.357640  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:39.359334  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:39.360476 11305 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:39.360934 11305 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.361334 11305 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:39.361505  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:39.362250  4217 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
W20260709 13:21:39.365010  4261 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:39.382342  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.389720  3021 raft_consensus.cc:2243] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:39.392259  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:39.392877  4218 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:39.395938  4220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:39.396876  4220 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:39.400463  4296 raft_consensus.cc:1275] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:39.402089  4294 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:39.402489 11266 consensus_queue.cc:1048] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:39.406682 11266 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:39.375535 11258 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:39.449048  3021 raft_consensus.cc:2272] T eff857a690104e20896367b8755773e0 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.505591  3021 tablet_replica.cc:333] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.521941  4295 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:39.532913  4185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:35693, user_credentials={real_user=slave}} blocked reactor thread for 75918.3us
I20260709 13:21:39.532446 11338 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:39.489562  4040 catalog_manager.cc:5697] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 9 to 10, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 10 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:39.537511  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 97792.4us
I20260709 13:21:39.547361  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:39.522393 11305 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.558784  4919 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:39.550192  3021 raft_consensus.cc:2243] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:21:39.562988  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ee822f7cf89d49cb90b5fa2997ef4f4f: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:21:39.567672  4187 consensus_peers.cc:597] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.574707  4219 raft_consensus.cc:2393] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f753b799f924bacb0a0f0f6e0068ee9 in current term 20: Already voted for candidate 34e6205f3c1d434193126fef20d73800 in this term.
I20260709 13:21:39.575678 11305 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:39.566421  4893 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.582291  3021 raft_consensus.cc:2272] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:39.588279  4187 consensus_peers.cc:597] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.589118  4187 consensus_peers.cc:597] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.589702  4187 consensus_peers.cc:597] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.591251  3021 tablet_replica.cc:333] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.592149  3021 raft_consensus.cc:2243] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.592984  3021 raft_consensus.cc:2272] T 151a7707aeab4292bf6804cdfbf0cf06 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.601617  3021 tablet_replica.cc:333] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.602658  3021 raft_consensus.cc:2243] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.603796  3021 raft_consensus.cc:2272] T 3e71d21bb0584872aaf6dcba10ac49fc P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:39.605163  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:45005, user_credentials={real_user=slave}} blocked reactor thread for 58339us
I20260709 13:21:39.606052  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:39.607336  3021 tablet_replica.cc:333] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.607542  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:39.608408  3021 raft_consensus.cc:2243] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.608567 11322 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:39.609283 11336 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:39.609723 11336 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.609948 11322 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:39.610103 11336 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:39.610459 11322 raft_consensus.cc:493] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.610880 11322 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:39.614903  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:39.616817 11290 raft_consensus.cc:3060] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:39.622695  3021 raft_consensus.cc:2272] T ccbf9cc060a440feab4ab0c62d18794f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.625962  3021 tablet_replica.cc:333] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.627425 11322 raft_consensus.cc:515] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:39.630849  4186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 60518.3us
I20260709 13:21:39.632377  4296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e2dc5c77a5416995232da7a676ae73" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:39.637068 11266 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:21:39.638708  4187 consensus_peers.cc:597] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.639130  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48865.7us
W20260709 13:21:39.640621  4187 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:39.641943  4187 consensus_peers.cc:597] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.644057 11308 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.644654 11308 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.646672 11308 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:39.649462  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:39.650091  4295 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:21:39.651588  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:39.652436 11266 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:39.652799 11266 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.653180 11266 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:39.665740 11322 leader_election.cc:290] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:39.668761  4187 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.670696  4919 raft_consensus.cc:2955] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
W20260709 13:21:39.673002  4261 leader_election.cc:336] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.685665 11336 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.688973  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5c2c5dc1b340968b54f2a9a970cfce" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:39.689630  4218 raft_consensus.cc:3060] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:39.689783  4031 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 584cfa5b7a8849d1bb573f5304d7cce9 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:39.691552 11336 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:39.693603 11290 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:39.703635  4296 raft_consensus.cc:2468] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:39.703377  4038 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: config changed from index 11 to 12, VOTER 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) evicted. New cstate: current_term: 15 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } } }
I20260709 13:21:39.707129  4186 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:39.708784 11343 raft_consensus.cc:2804] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:39.709334 11343 raft_consensus.cc:697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:39.710283 11343 consensus_queue.cc:237] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.709352  3021 raft_consensus.cc:2243] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.717429  3021 raft_consensus.cc:2272] T ee822f7cf89d49cb90b5fa2997ef4f4f P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.721333  3021 tablet_replica.cc:333] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.722141  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
W20260709 13:21:39.722788  4261 consensus_peers.cc:597] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.766815  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 44063.4us
I20260709 13:21:39.766839  4217 raft_consensus.cc:3060] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:39.767755  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.723052  4187 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.732484  4925 raft_consensus.cc:1275] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 9 index: 12. Preceding OpId from leader: term: 10 index: 13. (index mismatch)
I20260709 13:21:39.672483 11266 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:39.771848  4187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 48850us
I20260709 13:21:39.772866 11336 consensus_queue.cc:1048] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:39.773823 11266 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:39.778617 11342 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.779189 11342 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.729712  4218 raft_consensus.cc:2468] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 18.
I20260709 13:21:39.781829 11342 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:39.786705  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8ad10a3aa47109171ff50298ccf9b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:39.787309  4291 raft_consensus.cc:3060] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:39.791004  4217 raft_consensus.cc:2468] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:39.767107  3021 raft_consensus.cc:2243] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:39.798615  3021 raft_consensus.cc:2272] T fee6dae3af1842289de63342b7a950f9 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.801824  3021 tablet_replica.cc:333] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c: stopping tablet replica
I20260709 13:21:39.804798  4291 raft_consensus.cc:2468] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:39.808359  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:39.808753  4261 leader_election.cc:304] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
W20260709 13:21:39.821489  4187 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.834931  4261 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:39.840461 11336 raft_consensus.cc:2804] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:39.841054 11336 raft_consensus.cc:697] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:39.842118  4186 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:39.843281 11295 raft_consensus.cc:2804] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:39.843163 11336 consensus_queue.cc:237] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:39.843050  4038 catalog_manager.cc:5697] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 19 to 20, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 20 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.843876 11295 raft_consensus.cc:697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:39.845275 11295 consensus_queue.cc:237] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:39.849210  4261 leader_election.cc:336] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:39.851446  4261 leader_election.cc:336] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.853387 11322 raft_consensus.cc:2804] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:39.855865 11322 raft_consensus.cc:697] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:39.856887 11322 consensus_queue.cc:237] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:39.852315  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:39.862325  3021 raft_consensus.cc:2243] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:39.863588  3021 raft_consensus.cc:2272] T 4661232a8b934fa0b9135bf4650bfd02 P 32ebd3bc4af5446f94d9f3ac7c8cf53c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:39.891064  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.892023  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:39.893784  4261 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.901083  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:39.902633 11337 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:39.916190  4261 consensus_peers.cc:597] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.941748  4042 catalog_manager.cc:5697] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 17 to 18, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 18 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.949062 11339 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:39.953305 11339 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:39.959883 11339 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:39.960122  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:39.968976  4038 catalog_manager.cc:5697] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 19 to 20, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 20 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.984678  4042 catalog_manager.cc:5697] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 16 to 17, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 17 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:39.997515  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:39.998011  4893 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:39.999008 11339 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:40.024959 11266 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.025632 11266 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:40.026322 11295 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.026883 11295 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.027802 11266 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:40.029170 11295 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:40.029224  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:40.033007  4925 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
W20260709 13:21:40.033201  4187 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.031960  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:40.034116  4291 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 15.
I20260709 13:21:40.035470  4186 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:40.036064 11343 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.036636 11343 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.036866  4185 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:40.037106 11340 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:40.037492 11340 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.037829 11340 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:40.038621 11343 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:40.039227 11343 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:40.039564 11343 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.039899 11343 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:40.043613  4187 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.044656  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:40.051666 11340 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.068594  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434e24168b204a82b4cafcc2cba44c46" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:40.069270  4291 raft_consensus.cc:3060] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:40.074918  4187 leader_election.cc:336] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.075488  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:40.077279 11266 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:40.078974  4291 raft_consensus.cc:2468] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 16.
W20260709 13:21:40.079882  4187 consensus_peers.cc:597] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:40.081185  4186 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:40.079550 11340 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:40.081986 11266 raft_consensus.cc:2804] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:40.082511 11266 raft_consensus.cc:697] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:40.083443 11266 consensus_queue.cc:237] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:40.092948  4187 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.076897 11343 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:40.099427 11343 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:40.099649  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7cd0a583da4bb18010d5a62595ea88" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:40.100292  4925 raft_consensus.cc:3060] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:40.107990  4042 catalog_manager.cc:5697] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 15 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 16 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.127090  4925 raft_consensus.cc:2468] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
W20260709 13:21:40.121975  4187 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.133152  4185 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:40.135537 11266 raft_consensus.cc:2804] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:40.136119 11266 raft_consensus.cc:697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:40.137995 11266 consensus_queue.cc:237] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:40.171234  4042 catalog_manager.cc:5697] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 19 to 20, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 20 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.245071 11290 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.245568  4217 raft_consensus.cc:1275] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:40.245718 11290 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.257406 11290 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
I20260709 13:21:40.261197 11337 consensus_queue.cc:1048] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:40.262867  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:40.264539  4291 raft_consensus.cc:1275] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:40.267967 11343 consensus_queue.cc:1048] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:40.274101  4217 raft_consensus.cc:1275] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:21:40.300560  4187 consensus_peers.cc:597] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.311241  4187 consensus_peers.cc:597] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.324591 11322 consensus_queue.cc:1048] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:40.328804 11266 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.329581 11266 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.331763 11266 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:40.336516  4295 raft_consensus.cc:1275] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:21:40.341150  4187 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.341854  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:40.345345 11337 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.345922 11337 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.346618 11343 consensus_queue.cc:1048] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:40.348016 11337 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:40.348917  4186 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:40.363485 11266 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:40.367477  4219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:40.368126  4219 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:40.368126 11266 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.369059 11266 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.371255 11266 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:40.377070  4261 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.378818  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:40.379698 11337 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:40.386830  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:40.387516  4291 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 17.
W20260709 13:21:40.389252  4893 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 318 similar messages]
W20260709 13:21:40.394260  4187 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.396087  4186 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:40.396899 11340 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:40.397346 11340 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.397732 11340 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:40.403007  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:40.403940 11337 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:40.404431 11337 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.404906 11337 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:40.405942 11340 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.418562 11340 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:40.424700  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2ffb00e35435085552a2adb73fcc2" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:40.425381  4291 raft_consensus.cc:3060] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:40.426187  4261 consensus_peers.cc:597] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.433703  4187 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:40.433905  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:40.441319  4261 consensus_peers.cc:597] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.441912  4261 leader_election.cc:336] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.441614 11337 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.450152 11337 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:40.456501  4291 raft_consensus.cc:2468] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 18.
I20260709 13:21:40.467630 11290 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.468382 11290 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.472164  4186 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:40.473295 11266 raft_consensus.cc:2804] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:40.473812 11266 raft_consensus.cc:697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:40.474686 11266 consensus_queue.cc:237] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.481731  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:40.482370  4218 raft_consensus.cc:3060] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:40.482578 11290 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:40.503291  4218 raft_consensus.cc:2468] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:40.515520  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:40.525627  4038 catalog_manager.cc:5697] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 17 to 18, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 18 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.542073  4261 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:40.543210 11290 raft_consensus.cc:2804] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:40.544435 11290 raft_consensus.cc:697] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:40.545445 11290 consensus_queue.cc:237] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:40.575951  4261 leader_election.cc:336] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:40.577101  4261 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:40.578029  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:40.578943 11322 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:40.581384  4925 raft_consensus.cc:1275] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:21:40.583024 11340 consensus_queue.cc:1048] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:21:40.600991  4187 consensus_peers.cc:597] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.615823  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ee822f7cf89d49cb90b5fa2997ef4f4f: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:21:40.620059 11322 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.620688 11322 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.622695 11322 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:40.630662  4187 consensus_peers.cc:597] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.633678  4291 raft_consensus.cc:1275] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:40.635404 11266 consensus_queue.cc:1048] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:40.638329  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:40.638983  4218 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:40.644287 11266 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.644886 11266 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.648187  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:40.649049  4295 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:21:40.650552  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:40.651592 11335 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:40.652024 11335 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
W20260709 13:21:40.652135  4111 connection.cc:466] server connection from 127.0.0.1:52134 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52134 (request call id 4063) could send its response
I20260709 13:21:40.652475 11335 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:40.649304  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:40.659642 11322 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:40.663125 11322 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.663540 11322 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:40.672720 11322 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.674563 11266 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:40.674718 11322 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:40.676353  4893 connection.cc:573] client connection to 127.2.243.65:36237 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:21:40.685564  4261 connection.cc:769] client connection to 127.2.243.65:36237 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 13:21:40.717563  4261 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:40.718127  4261 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:40.720824  4187 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:40.723944 11344 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.724609 11344 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:40.726760 11344 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:40.729552  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:40.733299  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:40.733824  4218 raft_consensus.cc:3060] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:40.742180 11335 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.762497  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff857a690104e20896367b8755773e0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:40.763144  4291 raft_consensus.cc:3060] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:40.768469 11335 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:40.785401  4291 raft_consensus.cc:2468] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
I20260709 13:21:40.786689  4186 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:40.787492 11335 raft_consensus.cc:2804] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:40.788179 11335 raft_consensus.cc:697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:40.789177 11335 consensus_queue.cc:237] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:40.797526  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:40.798060  4893 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:40.811265  4038 catalog_manager.cc:5697] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 15 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:40.814357 11344 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:40.817394  4218 raft_consensus.cc:2468] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
W20260709 13:21:40.834061  4187 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:40.876864  4042 catalog_manager.cc:5697] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 19 to 20, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 20 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.891144  4261 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:40.899140 11322 raft_consensus.cc:2804] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:40.899720 11322 raft_consensus.cc:697] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:40.900687 11322 consensus_queue.cc:237] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:40.942440  4291 raft_consensus.cc:1275] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:40.945600 11308 consensus_queue.cc:1048] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:40.961784  4038 catalog_manager.cc:5697] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 15 to 16, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:40.990742 11308 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:40.991339 11308 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:40.993520 11308 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:40.998469  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:40.999183  4919 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 19.
I20260709 13:21:41.000730  4185 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:41.001597 11308 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:41.002005 11308 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:41.002389 11308 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:41.006873  4187 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:41.010788 11308 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:41.022234  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d1753ccc1e4c2d98ff3195cd6bb590" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:41.022810  4919 raft_consensus.cc:3060] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:41.026734  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:41.030565 11308 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:41.039937  4187 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:41.045439  4187 consensus_peers.cc:597] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.042711  4919 raft_consensus.cc:2468] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 20.
W20260709 13:21:41.043990  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:41.050853  4185 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:41.052017 11308 raft_consensus.cc:2804] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:41.053390 11308 raft_consensus.cc:697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:41.054307 11308 consensus_queue.cc:237] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:41.071388 11335 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:41.071938 11335 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:41.074342 11335 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:41.075384  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:41.082857 11336 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:41.083437 11336 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:41.086014 11336 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:41.086977  4261 consensus_peers.cc:597] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.091768  4187 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:41.094763  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:41.095587 11335 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:41.099915  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
W20260709 13:21:41.101874  4261 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:41.106595  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:41.107456 11290 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:41.125470  4038 catalog_manager.cc:5697] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 19 to 20, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 20 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:41.167589  4187 consensus_peers.cc:597] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:41.169202  4217 raft_consensus.cc:1275] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:41.172174 11336 consensus_queue.cc:1048] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:41.210920  4291 raft_consensus.cc:1275] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:41.212390 11308 consensus_queue.cc:1048] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:21:41.232853  4187 consensus_peers.cc:597] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.246438  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:41.254629 11308 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:41.255311 11308 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:41.257422 11308 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:41.259253  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:41.259948  4295 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 24.
I20260709 13:21:41.261070  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:41.261878 11308 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:41.262300 11308 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:41.262652 11308 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:21:41.266121  4187 consensus_peers.cc:597] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.276845 11308 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:41.280917 11308 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 25 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:41.296376  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee6dae3af1842289de63342b7a950f9" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:41.296984  4295 raft_consensus.cc:3060] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:41.304299  4295 raft_consensus.cc:2468] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34e6205f3c1d434193126fef20d73800 in term 25.
I20260709 13:21:41.307499  4186 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 
I20260709 13:21:41.309818 11345 raft_consensus.cc:2804] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:41.310366 11345 raft_consensus.cc:697] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 25 LEADER]: Becoming Leader. State: Replica: 34e6205f3c1d434193126fef20d73800, State: Running, Role: LEADER
I20260709 13:21:41.311254 11345 consensus_queue.cc:237] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:41.329670  4187 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:41.330482  4187 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:41.356067  4038 catalog_manager.cc:5697] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 reported cstate change: term changed from 24 to 25, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to 34e6205f3c1d434193126fef20d73800 (127.2.243.66). New cstate: current_term: 25 leader_uuid: "34e6205f3c1d434193126fef20d73800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:41.366590 11339 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:41.367250 11339 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:41.369285 11339 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:41.371387  4218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800" is_pre_election: true
I20260709 13:21:41.372076  4218 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 17.
I20260709 13:21:41.375952  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:41.378924 11339 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:41.379382 11339 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32ebd3bc4af5446f94d9f3ac7c8cf53c)
I20260709 13:21:41.379801 11339 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:41.384650  4893 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:41.386044  4187 consensus_peers.cc:597] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.404937  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:41.422824 11339 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:41.432755  4218 raft_consensus.cc:1275] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:41.439459 11290 consensus_queue.cc:1048] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:21:41.459554  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:41.472234 11339 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 election: Requested vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:41.479060  4217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "34e6205f3c1d434193126fef20d73800"
I20260709 13:21:41.479776  4217 raft_consensus.cc:3060] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:41.487560  4217 raft_consensus.cc:2468] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 18.
W20260709 13:21:41.488022  4893 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:41.489089  4261 consensus_peers.cc:597] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.490163  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.493083  4187 consensus_peers.cc:597] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.496011  4893 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c
I20260709 13:21:41.496833 11344 raft_consensus.cc:2804] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:41.497319 11344 raft_consensus.cc:697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 18 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:21:41.498193 11344 consensus_queue.cc:237] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:41.521867  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.529033  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:41.564500  4038 catalog_manager.cc:5697] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 17 to 18, leader changed from 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 18 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:41.570518  4261 consensus_peers.cc:597] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.596488  4892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:40585, user_credentials={real_user=slave}} blocked reactor thread for 74039.2us
W20260709 13:21:41.617609  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.618528 11379 log.cc:927] Time spent T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:21:41.658179  4893 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.689271  4187 consensus_peers.cc:597] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:41.689793  4187 consensus_peers.cc:597] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.692566  4893 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:41.694283  4925 raft_consensus.cc:1275] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:21:41.696996 11308 consensus_queue.cc:1048] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:21:41.702523  3021 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4168)
W20260709 13:21:41.720892  4187 consensus_peers.cc:597] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.741588  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.746582  4187 consensus_peers.cc:597] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.753041  4187 consensus_peers.cc:597] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.799633  4187 consensus_peers.cc:597] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.831346  4187 consensus_peers.cc:597] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.832283  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:41.853519  4187 consensus_peers.cc:597] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:41.910632  4893 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:41.919204  4291 raft_consensus.cc:1275] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Refusing update from remote peer 34e6205f3c1d434193126fef20d73800: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:21:41.929010 11308 consensus_queue.cc:1048] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:42.122957  4218 raft_consensus.cc:1275] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:21:42.129194 11380 consensus_queue.cc:1048] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:21:42.131500  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.132114  4261 consensus_peers.cc:597] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.140852  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.152086  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:42.153028  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.166350  4187 consensus_peers.cc:597] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.179932  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.185187  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.270742  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 584cfa5b7a8849d1bb573f5304d7cce9: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:42.274466  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.377408  4261 consensus_peers.cc:597] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.500705  4187 consensus_peers.cc:597] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.607587  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:42.700510  4187 consensus_peers.cc:597] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.908248  4261 consensus_peers.cc:597] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.948376  4187 consensus_peers.cc:597] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:43.009665  4261 consensus_peers.cc:597] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:43.046839  4187 consensus_peers.cc:597] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:43.054697  4187 consensus_peers.cc:597] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:43.321619  4187 consensus_peers.cc:597] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.322428  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.517863  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.563894  4187 consensus_peers.cc:597] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:43.588608  4261 consensus_peers.cc:597] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:43.643160  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.702419  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.704560  4187 consensus_peers.cc:597] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:43.724311  4187 consensus_peers.cc:597] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.802987  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.948480  4187 consensus_peers.cc:597] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.998383  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:43.999385  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.016144  4187 consensus_peers.cc:597] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:44.039994  3021 tablet_server.cc:196] TabletServer@127.2.243.65:0 shutdown complete.
W20260709 13:21:44.106913  4187 consensus_peers.cc:597] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:44.126123  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.157720  4893 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.159871  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.183323  4187 consensus_peers.cc:597] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:44.195025  4187 consensus_peers.cc:597] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.231557  4261 consensus_peers.cc:597] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:44.261924  4187 consensus_peers.cc:597] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.307473  4187 consensus_peers.cc:597] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:44.308679  4261 consensus_peers.cc:597] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.315094  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.315708  4261 consensus_peers.cc:597] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.328500  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.337904  4187 consensus_peers.cc:597] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:44.355103  3021 tablet_server.cc:179] TabletServer@127.2.243.66:0 shutting down...
W20260709 13:21:44.354987  4187 consensus_peers.cc:597] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.376968  4893 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.383677  4893 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.384078  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.387385  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.388600  4893 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:44.411966  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.419011  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.426367  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.440025  4187 consensus_peers.cc:597] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:44.446916  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 584cfa5b7a8849d1bb573f5304d7cce9: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:44.448206  4187 consensus_peers.cc:597] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.449290  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.509651  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:44.517748  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.521102  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.527861  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.528635  4261 consensus_peers.cc:597] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.551918  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:44.631055  4261 consensus_peers.cc:597] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.631112  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.634212  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.647239  4261 consensus_peers.cc:597] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:44.683736  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.718910  4893 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:44.732122  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:21:44.738792  4261 consensus_peers.cc:597] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:44.748131  3021 tablet_replica.cc:333] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:44.750052  3021 raft_consensus.cc:2243] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.757668  3021 raft_consensus.cc:2272] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.767804  4893 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.774564  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:44.779228  3021 tablet_replica.cc:333] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
W20260709 13:21:44.776430  4261 consensus_peers.cc:597] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:44.780385  3021 raft_consensus.cc:2243] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:21:44.785705  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:44.802803  3021 raft_consensus.cc:2272] T bb7d207ddadd4505a2b62ff61258cff1 P 34e6205f3c1d434193126fef20d73800 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.817162  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.831957  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.836762  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.839582  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:44.813737  3021 tablet_replica.cc:333] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:44.843501  3021 raft_consensus.cc:2243] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.853830  3021 raft_consensus.cc:2272] T 17b099e5e28a475fa86a6f1efaa21ed9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.844265  4261 consensus_peers.cc:597] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.882467  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:44.883917  3021 tablet_replica.cc:333] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:44.887045  3021 raft_consensus.cc:2243] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.888506  3021 raft_consensus.cc:2272] T 57a7dac49b784166afd62631b44900c8 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.901893  3021 tablet_replica.cc:333] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:44.903299  3021 raft_consensus.cc:2243] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.908275  3021 raft_consensus.cc:2272] T e2c23c7c663f4647955b43f85d642e1c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.941533  4261 consensus_peers.cc:597] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:44.954169  3021 tablet_replica.cc:333] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:44.955660  3021 raft_consensus.cc:2243] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:44.973342  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:44.987051  3021 raft_consensus.cc:2272] T d9ed971e9cd64f17bc8646a1d19e3622 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.010179  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:45.014891  3021 tablet_replica.cc:333] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.040750  3021 raft_consensus.cc:2243] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.060954  3021 raft_consensus.cc:2272] T e6b9a320ff854b5998471937010702d5 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.104004  3021 tablet_replica.cc:333] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.116986  3021 raft_consensus.cc:2243] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.123488  3021 raft_consensus.cc:2272] T a94558f1f2d64f6b8e16501cb7d48d78 P 34e6205f3c1d434193126fef20d73800 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.130831  3021 tablet_replica.cc:333] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.157609  3021 raft_consensus.cc:2243] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.164883  3021 raft_consensus.cc:2272] T 95ca04a09529497898d86f573a0e1189 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.160686  4261 consensus_peers.cc:597] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:45.201277  4187 consensus_peers.cc:597] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:45.204670  3021 tablet_replica.cc:333] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.206871  3021 raft_consensus.cc:2243] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.239874  3021 raft_consensus.cc:2272] T f1a8ad10a3aa47109171ff50298ccf9b P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.256122  3021 tablet_replica.cc:333] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
W20260709 13:21:45.275216  4187 consensus_peers.cc:597] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:45.285868  3021 raft_consensus.cc:2243] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.287264  3021 raft_consensus.cc:2272] T d2e2dc5c77a5416995232da7a676ae73 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.278103  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:45.290409  3021 tablet_replica.cc:333] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.291352  3021 raft_consensus.cc:2243] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.291957  3021 raft_consensus.cc:2272] T 002295ea4e164178a447d55ccde98422 P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.319556  3021 tablet_replica.cc:333] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.320842  3021 raft_consensus.cc:2243] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.321679  3021 raft_consensus.cc:2272] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.326713  4185 raft_consensus.cc:687] T 537f9faaf59648debe160e6df5d91fcd P 34e6205f3c1d434193126fef20d73800: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260709 13:21:45.335640  3021 tablet_replica.cc:333] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.336829  3021 raft_consensus.cc:2243] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.337608  3021 raft_consensus.cc:2272] T bf26f731cd1d411a93da2187b3452b52 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.369087  3021 tablet_replica.cc:333] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.369998 11396 raft_consensus.cc:493] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.370790 11396 raft_consensus.cc:515] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.375217  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ba8b2d18b04025b73da88c20e6dbe0" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.370095  3021 raft_consensus.cc:2243] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.379374  3021 raft_consensus.cc:2272] T b9ebd7fa04d4401f96670bd2866c719c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.383071  3021 tablet_replica.cc:333] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.383975  3021 raft_consensus.cc:2243] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.387107 11396 leader_election.cc:290] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.394553  3021 raft_consensus.cc:2272] T da0810d325774d7181018ff01e71333a P 34e6205f3c1d434193126fef20d73800 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.397962  3021 tablet_replica.cc:333] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
W20260709 13:21:45.398773  4893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111) [suppressed 545 similar messages]
W20260709 13:21:45.405017  4187 leader_election.cc:336] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.407541  4187 leader_election.cc:304] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:45.408524 11396 raft_consensus.cc:2749] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:45.413544 11396 raft_consensus.cc:493] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.398923  3021 raft_consensus.cc:2243] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.444533 11396 raft_consensus.cc:515] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.445264  3021 raft_consensus.cc:2272] T c130eddd78204cee994818f0043bf88c P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.451803  3021 tablet_replica.cc:333] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.452960  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a7707aeab4292bf6804cdfbf0cf06" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.460520 11396 leader_election.cc:290] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.468623 11308 raft_consensus.cc:493] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:45.469424 11308 raft_consensus.cc:515] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:45.471704 11308 leader_election.cc:290] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:45.474107  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270a058111c4161ba865afa3630bfb7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:45.452975  3021 raft_consensus.cc:2243] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.478400  3021 raft_consensus.cc:2272] T 4dd7c9d3d77844388d8c5138c924c640 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.482441  3021 tablet_replica.cc:333] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.487430  3021 raft_consensus.cc:2243] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.500958  3021 raft_consensus.cc:2272] T 7522b19b153a491c9d822b8ffb2becc5 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.504436  3021 tablet_replica.cc:333] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.513167  3021 raft_consensus.cc:2243] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.514051  3021 raft_consensus.cc:2272] T c93b2eb873344f43936dabea6e173ea0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.528782  3021 tablet_replica.cc:333] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.529186 11396 raft_consensus.cc:493] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.529716  3021 raft_consensus.cc:2243] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.529840 11396 raft_consensus.cc:515] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.530776  3021 raft_consensus.cc:2272] T 151524a8517e4b8ebc7308777c98105e P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.535336  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6091d765c73842c992d8c60523872ccc" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.535907 11308 raft_consensus.cc:493] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.532162 11396 leader_election.cc:290] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.539600  3021 tablet_replica.cc:333] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.536496 11308 raft_consensus.cc:515] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:45.540244  4261 consensus_peers.cc:597] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:45.546365 11308 leader_election.cc:290] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.544019  3021 raft_consensus.cc:2243] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.549506  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776151073534d2e9012d8a291b66b5a" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.551232  3021 raft_consensus.cc:2272] T ad5c2c5dc1b340968b54f2a9a970cfce P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.556247  3021 tablet_replica.cc:333] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.561206  3021 raft_consensus.cc:2243] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.569044  3021 raft_consensus.cc:2272] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.578161  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:45.580328  4187 leader_election.cc:336] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.581004  4187 leader_election.cc:304] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:45.582304 11308 raft_consensus.cc:2749] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:45.582468  4187 leader_election.cc:336] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.582737  3021 tablet_replica.cc:333] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.582978  4187 leader_election.cc:304] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:45.583781  3021 raft_consensus.cc:2243] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.583905 11308 raft_consensus.cc:2749] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:21:45.594696  3021 raft_consensus.cc:2272] T 527025007d0641e3a50bfc3a9d2e5b80 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.595466 11308 raft_consensus.cc:493] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:45.596051 11308 raft_consensus.cc:515] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:45.598440 11308 leader_election.cc:290] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:45.599736  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4661232a8b934fa0b9135bf4650bfd02" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:45.604032 11398 raft_consensus.cc:493] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b81584b21ed144698954548303f1e507)
I20260709 13:21:45.604750 11398 raft_consensus.cc:515] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:45.607327 11398 leader_election.cc:290] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:45.609557  4187 leader_election.cc:336] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.609843  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0334f31959bc48878664996813e359b4" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:45.610183  4187 leader_election.cc:304] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:45.610958 11398 raft_consensus.cc:2749] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:45.613427  3021 tablet_replica.cc:333] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.614445  3021 raft_consensus.cc:2243] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.615578  3021 raft_consensus.cc:2272] T eff857a690104e20896367b8755773e0 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.638303  3021 tablet_replica.cc:333] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.639580  3021 raft_consensus.cc:2243] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.653474  3021 raft_consensus.cc:2272] T 584cfa5b7a8849d1bb573f5304d7cce9 P 34e6205f3c1d434193126fef20d73800 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.631798  4187 leader_election.cc:336] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.662804  4187 leader_election.cc:304] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:45.665318  4187 raft_consensus.cc:2686] T f776151073534d2e9012d8a291b66b5a P 34e6205f3c1d434193126fef20d73800: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:45.688956  3021 tablet_replica.cc:333] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.698484 11308 raft_consensus.cc:493] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.703191 11308 raft_consensus.cc:515] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.706986 11308 leader_election.cc:290] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.707197  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a95e60f9ae4eea85c4a330ff8078c7" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.711287  3021 raft_consensus.cc:2243] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.714720  3021 raft_consensus.cc:2272] T 10d1753ccc1e4c2d98ff3195cd6bb590 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.736197 11308 raft_consensus.cc:493] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.737088 11308 raft_consensus.cc:515] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.740701 11308 leader_election.cc:290] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.740974  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61c18f5030a4980bd0f16ae2690b843" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.743991  3021 tablet_replica.cc:333] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.752231 11336 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:45.752995 11336 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.755353 11336 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:45.755632  3021 raft_consensus.cc:2243] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:45.760686  4261 leader_election.cc:336] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:45.762705  4187 leader_election.cc:336] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.768543  4187 leader_election.cc:304] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:45.766134 11308 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.783808 11308 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:45.788704 11308 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:45.788856  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.763840  3021 raft_consensus.cc:2272] T 151a7707aeab4292bf6804cdfbf0cf06 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.791879 11396 raft_consensus.cc:2749] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:45.792016  4187 leader_election.cc:336] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.794502  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee822f7cf89d49cb90b5fa2997ef4f4f" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:45.796183  4185 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507
I20260709 13:21:45.798338 11308 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:45.792831  4187 leader_election.cc:304] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:45.800161 11308 raft_consensus.cc:2749] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:45.803607  4187 consensus_peers.cc:597] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:45.805439  3021 tablet_replica.cc:333] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.813838  3021 raft_consensus.cc:2243] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.818295  3021 raft_consensus.cc:2272] T 3e71d21bb0584872aaf6dcba10ac49fc P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.822439  3021 tablet_replica.cc:333] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.823423  3021 raft_consensus.cc:2243] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.825384  3021 raft_consensus.cc:2272] T ccbf9cc060a440feab4ab0c62d18794f P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.829334  3021 tablet_replica.cc:333] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.830257  3021 raft_consensus.cc:2243] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.831436  3021 raft_consensus.cc:2272] T 38e2ffb00e35435085552a2adb73fcc2 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.834007  4187 consensus_peers.cc:597] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:45.836793  4187 leader_election.cc:336] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.837224  4187 leader_election.cc:304] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:45.836099  3021 tablet_replica.cc:333] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.839372 11396 raft_consensus.cc:493] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.839874 11398 raft_consensus.cc:2749] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:45.841673 11398 raft_consensus.cc:493] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.842362 11398 raft_consensus.cc:515] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.846231 11398 leader_election.cc:290] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.846478  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6478d83fa954184a297fb7466378df1" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.840080 11396 raft_consensus.cc:515] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.853120 11398 raft_consensus.cc:493] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.856006 11308 raft_consensus.cc:493] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:45.857187 11308 raft_consensus.cc:515] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.859405 11308 leader_election.cc:290] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.861744 11396 leader_election.cc:290] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.861517 11398 raft_consensus.cc:515] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.863422  3021 raft_consensus.cc:2243] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.861521  4291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5985d95b5ba74bed90f719c554bee460" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.864956  3021 raft_consensus.cc:2272] T 7abf29f1bff94e6397d4a2561e35ef1b P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.861521  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42018491ecaa43a29d99307d7ccd824b" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.870517  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70df96ad70f0416db400b7395b0d7b9e" candidate_uuid: "34e6205f3c1d434193126fef20d73800" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:45.870519  3021 tablet_replica.cc:333] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.874635  3021 raft_consensus.cc:2243] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.875345  3021 raft_consensus.cc:2272] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.870679 11398 leader_election.cc:290] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:45.895803  3021 tablet_replica.cc:333] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
W20260709 13:21:45.902464  4187 leader_election.cc:336] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.904011  4187 leader_election.cc:304] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:45.901623  3021 raft_consensus.cc:2243] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.909595 11404 raft_consensus.cc:2749] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:45.908804  3021 raft_consensus.cc:2272] T 09ba8b2d18b04025b73da88c20e6dbe0 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.913558  3021 tablet_replica.cc:333] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.914546  3021 raft_consensus.cc:2243] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.915933  3021 raft_consensus.cc:2272] T e24b8745010349f4b91ac3fb893c50d0 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.931232  4261 leader_election.cc:336] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:45.931737  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:45.932519 11336 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:21:45.941058  4187 leader_election.cc:336] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.942480  4187 leader_election.cc:304] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:45.943646  4187 leader_election.cc:336] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.944106  4187 leader_election.cc:304] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:45.946516 11399 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:45.947155 11399 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:45.948858 11404 raft_consensus.cc:2749] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:45.949666 11404 raft_consensus.cc:2749] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:45.954211 11399 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:45.954447  4187 leader_election.cc:336] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.957558  4187 leader_election.cc:304] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:45.958756  4187 leader_election.cc:336] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.959226  4187 leader_election.cc:304] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34e6205f3c1d434193126fef20d73800; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:45.959600 11398 raft_consensus.cc:2749] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:45.959942  4187 raft_consensus.cc:2686] T 70df96ad70f0416db400b7395b0d7b9e P 34e6205f3c1d434193126fef20d73800: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:45.965167  3021 tablet_replica.cc:333] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.975164  3021 raft_consensus.cc:2243] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.976416  3021 raft_consensus.cc:2272] T 11a1f1fbec3b44838ed91074017003db P 34e6205f3c1d434193126fef20d73800 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.973999  4261 leader_election.cc:336] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:45.985844  3021 tablet_replica.cc:333] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.988137  3021 raft_consensus.cc:2243] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.989316  3021 raft_consensus.cc:2272] T e6478d83fa954184a297fb7466378df1 P 34e6205f3c1d434193126fef20d73800 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.992969  3021 tablet_replica.cc:333] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:45.998271  3021 raft_consensus.cc:2243] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.001672  3021 raft_consensus.cc:2272] T 27a95e60f9ae4eea85c4a330ff8078c7 P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.008801  3021 tablet_replica.cc:333] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
W20260709 13:21:46.012020  4261 leader_election.cc:336] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:46.012647  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.013989 11399 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:46.021306  3021 raft_consensus.cc:2243] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.022270  3021 raft_consensus.cc:2272] T 5985d95b5ba74bed90f719c554bee460 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.026028  3021 tablet_replica.cc:333] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.027534 11378 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.028228 11378 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.037216  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
W20260709 13:21:46.045449  4893 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:46.046307  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:46.048480 11378 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:46.049368 11385 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:46.051311  3021 raft_consensus.cc:2243] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.052114  3021 raft_consensus.cc:2272] T 6091d765c73842c992d8c60523872ccc P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.058455  3021 tablet_replica.cc:333] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.059526  3021 raft_consensus.cc:2243] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.060992  3021 raft_consensus.cc:2272] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.065593  3021 tablet_replica.cc:333] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.066579  3021 raft_consensus.cc:2243] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.072635  3021 raft_consensus.cc:2272] T 4661232a8b934fa0b9135bf4650bfd02 P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.079125  3021 tablet_replica.cc:333] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.080212  3021 raft_consensus.cc:2243] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.100870  3021 raft_consensus.cc:2272] T f61c18f5030a4980bd0f16ae2690b843 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.109927  3021 tablet_replica.cc:333] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.114378  3021 raft_consensus.cc:2243] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:46.116160  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:46.117103  3021 raft_consensus.cc:2272] T 42018491ecaa43a29d99307d7ccd824b P 34e6205f3c1d434193126fef20d73800 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.122184  3021 tablet_replica.cc:333] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.123159  3021 raft_consensus.cc:2243] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.125247  3021 raft_consensus.cc:2272] T 9e7cd0a583da4bb18010d5a62595ea88 P 34e6205f3c1d434193126fef20d73800 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:46.125311  4261 consensus_peers.cc:597] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:46.130540  3021 tablet_replica.cc:333] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.131544  3021 raft_consensus.cc:2243] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.133028  3021 raft_consensus.cc:2272] T fee6dae3af1842289de63342b7a950f9 P 34e6205f3c1d434193126fef20d73800 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.136101  3021 tablet_replica.cc:333] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.137158  3021 raft_consensus.cc:2243] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.145012  3021 raft_consensus.cc:2272] T 434e24168b204a82b4cafcc2cba44c46 P 34e6205f3c1d434193126fef20d73800 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.149995  3021 tablet_replica.cc:333] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.150910  3021 raft_consensus.cc:2243] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.151660  3021 raft_consensus.cc:2272] T 1270a058111c4161ba865afa3630bfb7 P 34e6205f3c1d434193126fef20d73800 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.154963  3021 tablet_replica.cc:333] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.155821  3021 raft_consensus.cc:2243] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.156947  3021 raft_consensus.cc:2272] T ee822f7cf89d49cb90b5fa2997ef4f4f P 34e6205f3c1d434193126fef20d73800 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.167631  3021 tablet_replica.cc:333] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800: stopping tablet replica
I20260709 13:21:46.168509  3021 raft_consensus.cc:2243] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.169351  3021 raft_consensus.cc:2272] T 0334f31959bc48878664996813e359b4 P 34e6205f3c1d434193126fef20d73800 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.185756 11399 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.186408 11399 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:46.189108 11399 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:46.204089  4261 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:46.205165  4261 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:46.205607  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.206467 11322 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:46.291448  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:46.319173 11399 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.320091 11399 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.325259 11399 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:46.327471  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:46.328680 11378 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.329279 11378 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:46.331616  4261 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:46.328233  4925 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:46.339888  4259 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.341653 11399 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:46.342119 11399 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.342519 11399 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:46.346344 11378 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:46.357761 11399 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.361675  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a7dac49b784166afd62631b44900c8" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:46.362413  4925 raft_consensus.cc:3060] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:46.366493 11322 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.367137 11322 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:46.369297 11322 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:46.375777  4925 raft_consensus.cc:2468] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
W20260709 13:21:46.376020  4261 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:46.381517  4259 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.382845 11336 raft_consensus.cc:2804] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:46.383360 11336 raft_consensus.cc:697] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:46.384305 11336 consensus_queue.cc:237] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.376451 11399 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:46.427951  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:46.446528  4261 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:46.459502  4893 connection.cc:769] client connection to 127.2.243.66:45005 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:21:46.465837  4261 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:46.466533  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.467309 11336 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:46.482534  4261 connection.cc:769] client connection to 127.2.243.66:45005 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:21:46.484019  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:46.485409  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:46.486361  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.486778  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.487607 11378 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:46.511993  4042 catalog_manager.cc:5697] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 15 to 16, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.518791 11399 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.519615 11399 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.523762  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:46.526083 11399 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:46.523998  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:46.560891 11322 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:21:46.561633  4261 consensus_peers.cc:597] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:46.561519 11322 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:46.563879 11322 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:46.572686  4261 leader_election.cc:336] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.583730  4261 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:46.584852 11322 raft_consensus.cc:2749] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:46.585894  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:46.586561  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:46.588042  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:46.598050  4261 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:46.601457  4261 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:46.603730  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.606104 11322 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:46.621031 11322 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.621688 11322 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:46.624511 11322 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:46.634001  4261 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:46.655932  4261 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.656627  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.658066 11399 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:46.666751  4261 consensus_peers.cc:597] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:46.678532  4261 consensus_peers.cc:597] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:46.709754 11378 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.710481 11378 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.712980 11378 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:46.724586  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:46.744601 11410 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.745457 11410 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.749547  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:46.754076 11322 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.754829 11322 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:46.757390 11322 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:46.759042 11410 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:46.772588  4893 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:46.773152  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:46.773329  4261 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:46.774217  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.774854  4893 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.775251  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.775635  4893 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:46.776005  4261 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:46.786360  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.776562 11410 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:46.783987  4893 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.794765 11336 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:46.798007 11336 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.798630 11322 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.799351 11322 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:46.800014  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.802537 11322 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:46.798651 11336 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.794386  4893 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:46.805198 11410 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:46.805392 11336 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:46.807940  4893 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:46.807880  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:46.809437  4925 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 15.
I20260709 13:21:46.811584  4259 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:46.812922 11322 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:46.813346 11322 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.813745 11322 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:46.823303 11322 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:46.825515  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.828125  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebd7fa04d4401f96670bd2866c719c" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:46.829208  4925 raft_consensus.cc:3060] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:46.834496  4261 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:46.837153  4261 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.837899  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.840847 11399 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:46.842723  4261 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.844452 11410 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.845234 11410 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.848469 11322 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:46.841275  4925 raft_consensus.cc:2468] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:46.850230  4259 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:46.851135 11322 raft_consensus.cc:2804] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:46.851699 11322 raft_consensus.cc:697] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:46.852596 11322 consensus_queue.cc:237] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.852948  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:46.853647  4295 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
W20260709 13:21:46.853762  4893 leader_election.cc:336] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.855199  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.856297 11378 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:21:46.856622  4893 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.856851 11378 raft_consensus.cc:493] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.850602 11410 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:46.857317 11378 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:46.857987  4261 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.861109 11399 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.862208 11399 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:46.863530  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:46.872109 11399 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
W20260709 13:21:46.895470  4261 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:46.901052  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:46.901753  4261 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:46.902369  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.897919 11378 raft_consensus.cc:515] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.927520 11378 leader_election.cc:290] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:46.915360 11399 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:46.929350  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7522b19b153a491c9d822b8ffb2becc5" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:46.930382  4295 raft_consensus.cc:3060] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:46.938541  4893 leader_election.cc:336] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:46.940383  4261 consensus_peers.cc:597] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.940761 11385 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.941330 11385 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.943625 11385 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:46.951516  4295 raft_consensus.cc:2468] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 16.
W20260709 13:21:46.952975  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:46.953222  4892 leader_election.cc:304] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
W20260709 13:21:46.953563  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:46.954618 11378 raft_consensus.cc:2804] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:46.955293 11378 raft_consensus.cc:697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 16 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
W20260709 13:21:46.955452  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:46.955929  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:46.956833 11385 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:46.956437 11378 consensus_queue.cc:237] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:46.969906  4261 consensus_peers.cc:597] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.971796  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ee822f7cf89d49cb90b5fa2997ef4f4f: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:46.986215  4925 raft_consensus.cc:1275] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:21:46.991253 11399 consensus_queue.cc:1048] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:46.996191 11385 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:46.996841 11385 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:46.995956  4042 catalog_manager.cc:5697] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 15 to 16, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 16 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.999292 11385 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:47.013497  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:47.016819  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.017409  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:47.018890 11385 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:47.020278  4038 catalog_manager.cc:5697] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 15 to 16, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 16 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:47.026010  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:47.026859  4261 consensus_peers.cc:597] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:47.040050  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:47.043298  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.046772 11399 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.047523 11399 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:47.050472  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:47.051286  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.052978  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:47.054962 11399 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:47.058354  4261 leader_election.cc:336] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.059278  4261 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 34e6205f3c1d434193126fef20d73800, b81584b21ed144698954548303f1e507
I20260709 13:21:47.062896 11400 raft_consensus.cc:2749] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:47.103012 11322 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.103694 11322 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:47.106776 11322 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:47.108551  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:47.114722  4893 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:47.124640 11399 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.125612 11399 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:47.128631 11399 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:47.152699  4261 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:47.153514  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, b81584b21ed144698954548303f1e507
I20260709 13:21:47.154495 11399 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:47.154699  4261 leader_election.cc:336] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:47.156388  4261 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.157433 11378 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.158790 11378 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:47.162199 11378 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:47.163887  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:47.167768 11385 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.168547 11385 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:47.175364  4893 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.175745  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:47.176090  4893 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:47.176708  4295 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 15.
W20260709 13:21:47.177712  4261 leader_election.cc:336] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.179342 11410 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:47.179653  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:47.178431  4892 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:47.184195 11399 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:47.184471 11410 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:47.185001 11410 raft_consensus.cc:493] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.185406 11410 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:47.187311  4893 leader_election.cc:336] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.180507 11385 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:47.198252  4261 consensus_peers.cc:597] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.205881 11410 raft_consensus.cc:515] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:47.210441  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584cfa5b7a8849d1bb573f5304d7cce9" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9"
I20260709 13:21:47.211225  4295 raft_consensus.cc:3060] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:47.210587  4893 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.220836 11410 leader_election.cc:290] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:47.228041  4893 leader_election.cc:336] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.229854  4295 raft_consensus.cc:2468] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 16.
I20260709 13:21:47.231495  4892 leader_election.cc:304] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800
I20260709 13:21:47.233210 11410 raft_consensus.cc:2804] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:47.237349 11410 raft_consensus.cc:697] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 16 LEADER]: Becoming Leader. State: Replica: b81584b21ed144698954548303f1e507, State: Running, Role: LEADER
I20260709 13:21:47.238507 11410 consensus_queue.cc:237] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:47.243173  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:47.244716 11399 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.245343 11399 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:47.248046 11399 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:47.256852  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:47.263518  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:47.264509  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:47.270994  4261 consensus_peers.cc:597] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:47.275496  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:47.278348  4261 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:47.282073 11385 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.282863 11385 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:47.283618  4038 catalog_manager.cc:5697] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 reported cstate change: term changed from 15 to 16, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to b81584b21ed144698954548303f1e507 (127.2.243.68). New cstate: current_term: 16 leader_uuid: "b81584b21ed144698954548303f1e507" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:47.296543  4893 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:47.296600  4295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "b81584b21ed144698954548303f1e507" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" is_pre_election: true
I20260709 13:21:47.299952  4295 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81584b21ed144698954548303f1e507 in term 10.
I20260709 13:21:47.297420 11385 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:47.313068  4893 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.314823  4893 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:47.316314 11385 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:47.280035  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:47.329917  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:47.332227  4261 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.334458  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:47.335672 11399 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:47.348524 11322 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.349175 11322 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:47.351727 11322 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:47.352128 11385 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.352785 11385 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:47.354977 11385 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:47.365773  4925 raft_consensus.cc:1275] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:21:47.368054 11399 consensus_queue.cc:1048] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:47.400987  4893 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:47.423599 11385 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.424271 11385 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:47.426442 11385 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:47.429581  4893 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.431593  4893 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:47.431033  4261 consensus_peers.cc:597] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.434427 11385 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:47.454928  4261 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:47.461350  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:47.462190  4261 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.473671  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:47.477794 11399 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:47.478199  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:47.479794  4261 consensus_peers.cc:597] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:47.482100  4295 raft_consensus.cc:1275] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:21:47.490705  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:47.490803 11385 consensus_queue.cc:1048] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:47.492702  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.499625  4893 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:47.498958  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.503509 11385 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:47.521761 11399 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.522768 11399 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:47.525695  4893 consensus_peers.cc:597] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:47.527839  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
W20260709 13:21:47.527132  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.528712  4925 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 16.
I20260709 13:21:47.531008  4259 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:47.532377 11400 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:47.532845 11400 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.532948 11399 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:47.533290 11400 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:47.559479  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.576501 11400 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:47.588982  4261 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.591109  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c7d9fa8715457fb7cd31f0ea47ae92" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507"
I20260709 13:21:47.591828  4925 raft_consensus.cc:3060] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:47.593576  4261 consensus_peers.cc:597] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.596081 11322 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.596848 11322 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:47.599186 11322 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:47.589896 11400 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Requested vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
I20260709 13:21:47.608462  4925 raft_consensus.cc:2468] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 17.
I20260709 13:21:47.619576  4259 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 
I20260709 13:21:47.624487 11400 raft_consensus.cc:2804] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:47.627574 11400 raft_consensus.cc:697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 LEADER]: Becoming Leader. State: Replica: 6f753b799f924bacb0a0f0f6e0068ee9, State: Running, Role: LEADER
I20260709 13:21:47.636914 11400 consensus_queue.cc:237] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:47.628777  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:47.651077  4261 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:47.669551  4261 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:47.670478  4261 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:47.670883  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:47.671679 11400 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:47.679960  4038 catalog_manager.cc:5697] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 reported cstate change: term changed from 16 to 17, leader changed from 34e6205f3c1d434193126fef20d73800 (127.2.243.66) to 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67). New cstate: current_term: 17 leader_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:47.685413  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:47.737449  4893 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:47.764428  4261 consensus_peers.cc:597] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:47.766966  4295 raft_consensus.cc:1275] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Refusing update from remote peer b81584b21ed144698954548303f1e507: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:21:47.769233 11410 consensus_queue.cc:1048] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:47.780102  4261 consensus_peers.cc:597] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:47.976713 11399 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:47.977519 11399 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:47.979940 11399 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:48.023250  4261 leader_election.cc:336] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:48.057956  4261 consensus_peers.cc:597] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:48.058652  4261 leader_election.cc:336] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:48.059118  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:48.072678 11399 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:48.073887 11399 raft_consensus.cc:493] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.074462 11399 raft_consensus.cc:515] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:48.080049 11399 leader_election.cc:290] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:48.088454  4925 raft_consensus.cc:1275] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Refusing update from remote peer 6f753b799f924bacb0a0f0f6e0068ee9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:21:48.090647 11400 consensus_queue.cc:1048] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:48.114185 11322 raft_consensus.cc:493] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.114814 11322 raft_consensus.cc:515] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:48.118362 11322 leader_election.cc:290] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:48.140635 11400 raft_consensus.cc:493] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.141510 11400 raft_consensus.cc:515] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:48.143953 11400 leader_election.cc:290] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:48.165940 11410 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.166730 11410 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:48.169543 11410 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:48.182508  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:48.189913  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:48.190495  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:48.205776  4261 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:48.208930 11410 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:48.213951  4261 leader_election.cc:336] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:48.214609  4261 leader_election.cc:304] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:48.215567 11428 raft_consensus.cc:2749] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:48.215768  4261 leader_election.cc:336] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:48.216504  4261 consensus_peers.cc:597] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:48.237150  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:48.243613  4261 leader_election.cc:336] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:48.244182  4261 leader_election.cc:304] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:48.245220  4261 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:48.245986 11400 raft_consensus.cc:2749] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:21:48.266150  4261 leader_election.cc:336] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:48.266702  4261 leader_election.cc:304] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:48.268258 11428 raft_consensus.cc:2749] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:48.380511 11428 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.381152 11428 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:48.402079 11428 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:48.444465  4261 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:48.451505  4261 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:48.452147  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:48.453274 11400 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:48.466822  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:48.515995 11400 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.516743 11400 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:48.519275 11400 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:48.524295 11410 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.525051 11410 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:48.527596 11410 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:48.534279  4261 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:48.535355  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:48.537813  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:48.538398  4893 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:48.539474 11410 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:48.536960  4261 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:48.540424  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:48.541065 11410 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.541285 11428 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:48.541661 11410 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:48.544612 11410 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:48.563292  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:48.564128  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:48.564610  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:48.565516 11410 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:48.637619  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:48.654367  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 584cfa5b7a8849d1bb573f5304d7cce9: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:48.681777  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:48.709055 11428 raft_consensus.cc:493] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:48.709880 11428 raft_consensus.cc:515] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:48.712585 11428 leader_election.cc:290] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:48.728860  4261 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:48.732626  4261 leader_election.cc:336] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:48.733332  4261 leader_election.cc:304] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:48.734236 11428 raft_consensus.cc:2749] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:48.756654  4261 consensus_peers.cc:597] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:48.757339  4261 consensus_peers.cc:597] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:48.776921  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:48.845496  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:48.902136  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.001662  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:49.026090 11400 raft_consensus.cc:493] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.026742 11400 raft_consensus.cc:515] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:49.030570 11428 raft_consensus.cc:493] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.031235 11428 raft_consensus.cc:515] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:49.037679 11400 leader_election.cc:290] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:49.039755 11428 leader_election.cc:290] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:49.054283 11428 raft_consensus.cc:493] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.054894 11428 raft_consensus.cc:515] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:49.056033 11400 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.056686 11400 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:49.059546 11428 leader_election.cc:290] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:49.060025 11400 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
W20260709 13:21:49.077469  4261 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:49.089439  4261 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:49.093932  4261 leader_election.cc:336] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:49.096583  4261 leader_election.cc:304] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.099252 11428 raft_consensus.cc:2749] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:49.100546  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.101226  4261 leader_election.cc:336] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:49.104519  4261 leader_election.cc:304] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.105399 11428 raft_consensus.cc:2749] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:49.113544 11410 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.115150 11410 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:49.114508 11431 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.116355 11431 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:49.119544 11431 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:49.125792  4261 consensus_peers.cc:597] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.126421  4261 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:49.126917  4261 leader_election.cc:336] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:49.130671 11410 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:49.132627 11400 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.133296 11400 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
W20260709 13:21:49.134780  4261 leader_election.cc:336] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:49.135257  4261 leader_election.cc:304] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.135524 11400 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:49.137373 11428 raft_consensus.cc:2749] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:49.138927  4261 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:49.140622  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.141436 11428 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:49.149343  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:49.150832  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:49.160192  4893 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.161444 11431 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:49.165499  4261 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:49.166445  4261 consensus_peers.cc:597] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.166445  4893 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:49.167801  4893 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:49.168289  4893 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.169314 11431 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:49.222435  4261 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:49.232901 11410 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.234760 11410 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:49.225070  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.241518 11432 raft_consensus.cc:2749] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:49.246491  4261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:36237, user_credentials={real_user=slave}} blocked reactor thread for 79466.8us
W20260709 13:21:49.287900  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:49.297783 11410 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:49.322134  4893 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.324148  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:49.332947  4893 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:49.346146  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:49.346869  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
W20260709 13:21:49.349259  4893 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:49.348191 11378 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:49.353318  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.358919  4893 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.373734  4261 consensus_peers.cc:597] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.374828  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.430990  4893 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.443383  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.454304  4261 consensus_peers.cc:597] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:49.458189 11437 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:49.459227 11437 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:49.468888  4925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf9cc060a440feab4ab0c62d18794f" candidate_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b81584b21ed144698954548303f1e507" is_pre_election: true
I20260709 13:21:49.470151  4925 raft_consensus.cc:2468] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f753b799f924bacb0a0f0f6e0068ee9 in term 10.
I20260709 13:21:49.472832 11437 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), b81584b21ed144698954548303f1e507 (127.2.243.68:35693)
W20260709 13:21:49.475723  4261 consensus_peers.cc:597] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.491433  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.492110  4261 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:49.495664  4261 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:49.496275  4261 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9, b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.497215 11437 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:49.505748  4261 consensus_peers.cc:597] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:49.516585  4261 consensus_peers.cc:597] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.546756  4261 consensus_peers.cc:597] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.561522  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.611711  4261 consensus_peers.cc:597] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.612452  4261 consensus_peers.cc:597] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.628755  4893 consensus_peers.cc:597] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:49.630589  4261 consensus_peers.cc:597] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.667327  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.669767  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:49.670276 11437 raft_consensus.cc:493] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
W20260709 13:21:49.670678  4261 consensus_peers.cc:597] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:49.671137 11437 raft_consensus.cc:515] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:49.673928 11437 leader_election.cc:290] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:49.687742  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.701171  4261 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:49.705160  4261 leader_election.cc:336] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:49.705852  4261 leader_election.cc:304] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:49.706820 11437 raft_consensus.cc:2749] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:49.708750  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.769944  4261 consensus_peers.cc:597] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.788256  4893 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.855046  4261 consensus_peers.cc:597] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.867651  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.880465  4261 consensus_peers.cc:597] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.905102  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:49.933157  4261 consensus_peers.cc:597] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:49.955477  3021 tablet_server.cc:196] TabletServer@127.2.243.66:0 shutdown complete.
W20260709 13:21:49.957468  4261 consensus_peers.cc:597] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.966219  4261 consensus_peers.cc:597] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.974478  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.003412  4261 consensus_peers.cc:597] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.027448  4261 consensus_peers.cc:597] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:50.035038  4261 consensus_peers.cc:597] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.036479  4261 consensus_peers.cc:597] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:50.102890 11437 raft_consensus.cc:493] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:50.103654 11437 raft_consensus.cc:515] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:50.106226 11437 leader_election.cc:290] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:50.128537  4261 leader_election.cc:336] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:50.129613  4261 leader_election.cc:336] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:50.130162  4261 leader_election.cc:304] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:50.131109 11437 raft_consensus.cc:2749] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:50.157949  4893 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:50.206779  4261 consensus_peers.cc:597] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:50.263531  4261 consensus_peers.cc:597] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:50.283092  3021 tablet_server.cc:179] TabletServer@127.2.243.67:0 shutting down...
W20260709 13:21:50.319964  4892 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.335101  4892 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.402029  4261 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111) [suppressed 695 similar messages]
W20260709 13:21:50.460289  4892 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.470745  4892 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.471587  4892 consensus_peers.cc:597] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.481753  4892 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.488765  4892 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.507180  4261 consensus_peers.cc:597] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:50.515168 11437 raft_consensus.cc:493] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:50.516052 11437 raft_consensus.cc:515] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:50.534902 11437 leader_election.cc:290] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:50.537978  4892 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.546089  4261 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:50.551865  4261 leader_election.cc:336] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:50.552690  4261 leader_election.cc:304] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:50.553347  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.553789 11437 raft_consensus.cc:2749] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:50.561162  3021 tablet_replica.cc:333] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.562975  3021 raft_consensus.cc:2243] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.570464  3021 raft_consensus.cc:2272] T 8fcd7e7f18b74faf9bbcd8060013bfa2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.574884  3021 tablet_replica.cc:333] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.579607  3021 raft_consensus.cc:2243] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.589596  3021 raft_consensus.cc:2272] T bb7d207ddadd4505a2b62ff61258cff1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.597213  3021 tablet_replica.cc:333] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.599949  3021 raft_consensus.cc:2243] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.604810  3021 raft_consensus.cc:2272] T d9ed971e9cd64f17bc8646a1d19e3622 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.619397  3021 tablet_replica.cc:333] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.624828  3021 raft_consensus.cc:2243] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:50.634939  4892 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.636974  3021 raft_consensus.cc:2272] T 40b291caa9a64e83948693294f96069d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.657085  3021 tablet_replica.cc:333] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.658886  3021 raft_consensus.cc:2243] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.663600  3021 raft_consensus.cc:2272] T 17b099e5e28a475fa86a6f1efaa21ed9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.668517  3021 tablet_replica.cc:333] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.685563  3021 raft_consensus.cc:2243] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:21:50.690939  4261 consensus_peers.cc:597] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:50.691547  3021 raft_consensus.cc:2272] T 57a7dac49b784166afd62631b44900c8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.699302 11440 raft_consensus.cc:493] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:50.701363 11440 raft_consensus.cc:515] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:50.706688 11440 leader_election.cc:290] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:50.733971  4892 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.735651  3021 tablet_replica.cc:333] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
W20260709 13:21:50.737507  4261 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:50.752619  3021 raft_consensus.cc:2243] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.755685  3021 raft_consensus.cc:2272] T a35e1cee8a15436dbfaf75dd67824aad P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.757257  4261 leader_election.cc:336] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:50.762177  4261 leader_election.cc:304] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:50.766161 11436 raft_consensus.cc:2749] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:50.768543  3021 tablet_replica.cc:333] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.770069  3021 raft_consensus.cc:2243] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.771802  3021 raft_consensus.cc:2272] T e2c23c7c663f4647955b43f85d642e1c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.778692 11437 raft_consensus.cc:493] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:50.779871 11437 raft_consensus.cc:515] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:50.780905  3021 tablet_replica.cc:333] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.782076  3021 raft_consensus.cc:2243] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.782577 11437 leader_election.cc:290] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237)
W20260709 13:21:50.796845  4261 consensus_peers.cc:597] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:50.800817  3021 raft_consensus.cc:2272] T f1a8ad10a3aa47109171ff50298ccf9b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.805624  3021 tablet_replica.cc:333] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.806890  3021 raft_consensus.cc:2243] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:50.819577  4261 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:50.821484  4261 leader_election.cc:336] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:50.808122  3021 raft_consensus.cc:2272] T d2e2dc5c77a5416995232da7a676ae73 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.832590  4261 leader_election.cc:304] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:50.834417 11436 raft_consensus.cc:2749] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:50.836802  3021 tablet_replica.cc:333] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.838250  3021 raft_consensus.cc:2243] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.840243  3021 raft_consensus.cc:2272] T fcc0e559b40a475ea99ac69d7dbea6c0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.844144  3021 tablet_replica.cc:333] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.861682  3021 raft_consensus.cc:2243] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.862830  3021 raft_consensus.cc:2272] T 537f9faaf59648debe160e6df5d91fcd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.866966  3021 tablet_replica.cc:333] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.868077  3021 raft_consensus.cc:2243] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.878518  3021 raft_consensus.cc:2272] T da0810d325774d7181018ff01e71333a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.882395  3021 tablet_replica.cc:333] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.887420  3021 raft_consensus.cc:2243] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.889274  3021 raft_consensus.cc:2272] T 002295ea4e164178a447d55ccde98422 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.897269  4892 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.904243  3021 tablet_replica.cc:333] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.907359  3021 raft_consensus.cc:2243] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.909787  3021 raft_consensus.cc:2272] T 95ca04a09529497898d86f573a0e1189 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.913144  3021 tablet_replica.cc:333] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.925124  3021 raft_consensus.cc:2243] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.926986  3021 raft_consensus.cc:2272] T 96704063be1347b0bf621569c72ae1fd P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.930683  3021 tablet_replica.cc:333] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.931941  3021 raft_consensus.cc:2243] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.933615  3021 raft_consensus.cc:2272] T bf26f731cd1d411a93da2187b3452b52 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.937816  3021 tablet_replica.cc:333] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.949297  3021 raft_consensus.cc:2243] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:21:50.949354  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:50.952891  3021 raft_consensus.cc:2272] T b9ebd7fa04d4401f96670bd2866c719c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.968693  3021 tablet_replica.cc:333] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.969846  3021 raft_consensus.cc:2243] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.971834  3021 raft_consensus.cc:2272] T c130eddd78204cee994818f0043bf88c P 6f753b799f924bacb0a0f0f6e0068ee9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.975967  3021 tablet_replica.cc:333] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.977240  3021 raft_consensus.cc:2243] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.979261  3021 raft_consensus.cc:2272] T e9d67bbe0103433095fb80de46cf624d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.983253  3021 tablet_replica.cc:333] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:50.993487  3021 raft_consensus.cc:2243] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.995431  3021 raft_consensus.cc:2272] T 4dd7c9d3d77844388d8c5138c924c640 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.999478  3021 tablet_replica.cc:333] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.012527  3021 raft_consensus.cc:2243] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.028946  3021 raft_consensus.cc:2272] T 729a3ec3cbd04254ac398836ae71b77d P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.032722  3021 tablet_replica.cc:333] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.033761  3021 raft_consensus.cc:2243] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.035387  3021 raft_consensus.cc:2272] T f776151073534d2e9012d8a291b66b5a P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.038931  3021 tablet_replica.cc:333] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.040035  3021 raft_consensus.cc:2243] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.064675  3021 raft_consensus.cc:2272] T ad5c2c5dc1b340968b54f2a9a970cfce P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.068738  3021 tablet_replica.cc:333] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.069806  3021 raft_consensus.cc:2243] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.070575  3021 raft_consensus.cc:2272] T 7522b19b153a491c9d822b8ffb2becc5 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.074301  3021 tablet_replica.cc:333] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.075332  3021 raft_consensus.cc:2243] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:51.102303  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:51.105773  3021 raft_consensus.cc:2272] T a767a88581024d12b14e9f965193d404 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.123622  3021 tablet_replica.cc:333] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.124745  3021 raft_consensus.cc:2243] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.126319  3021 raft_consensus.cc:2272] T c93b2eb873344f43936dabea6e173ea0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.134690 11441 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:51.135701  3021 tablet_replica.cc:333] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.135387 11441 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:51.136862  3021 raft_consensus.cc:2243] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.139878 11441 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:51.149685  3021 raft_consensus.cc:2272] T 151a7707aeab4292bf6804cdfbf0cf06 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.151556  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:51.152624  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:51.153115  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:51.153227  3021 tablet_replica.cc:333] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.154096 11441 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:51.154536  3021 raft_consensus.cc:2243] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.156438  3021 raft_consensus.cc:2272] T ccbf9cc060a440feab4ab0c62d18794f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.160940  3021 tablet_replica.cc:333] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.162480  3021 raft_consensus.cc:2243] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.164290  3021 raft_consensus.cc:2272] T 3e71d21bb0584872aaf6dcba10ac49fc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.183454  3021 tablet_replica.cc:333] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.184594  3021 raft_consensus.cc:2243] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.186143  3021 raft_consensus.cc:2272] T eff857a690104e20896367b8755773e0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.194387  3021 tablet_replica.cc:333] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.195504  3021 raft_consensus.cc:2243] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.196616  3021 raft_consensus.cc:2272] T ab416835542d4f11852821a8161b8f7b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.213383  3021 tablet_replica.cc:333] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.214395  3021 raft_consensus.cc:2243] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.215852  3021 raft_consensus.cc:2272] T 09ba8b2d18b04025b73da88c20e6dbe0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.219004  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:51.220112  3021 tablet_replica.cc:333] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.221468  3021 raft_consensus.cc:2243] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.222257  3021 raft_consensus.cc:2272] T e24b8745010349f4b91ac3fb893c50d0 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.225804  3021 tablet_replica.cc:333] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.226806  3021 raft_consensus.cc:2243] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.236655 11439 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:51.237939 11439 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:51.236763  3021 raft_consensus.cc:2272] T e6478d83fa954184a297fb7466378df1 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.248546  3021 tablet_replica.cc:333] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.249549  3021 raft_consensus.cc:2243] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.251021  3021 raft_consensus.cc:2272] T 27a95e60f9ae4eea85c4a330ff8078c7 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.252260  4893 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:51.263121  3021 tablet_replica.cc:333] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.264747  3021 raft_consensus.cc:2243] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.259963 11439 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:51.266212 11439 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:51.267268  3021 raft_consensus.cc:2272] T 5985d95b5ba74bed90f719c554bee460 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.271499  4892 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:51.266971 11439 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:51.275473 11439 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
I20260709 13:21:51.272156  4892 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:51.278064  4893 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:51.280988 11441 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:51.283092  3021 tablet_replica.cc:333] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.285677  3021 raft_consensus.cc:2243] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.289063  3021 raft_consensus.cc:2272] T 6091d765c73842c992d8c60523872ccc P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.297267  3021 tablet_replica.cc:333] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.301132  3021 raft_consensus.cc:2243] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.303244  3021 raft_consensus.cc:2272] T 584cfa5b7a8849d1bb573f5304d7cce9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.310740  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:51.325030  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:51.325518  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:51.326524 11441 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:51.352186  3021 tablet_replica.cc:333] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.355026  3021 raft_consensus.cc:2243] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.372018  3021 raft_consensus.cc:2272] T 38e2ffb00e35435085552a2adb73fcc2 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.375732  3021 tablet_replica.cc:333] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.381752  3021 raft_consensus.cc:2243] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.383198  3021 raft_consensus.cc:2272] T 7abf29f1bff94e6397d4a2561e35ef1b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.387115  3021 tablet_replica.cc:333] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.388275  3021 raft_consensus.cc:2243] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.389128  3021 raft_consensus.cc:2272] T fee6dae3af1842289de63342b7a950f9 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.395190 11441 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:51.396143 11441 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:51.399590 11441 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:51.406126  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:51.409296  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:51.409957  4893 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:51.410632  3021 tablet_replica.cc:333] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.411399 11441 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:51.413234  3021 raft_consensus.cc:2243] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.414966  3021 raft_consensus.cc:2272] T 70df96ad70f0416db400b7395b0d7b9e P 6f753b799f924bacb0a0f0f6e0068ee9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.419538  3021 tablet_replica.cc:333] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.420658  3021 raft_consensus.cc:2243] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.422683  3021 raft_consensus.cc:2272] T f61c18f5030a4980bd0f16ae2690b843 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.426553  3021 tablet_replica.cc:333] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.427603  3021 raft_consensus.cc:2243] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.429090  3021 raft_consensus.cc:2272] T a94558f1f2d64f6b8e16501cb7d48d78 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.428936 11436 raft_consensus.cc:493] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:51.431604 11436 raft_consensus.cc:515] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } }
I20260709 13:21:51.435690 11436 leader_election.cc:290] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:51.436825  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:51.439170  3021 tablet_replica.cc:333] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.440728  3021 raft_consensus.cc:2243] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.448532  3021 raft_consensus.cc:2272] T 033774cd1e264e69977f9f6f2e5a42e8 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.452162  3021 tablet_replica.cc:333] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.453163  3021 raft_consensus.cc:2243] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.453956  3021 raft_consensus.cc:2272] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.460558  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:51.461995  4261 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:51.463366  4261 leader_election.cc:336] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:51.463892  4261 leader_election.cc:304] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f753b799f924bacb0a0f0f6e0068ee9; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:51.465091  3021 tablet_replica.cc:333] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.466522  3021 raft_consensus.cc:2243] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.473529  3021 raft_consensus.cc:2272] T 42018491ecaa43a29d99307d7ccd824b P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.465090  4261 raft_consensus.cc:2686] T 434e24168b204a82b4cafcc2cba44c46 P 6f753b799f924bacb0a0f0f6e0068ee9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:51.479779  3021 tablet_replica.cc:333] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.480973  3021 raft_consensus.cc:2243] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.482776  3021 raft_consensus.cc:2272] T ee822f7cf89d49cb90b5fa2997ef4f4f P 6f753b799f924bacb0a0f0f6e0068ee9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.486984  3021 tablet_replica.cc:333] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9: stopping tablet replica
I20260709 13:21:51.488085  3021 raft_consensus.cc:2243] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.505568  3021 raft_consensus.cc:2272] T 78c7d9fa8715457fb7cd31f0ea47ae92 P 6f753b799f924bacb0a0f0f6e0068ee9 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.602247  4893 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:51.625540 11441 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:51.629447 11441 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:51.640987 11441 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:51.642436  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:51.653949  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:51.654578  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:51.655395 11441 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:51.687440  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:51.710795 11441 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:51.711609 11441 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:51.713929 11441 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:51.721499  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:51.722296  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:51.722913  4893 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:51.724184 11441 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:51.780823  4893 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.795363  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:51.823817  4893 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:51.974179 11441 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:51.974740 11441 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:51.977797  4893 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:51.983891  4892 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:51.986310 11441 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:51.989252  4893 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:51.989851  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:51.991143 11441 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:52.043896  4893 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:52.183765 11441 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:52.184453 11441 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:52.186664 11441 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:52.195868  4893 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:52.201417  4893 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:52.203819  4893 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:52.213235 11445 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:52.230186  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:52.256405 11446 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:52.257009 11446 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:52.259262 11446 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:52.264959  4892 leader_election.cc:336] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:52.266031 11446 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:52.266875 11446 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:52.269167 11446 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:52.276985  4892 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:52.278805  4893 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:52.281808  4893 leader_election.cc:336] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:52.282311  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:52.292846 11446 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:21:52.300014  4893 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:52.300611  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:52.301410 11446 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:52.302414 11446 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:52.303005 11446 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:52.311184  4892 leader_election.cc:336] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:52.312191 11446 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:52.317399  4893 consensus_peers.cc:597] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:52.328487  4893 leader_election.cc:336] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:52.329056  4893 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:52.329839 11446 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:52.330974  4893 leader_election.cc:336] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:52.405138 11446 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:52.405761 11446 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:52.418622  4893 leader_election.cc:336] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:52.419497  4892 leader_election.cc:336] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:52.419926  4892 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:52.420693 11446 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:52.421342 11441 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:52.436643  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:52.448171 11446 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:52.448868 11446 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:52.451289 11446 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:52.468595  4892 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:52.469985  4893 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:52.471143  4893 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:52.471988 11445 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:52.495741 11445 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:52.496549 11445 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:52.506574  4893 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:52.515477  4892 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:52.515954  4892 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:52.517000 11446 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:52.517787 11445 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:52.540375  4893 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:52.633001 11445 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:52.633589 11445 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:52.635875 11445 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:52.646055  4893 leader_election.cc:336] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:52.648648  4892 leader_election.cc:336] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:52.649125  4892 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:52.649912 11446 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:52.658870  4892 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.757589  4892 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.792778  3021 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4317)
W20260709 13:21:52.820695  4892 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:52.875768 11446 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:52.876408 11446 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:52.878561 11446 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:52.888688  4892 leader_election.cc:336] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:52.889806  4893 leader_election.cc:336] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:52.890312  4893 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:52.896418 11446 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:52.991928  4892 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.018172  4892 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.033187  4892 consensus_peers.cc:597] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.036375  4892 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.087182  4892 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.093076  4892 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.113588  4892 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.255932  4892 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:53.318774 11446 raft_consensus.cc:493] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:53.319392 11446 raft_consensus.cc:515] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:53.328962  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:53.330302 11446 leader_election.cc:290] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:53.335776  4893 leader_election.cc:336] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:53.336329  4893 leader_election.cc:304] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:53.337631 11446 raft_consensus.cc:2749] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:53.410039  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:53.621902  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:53.674646  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:53.726790 11445 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:53.729055 11445 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:53.731513 11445 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:53.732148  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:53.779675  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:53.787583  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:53.789959  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:53.790838 11445 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:53.793272  3021 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 4317)
W20260709 13:21:53.829682  4893 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:54.121908 11445 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:54.125970 11445 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:54.128588 11445 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:54.138437  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:54.144408  4892 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:54.163149  4893 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:54.167169  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:54.169610 11445 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:54.186007 11445 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:54.186725 11445 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:54.192809  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:54.190212 11445 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:54.198568 11445 raft_consensus.cc:493] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:54.199216 11445 raft_consensus.cc:515] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:54.204787 11445 leader_election.cc:290] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:54.208631  4892 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:54.217310  4893 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:54.217912  4893 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:54.219038 11445 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:54.234656  4893 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:54.235844  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:54.236729  4893 leader_election.cc:336] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:54.237237  4893 leader_election.cc:304] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:54.238152 11446 raft_consensus.cc:2749] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:54.243573 11446 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:54.244227 11446 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:54.246850 11446 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:54.254956  4892 leader_election.cc:336] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:54.263653  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:54.269083  4893 leader_election.cc:336] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:54.269752  4893 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:54.270648 11446 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:21:54.271847  4893 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:54.282992 11446 raft_consensus.cc:493] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:54.283666 11446 raft_consensus.cc:515] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:54.292330  4892 leader_election.cc:336] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:54.293326 11446 leader_election.cc:290] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:54.300626  4893 leader_election.cc:336] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:54.301290  4893 leader_election.cc:304] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:54.302222 11446 raft_consensus.cc:2749] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:54.360018 11446 raft_consensus.cc:493] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:54.360653 11446 raft_consensus.cc:515] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } attrs { replace: true } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:54.369007  4892 leader_election.cc:336] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:54.369892 11446 leader_election.cc:290] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:54.375277  4893 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:54.381068  4893 leader_election.cc:336] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:54.381608  4893 leader_election.cc:304] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:54.382314 11446 raft_consensus.cc:2749] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:54.383189  4893 leader_election.cc:336] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:54.433879 11446 raft_consensus.cc:493] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:54.434487 11446 raft_consensus.cc:515] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:54.436647 11446 leader_election.cc:290] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:54.441825  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:54.443508  4893 leader_election.cc:336] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:54.443974  4893 leader_election.cc:304] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:54.445806 11446 raft_consensus.cc:2749] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:54.487236 11446 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:54.487789 11446 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:54.489900 11446 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:54.494760  4892 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:54.499967  4893 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:54.500455  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:54.501941 11446 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:54.553839 11446 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:54.554472 11446 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:54.556759 11446 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:54.561708  4892 leader_election.cc:336] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:54.567080  4893 leader_election.cc:336] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:54.567638  4893 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:54.568624 11446 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:54.578260  4893 consensus_peers.cc:597] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.645511  4893 consensus_peers.cc:597] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:54.646464 11446 raft_consensus.cc:493] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:54.647061 11446 raft_consensus.cc:515] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:54.653190 11446 leader_election.cc:290] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:54.654925  4892 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:54.678011  4893 consensus_peers.cc:597] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:54.698431  4893 leader_election.cc:336] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:54.699041  4893 leader_election.cc:304] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
W20260709 13:21:54.701201  4893 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:54.701679 11450 raft_consensus.cc:2749] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:54.703256 11446 raft_consensus.cc:493] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:54.703801 11446 raft_consensus.cc:515] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:54.706187 11446 leader_election.cc:290] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:54.712276  4892 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:54.732609  4893 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.739338  4893 leader_election.cc:336] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:54.739929  4893 leader_election.cc:304] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:54.740790 11450 raft_consensus.cc:2749] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:54.793753  3021 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 4317)
W20260709 13:21:54.931667  4076 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5660 after lost signal to thread 3024
W20260709 13:21:54.932818  4076 debug-util.cc:398] Leaking SignalData structure 0x7b080009ba80 after lost signal to thread 4079
W20260709 13:21:54.934082  4076 debug-util.cc:398] Leaking SignalData structure 0x7b08003b53c0 after lost signal to thread 4953
W20260709 13:21:55.029181  4892 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.049345  4892 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:55.122248 11445 raft_consensus.cc:493] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:55.122833 11445 raft_consensus.cc:515] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:55.124989 11445 leader_election.cc:290] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:55.132795  4893 leader_election.cc:336] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:55.139288  4892 leader_election.cc:336] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:55.139876  4892 leader_election.cc:304] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:55.140715 11445 raft_consensus.cc:2749] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:55.146507  4893 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:55.146683  4892 consensus_peers.cc:597] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.163086  4893 consensus_peers.cc:597] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:55.219844  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ee822f7cf89d49cb90b5fa2997ef4f4f: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:55.438159  4893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111) [suppressed 424 similar messages]
I20260709 13:21:55.453193 11445 raft_consensus.cc:493] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:55.453855 11445 raft_consensus.cc:515] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:55.456239 11445 leader_election.cc:290] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:55.473519  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:55.475397  4893 leader_election.cc:336] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:55.475904  4893 leader_election.cc:304] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:55.477037 11445 raft_consensus.cc:2749] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:55.549109  4892 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.562500  4892 consensus_peers.cc:597] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:55.595911 11445 raft_consensus.cc:493] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:55.596522 11445 raft_consensus.cc:515] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:55.598860 11445 leader_election.cc:290] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:55.622350  4892 consensus_peers.cc:597] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.626327  4893 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:55.629895  4893 leader_election.cc:336] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:55.631734  4893 leader_election.cc:304] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:55.632634 11446 raft_consensus.cc:2749] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:55.693574  4892 consensus_peers.cc:597] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.870012  4892 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.892210  4892 consensus_peers.cc:597] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.942235  4893 consensus_peers.cc:597] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:55.964828  4892 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.967689  4892 consensus_peers.cc:597] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 -> Peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Couldn't send request to peer 6f753b799f924bacb0a0f0f6e0068ee9. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:56.050541 11445 raft_consensus.cc:493] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:56.051163 11445 raft_consensus.cc:515] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:56.053359 11445 leader_election.cc:290] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005)
W20260709 13:21:56.062273  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:56.064464  4893 leader_election.cc:336] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:56.064985  4893 leader_election.cc:304] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 34e6205f3c1d434193126fef20d73800
I20260709 13:21:56.066180 11445 raft_consensus.cc:2749] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:56.253379 11445 raft_consensus.cc:493] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:56.253934 11445 raft_consensus.cc:515] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:56.256078 11445 leader_election.cc:290] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:56.261312  4892 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:56.267795  4893 leader_election.cc:336] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:56.276409  3021 tablet_server.cc:196] TabletServer@127.2.243.67:0 shutdown complete.
I20260709 13:21:56.268306  4893 leader_election.cc:304] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:56.280565 11445 raft_consensus.cc:2749] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:21:56.281775 11445 raft_consensus.cc:493] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:56.282230 11445 raft_consensus.cc:515] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:56.284559 11445 leader_election.cc:290] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:56.288731  4892 leader_election.cc:336] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:56.289481  4893 leader_election.cc:336] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:56.289829  4893 leader_election.cc:304] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:56.290388 11445 raft_consensus.cc:2749] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:56.316483 11445 raft_consensus.cc:493] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34e6205f3c1d434193126fef20d73800)
I20260709 13:21:56.317173 11445 raft_consensus.cc:515] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } attrs { replace: true } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
W20260709 13:21:56.328972  4893 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:21:56.332269  4893 consensus_peers.cc:597] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:56.347436 11445 leader_election.cc:290] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:56.366240  4892 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:56.366807  4892 leader_election.cc:304] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:56.368839 11454 raft_consensus.cc:2749] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:56.370554  4893 consensus_peers.cc:597] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:56.371335  4893 consensus_peers.cc:597] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 -> Peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Couldn't send request to peer 34e6205f3c1d434193126fef20d73800. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.371791  4893 leader_election.cc:336] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
W20260709 13:21:56.407373  4893 consensus_peers.cc:597] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 -> Peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Couldn't send request to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:56.427405 11445 raft_consensus.cc:493] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:56.428126 11445 raft_consensus.cc:515] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34e6205f3c1d434193126fef20d73800" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 45005 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:56.430881 11445 leader_election.cc:290] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
W20260709 13:21:56.437479  4892 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
W20260709 13:21:56.447381  4893 leader_election.cc:336] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34e6205f3c1d434193126fef20d73800 (127.2.243.66:45005): Network error: Client connection negotiation failed: client connection to 127.2.243.66:45005: connect: Connection refused (error 111)
I20260709 13:21:56.447978  4893 leader_election.cc:304] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 34e6205f3c1d434193126fef20d73800, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:56.448838 11454 raft_consensus.cc:2749] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:56.450014  3021 tablet_server.cc:179] TabletServer@127.2.243.68:0 shutting down...
I20260709 13:21:56.517443  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:56.518399  3021 tablet_replica.cc:333] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.519464  3021 raft_consensus.cc:2243] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.520658  3021 raft_consensus.cc:2272] T 95ca04a09529497898d86f573a0e1189 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.523694  3021 tablet_replica.cc:333] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.524501  3021 raft_consensus.cc:2243] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.525974  3021 raft_consensus.cc:2272] T 584cfa5b7a8849d1bb573f5304d7cce9 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.529457  3021 tablet_replica.cc:333] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.530138 11454 raft_consensus.cc:493] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f753b799f924bacb0a0f0f6e0068ee9)
I20260709 13:21:56.530411  3021 raft_consensus.cc:2243] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.530732 11454 raft_consensus.cc:515] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "32ebd3bc4af5446f94d9f3ac7c8cf53c" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36237 } } peers { permanent_uuid: "6f753b799f924bacb0a0f0f6e0068ee9" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40585 } } peers { permanent_uuid: "b81584b21ed144698954548303f1e507" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 35693 } attrs { promote: false } }
I20260709 13:21:56.531345  3021 raft_consensus.cc:2272] T ccbf9cc060a440feab4ab0c62d18794f P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.534677  3021 tablet_replica.cc:333] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.535571  3021 raft_consensus.cc:2243] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.536510  3021 raft_consensus.cc:2272] T ee822f7cf89d49cb90b5fa2997ef4f4f P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:56.537151  4893 leader_election.cc:336] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:56.538539 11454 leader_election.cc:290] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237), 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585)
I20260709 13:21:56.539685  3021 tablet_replica.cc:333] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.540488  3021 raft_consensus.cc:2243] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.541646  3021 raft_consensus.cc:2272] T 96704063be1347b0bf621569c72ae1fd P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:56.543792  4892 leader_election.cc:336] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f753b799f924bacb0a0f0f6e0068ee9 (127.2.243.67:40585): Network error: Client connection negotiation failed: client connection to 127.2.243.67:40585: connect: Connection refused (error 111)
I20260709 13:21:56.544479  3021 tablet_replica.cc:333] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.544502  4892 leader_election.cc:304] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81584b21ed144698954548303f1e507; no voters: 32ebd3bc4af5446f94d9f3ac7c8cf53c, 6f753b799f924bacb0a0f0f6e0068ee9
I20260709 13:21:56.545449 11454 raft_consensus.cc:2749] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:21:56.545513  3021 raft_consensus.cc:2243] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.546478  3021 raft_consensus.cc:2272] T 033774cd1e264e69977f9f6f2e5a42e8 P b81584b21ed144698954548303f1e507 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.549218  3021 tablet_replica.cc:333] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.549880  3021 raft_consensus.cc:2243] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.550346  3021 raft_consensus.cc:2272] T b9ebd7fa04d4401f96670bd2866c719c P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.553035  3021 tablet_replica.cc:333] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.553572  3021 raft_consensus.cc:2243] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.554503  3021 raft_consensus.cc:2272] T d9ed971e9cd64f17bc8646a1d19e3622 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.556972  3021 tablet_replica.cc:333] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.557755  3021 raft_consensus.cc:2243] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.558821  3021 raft_consensus.cc:2272] T a767a88581024d12b14e9f965193d404 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.561766  3021 tablet_replica.cc:333] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.562623  3021 raft_consensus.cc:2243] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.563566  3021 raft_consensus.cc:2272] T 78c7d9fa8715457fb7cd31f0ea47ae92 P b81584b21ed144698954548303f1e507 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.567010  3021 tablet_replica.cc:333] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.567849  3021 raft_consensus.cc:2243] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.568923  3021 raft_consensus.cc:2272] T 4661232a8b934fa0b9135bf4650bfd02 P b81584b21ed144698954548303f1e507 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.571220  3021 tablet_replica.cc:333] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.571761  3021 raft_consensus.cc:2243] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.572722  3021 raft_consensus.cc:2272] T a35e1cee8a15436dbfaf75dd67824aad P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.575419  3021 tablet_replica.cc:333] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.576191  3021 raft_consensus.cc:2243] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.576836  3021 raft_consensus.cc:2272] T fcc0e559b40a475ea99ac69d7dbea6c0 P b81584b21ed144698954548303f1e507 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.579536  3021 tablet_replica.cc:333] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.580086  3021 raft_consensus.cc:2243] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.580950  3021 raft_consensus.cc:2272] T ab416835542d4f11852821a8161b8f7b P b81584b21ed144698954548303f1e507 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.583366  3021 tablet_replica.cc:333] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.583925  3021 raft_consensus.cc:2243] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.584626  3021 raft_consensus.cc:2272] T 151524a8517e4b8ebc7308777c98105e P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.586815  3021 tablet_replica.cc:333] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.587350  3021 raft_consensus.cc:2243] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.588200  3021 raft_consensus.cc:2272] T 0334f31959bc48878664996813e359b4 P b81584b21ed144698954548303f1e507 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.590175  3021 tablet_replica.cc:333] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.590914  3021 raft_consensus.cc:2243] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.591511  3021 raft_consensus.cc:2272] T 57a7dac49b784166afd62631b44900c8 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.594353  3021 tablet_replica.cc:333] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.595146  3021 raft_consensus.cc:2243] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.596190  3021 raft_consensus.cc:2272] T 002295ea4e164178a447d55ccde98422 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.598237  3021 tablet_replica.cc:333] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.598747  3021 raft_consensus.cc:2243] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.599249  3021 raft_consensus.cc:2272] T e6b9a320ff854b5998471937010702d5 P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.601248  3021 tablet_replica.cc:333] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.601763  3021 raft_consensus.cc:2243] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.602659  3021 raft_consensus.cc:2272] T 1270a058111c4161ba865afa3630bfb7 P b81584b21ed144698954548303f1e507 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.604874  3021 tablet_replica.cc:333] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.605370  3021 raft_consensus.cc:2243] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.605916  3021 raft_consensus.cc:2272] T 729a3ec3cbd04254ac398836ae71b77d P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.607844  3021 tablet_replica.cc:333] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.608382  3021 raft_consensus.cc:2243] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.609391  3021 raft_consensus.cc:2272] T 40b291caa9a64e83948693294f96069d P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.611816  3021 tablet_replica.cc:333] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.612316  3021 raft_consensus.cc:2243] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.613214  3021 raft_consensus.cc:2272] T 7522b19b153a491c9d822b8ffb2becc5 P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.615417  3021 tablet_replica.cc:333] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.615945  3021 raft_consensus.cc:2243] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.616468  3021 raft_consensus.cc:2272] T c130eddd78204cee994818f0043bf88c P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.618534  3021 tablet_replica.cc:333] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.619055  3021 raft_consensus.cc:2243] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.619851  3021 raft_consensus.cc:2272] T 11a1f1fbec3b44838ed91074017003db P b81584b21ed144698954548303f1e507 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.622354  3021 tablet_replica.cc:333] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.622972  3021 raft_consensus.cc:2243] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.623617  3021 raft_consensus.cc:2272] T 9e7cd0a583da4bb18010d5a62595ea88 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.626091  3021 tablet_replica.cc:333] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.626619  3021 raft_consensus.cc:2243] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.627425  3021 raft_consensus.cc:2272] T 527025007d0641e3a50bfc3a9d2e5b80 P b81584b21ed144698954548303f1e507 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.629494  3021 tablet_replica.cc:333] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.630048  3021 raft_consensus.cc:2243] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.630523  3021 raft_consensus.cc:2272] T 10d1753ccc1e4c2d98ff3195cd6bb590 P b81584b21ed144698954548303f1e507 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.632915  3021 tablet_replica.cc:333] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.633378  3021 raft_consensus.cc:2243] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.634279  3021 raft_consensus.cc:2272] T 537f9faaf59648debe160e6df5d91fcd P b81584b21ed144698954548303f1e507 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.636442  3021 tablet_replica.cc:333] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507: stopping tablet replica
I20260709 13:21:56.636874  3021 raft_consensus.cc:2243] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.637611  3021 raft_consensus.cc:2272] T e9d67bbe0103433095fb80de46cf624d P b81584b21ed144698954548303f1e507 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:56.860853  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 584cfa5b7a8849d1bb573f5304d7cce9: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:21:56.919996  3021 tablet_server.cc:196] TabletServer@127.2.243.68:0 shutdown complete.
I20260709 13:21:56.995046  3021 master.cc:562] Master@127.2.243.126:38007 shutting down...
W20260709 13:21:57.042711  4093 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:21:57.043009  4093 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:57.043291  4093 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:22:11.638794  4031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111) [suppressed 82 similar messages]
W20260709 13:22:11.644263  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ee822f7cf89d49cb90b5fa2997ef4f4f: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
W20260709 13:22:13.286636  4031 catalog_manager.cc:4755] TS 32ebd3bc4af5446f94d9f3ac7c8cf53c (127.2.243.65:36237): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 584cfa5b7a8849d1bb573f5304d7cce9: Network error: Client connection negotiation failed: client connection to 127.2.243.65:36237: connect: Connection refused (error 111)
I20260709 13:22:14.056838  3021 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.057945  3021 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.058313  3021 tablet_replica.cc:333] T 00000000000000000000000000000000 P bc702ba481ed4ff7b99697ca2b44c086: stopping tablet replica
I20260709 13:22:14.290498  3021 master.cc:584] Master@127.2.243.126:38007 shutdown complete.
I20260709 13:22:14.351557  3021 test_util.cc:182] -----------------------------------------------
I20260709 13:22:14.351873  3021 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603048513324-3021-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (260669 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:22:14.356499  3021 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.243.126:42969
I20260709 13:22:14.357831  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:14.364636 11464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.364622 11463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.365732 11466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:14.367728  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:14.372741  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:14.373019  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:14.373195  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603334373175 us; error 0 us; skew 500 ppm
I20260709 13:22:14.373805  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:14.376823  3021 webserver.cc:533] Webserver started at http://127.2.243.126:35945/ using document root <none> and password file <none>
I20260709 13:22:14.377413  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:14.377622  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:14.377956  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:14.379465  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/master-0-root/instance:
uuid: "8651d67893c54c26985e84a11f067948"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:14.385318  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:22:14.389875 11471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.390965  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:14.391381  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/master-0-root
uuid: "8651d67893c54c26985e84a11f067948"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:14.391835  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:14.409832  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:14.411396  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:14.464828  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.126:42969
I20260709 13:22:14.464983 11522 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.126:42969 every 8 connection(s)
I20260709 13:22:14.469967 11523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.486433 11523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948: Bootstrap starting.
I20260709 13:22:14.492945 11523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.498625 11523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948: No bootstrap required, opened a new log
I20260709 13:22:14.501451 11523 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8651d67893c54c26985e84a11f067948" member_type: VOTER }
I20260709 13:22:14.502099 11523 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.502347 11523 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8651d67893c54c26985e84a11f067948, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.503175 11523 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8651d67893c54c26985e84a11f067948" member_type: VOTER }
I20260709 13:22:14.503806 11523 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:14.504127 11523 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:14.504477 11523 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.510577 11523 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8651d67893c54c26985e84a11f067948" member_type: VOTER }
I20260709 13:22:14.511307 11523 leader_election.cc:304] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8651d67893c54c26985e84a11f067948; no voters: 
I20260709 13:22:14.512861 11523 leader_election.cc:290] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:14.513319 11526 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.515235 11526 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 1 LEADER]: Becoming Leader. State: Replica: 8651d67893c54c26985e84a11f067948, State: Running, Role: LEADER
I20260709 13:22:14.516103 11526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8651d67893c54c26985e84a11f067948" member_type: VOTER }
I20260709 13:22:14.516269 11523 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:14.526327 11528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8651d67893c54c26985e84a11f067948. Latest consensus state: current_term: 1 leader_uuid: "8651d67893c54c26985e84a11f067948" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8651d67893c54c26985e84a11f067948" member_type: VOTER } }
I20260709 13:22:14.527446 11528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:14.529518 11527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8651d67893c54c26985e84a11f067948" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8651d67893c54c26985e84a11f067948" member_type: VOTER } }
I20260709 13:22:14.530666 11527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:14.533901 11534 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:14.541395 11534 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:14.543634  3021 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:14.553850 11534 catalog_manager.cc:1383] Generated new cluster ID: 6037f1109f5a4781a6f6ded6abfeaa9d
I20260709 13:22:14.554248 11534 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:14.576023 11534 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:14.577637 11534 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:14.603555 11534 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948: Generated new TSK 0
I20260709 13:22:14.604318 11534 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:14.610922  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:14.618600 11544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.620070 11545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.623176 11547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:14.623567  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:14.626623  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:14.626935  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:14.627133  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603334627097 us; error 0 us; skew 500 ppm
I20260709 13:22:14.627779  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:14.630805  3021 webserver.cc:533] Webserver started at http://127.2.243.65:43987/ using document root <none> and password file <none>
I20260709 13:22:14.631388  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:14.631616  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:14.631933  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:14.633637  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/instance:
uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:14.639201  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:14.643445 11552 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.644565  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:14.644997  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:14.645494  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:14.660694  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:14.662432  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:14.664539  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:14.667590  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:14.667812  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.668041  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:14.668401  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:22:14.726399  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:42405
I20260709 13:22:14.726538 11614 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:42405 every 8 connection(s)
I20260709 13:22:14.734495  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:14.744396 11619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.746922 11620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.751314 11622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:14.752296 11615 heartbeater.cc:344] Connected to a master server at 127.2.243.126:42969
I20260709 13:22:14.752983 11615 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:14.754132 11615 heartbeater.cc:507] Master 127.2.243.126:42969 requested a full tablet report, sending...
I20260709 13:22:14.754316  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:14.757756 11488 ts_manager.cc:194] Registered new tserver with Master: 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:14.758308  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:14.758646  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:14.758863  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603334758818 us; error 0 us; skew 500 ppm
I20260709 13:22:14.759626  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:14.760048 11488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57918
I20260709 13:22:14.762939  3021 webserver.cc:533] Webserver started at http://127.2.243.66:41695/ using document root <none> and password file <none>
I20260709 13:22:14.763545  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:14.763773  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:14.764053  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:14.765429  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/instance:
uuid: "4b102b83096e4830a35a9006a2a2a0f0"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:14.770656  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:14.775449 11627 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.776499  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:14.776906  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-1-root
uuid: "4b102b83096e4830a35a9006a2a2a0f0"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:14.777276  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:14.818653  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:14.820327  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:14.822276  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:14.825171  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:14.825448  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.825743  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:14.825940  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.887825  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.66:40717
I20260709 13:22:14.888039 11689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.66:40717 every 8 connection(s)
I20260709 13:22:14.893950  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:14.903750 11693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.905869 11694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:14.908088  3021 server_base.cc:1061] running on GCE node
W20260709 13:22:14.910089 11696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:14.910916 11690 heartbeater.cc:344] Connected to a master server at 127.2.243.126:42969
I20260709 13:22:14.911386 11690 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:14.911620  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:14.911940  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:14.912173  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603334912152 us; error 0 us; skew 500 ppm
I20260709 13:22:14.913008  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:14.912899 11690 heartbeater.cc:507] Master 127.2.243.126:42969 requested a full tablet report, sending...
I20260709 13:22:14.916987  3021 webserver.cc:533] Webserver started at http://127.2.243.67:41287/ using document root <none> and password file <none>
I20260709 13:22:14.917457 11488 ts_manager.cc:194] Registered new tserver with Master: 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:14.917680  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:14.918118  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:14.918452  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:14.919777 11488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57926
I20260709 13:22:14.919989  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/instance:
uuid: "d59c3f822e674346af71ca9a5d899c2e"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:14.926366  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:14.931604 11701 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.932704  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:14.933109  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-2-root
uuid: "d59c3f822e674346af71ca9a5d899c2e"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:14.933467  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:14.979616  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:14.981617  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:14.984493  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:14.987402  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:14.987709  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.987991  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:14.988179  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.044842  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.67:42051
I20260709 13:22:15.044956 11763 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.67:42051 every 8 connection(s)
I20260709 13:22:15.050948  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:15.060039 11767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.061328 11768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.065194 11770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.066747  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:15.067798  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:15.067843 11764 heartbeater.cc:344] Connected to a master server at 127.2.243.126:42969
W20260709 13:22:15.068095  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:15.068418 11764 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:15.068426  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603335068405 us; error 0 us; skew 500 ppm
I20260709 13:22:15.069453  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:15.069535 11764 heartbeater.cc:507] Master 127.2.243.126:42969 requested a full tablet report, sending...
I20260709 13:22:15.072198 11488 ts_manager.cc:194] Registered new tserver with Master: d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:15.073084  3021 webserver.cc:533] Webserver started at http://127.2.243.68:37287/ using document root <none> and password file <none>
I20260709 13:22:15.074097  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:15.074421  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:15.074836  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:15.077142  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-3-root/instance:
uuid: "01c914cf532f4dc19c1bab3514524ac2"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-ftjc"
I20260709 13:22:15.077847 11488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57940
I20260709 13:22:15.085647  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:15.090982 11775 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.092182  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:15.092586  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-3-root
uuid: "01c914cf532f4dc19c1bab3514524ac2"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-ftjc"
I20260709 13:22:15.093029  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:15.108557  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:15.110301  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:15.111917  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:15.114626  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:15.114945  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.115231  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:15.115434  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.174870  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.68:39869
I20260709 13:22:15.175060 11837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.68:39869 every 8 connection(s)
I20260709 13:22:15.193398 11838 heartbeater.cc:344] Connected to a master server at 127.2.243.126:42969
I20260709 13:22:15.194067 11838 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:15.195210 11838 heartbeater.cc:507] Master 127.2.243.126:42969 requested a full tablet report, sending...
I20260709 13:22:15.197808 11488 ts_manager.cc:194] Registered new tserver with Master: 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:15.198293  3021 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.019633465s
I20260709 13:22:15.199568 11488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57950
I20260709 13:22:15.235488 11488 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57962:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:22:15.528630 11580 tablet_service.cc:1511] Processing CreateTablet for tablet 11aa6af0390c4e07bf2b362d5bdb078d (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:15.530702 11580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11aa6af0390c4e07bf2b362d5bdb078d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.533183 11579 tablet_service.cc:1511] Processing CreateTablet for tablet 458610efe1f94a709b0a77f938cc539b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:15.534097 11729 tablet_service.cc:1511] Processing CreateTablet for tablet 11aa6af0390c4e07bf2b362d5bdb078d (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:15.535168 11579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458610efe1f94a709b0a77f938cc539b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.536010 11729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11aa6af0390c4e07bf2b362d5bdb078d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.537312 11653 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2e77a7d8e74543bab76ac11418f6d3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:15.537904 11728 tablet_service.cc:1511] Processing CreateTablet for tablet b9f32f35d73c4f83a13beccdbaac3a81 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
W20260709 13:22:15.539227 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:15.539739 11578 tablet_service.cc:1511] Processing CreateTablet for tablet b9f32f35d73c4f83a13beccdbaac3a81 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:22:15.552680 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2e77a7d8e74543bab76ac11418f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.553808 11578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f32f35d73c4f83a13beccdbaac3a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.540356 11727 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2e77a7d8e74543bab76ac11418f6d3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:15.542270 11652 tablet_service.cc:1511] Processing CreateTablet for tablet 95b8cc1b52ce4b45866ae912c00828e5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:15.542630 11654 tablet_service.cc:1511] Processing CreateTablet for tablet 458610efe1f94a709b0a77f938cc539b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:15.545214 11655 tablet_service.cc:1511] Processing CreateTablet for tablet 11aa6af0390c4e07bf2b362d5bdb078d (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:15.547387 11577 tablet_service.cc:1511] Processing CreateTablet for tablet 95b8cc1b52ce4b45866ae912c00828e5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:15.549965 11726 tablet_service.cc:1511] Processing CreateTablet for tablet 95b8cc1b52ce4b45866ae912c00828e5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:15.561682 11576 tablet_service.cc:1511] Processing CreateTablet for tablet 486dc6cde7764b78aa07d583ef365e55 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:15.562057 11725 tablet_service.cc:1511] Processing CreateTablet for tablet 8881af9c27854058bd198d8a5bd2b1e3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:15.557781 11652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b8cc1b52ce4b45866ae912c00828e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.552680 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f32f35d73c4f83a13beccdbaac3a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.567924 11577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b8cc1b52ce4b45866ae912c00828e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.569942 11654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458610efe1f94a709b0a77f938cc539b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.572250 11651 tablet_service.cc:1511] Processing CreateTablet for tablet 486dc6cde7764b78aa07d583ef365e55 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:15.574159 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486dc6cde7764b78aa07d583ef365e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.575902 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486dc6cde7764b78aa07d583ef365e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.572286 11724 tablet_service.cc:1511] Processing CreateTablet for tablet f748295a5651478fad54cf62835b6d71 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:15.578259 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f748295a5651478fad54cf62835b6d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.580853 11723 tablet_service.cc:1511] Processing CreateTablet for tablet d90928a613c2450bb00632a65064996a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:15.582329 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90928a613c2450bb00632a65064996a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.585181 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11aa6af0390c4e07bf2b362d5bdb078d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.588899 11726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b8cc1b52ce4b45866ae912c00828e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.593449 11722 tablet_service.cc:1511] Processing CreateTablet for tablet 42d882e262e64f0fb7fc4614a9475b64 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:15.595587 11722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d882e262e64f0fb7fc4614a9475b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.597741 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8881af9c27854058bd198d8a5bd2b1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.603076 11721 tablet_service.cc:1511] Processing CreateTablet for tablet 8c066f250eb042dcb608879783345178 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:15.604904 11727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2e77a7d8e74543bab76ac11418f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.607314 11720 tablet_service.cc:1511] Processing CreateTablet for tablet e5305a21fc0049f69c387e0811febd16 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:15.609537 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5305a21fc0049f69c387e0811febd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.616909 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c066f250eb042dcb608879783345178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.649999 11579 tablet_service.cc:1511] Processing CreateTablet for tablet 8881af9c27854058bd198d8a5bd2b1e3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:15.651633 11579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8881af9c27854058bd198d8a5bd2b1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.663268 11650 tablet_service.cc:1511] Processing CreateTablet for tablet f748295a5651478fad54cf62835b6d71 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:15.665167 11650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f748295a5651478fad54cf62835b6d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.665987 11649 tablet_service.cc:1511] Processing CreateTablet for tablet d90928a613c2450bb00632a65064996a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:15.666254 11648 tablet_service.cc:1511] Processing CreateTablet for tablet 3f60ac2c79f045c18e7c1eed3af5f12b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:15.667989 11649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90928a613c2450bb00632a65064996a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.673931 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 8c066f250eb042dcb608879783345178 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:15.675304 11648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f60ac2c79f045c18e7c1eed3af5f12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.676964 11575 tablet_service.cc:1511] Processing CreateTablet for tablet d90928a613c2450bb00632a65064996a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:15.678659 11575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90928a613c2450bb00632a65064996a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.686841 11574 tablet_service.cc:1511] Processing CreateTablet for tablet 3f60ac2c79f045c18e7c1eed3af5f12b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:15.690142 11573 tablet_service.cc:1511] Processing CreateTablet for tablet 42d882e262e64f0fb7fc4614a9475b64 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:15.693980 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c066f250eb042dcb608879783345178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.696164 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d882e262e64f0fb7fc4614a9475b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.710593 11803 tablet_service.cc:1511] Processing CreateTablet for tablet 458610efe1f94a709b0a77f938cc539b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:15.710866 11802 tablet_service.cc:1511] Processing CreateTablet for tablet b9f32f35d73c4f83a13beccdbaac3a81 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:22:15.712474 11803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458610efe1f94a709b0a77f938cc539b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.713795 11800 tablet_service.cc:1511] Processing CreateTablet for tablet 486dc6cde7764b78aa07d583ef365e55 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:15.716820 11799 tablet_service.cc:1511] Processing CreateTablet for tablet 8881af9c27854058bd198d8a5bd2b1e3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:15.717715 11798 tablet_service.cc:1511] Processing CreateTablet for tablet f748295a5651478fad54cf62835b6d71 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:15.719606 11800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486dc6cde7764b78aa07d583ef365e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.721828 11796 tablet_service.cc:1511] Processing CreateTablet for tablet 42d882e262e64f0fb7fc4614a9475b64 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:15.719475 11797 tablet_service.cc:1511] Processing CreateTablet for tablet 3f60ac2c79f045c18e7c1eed3af5f12b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:15.725714 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d882e262e64f0fb7fc4614a9475b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.729998 11801 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2e77a7d8e74543bab76ac11418f6d3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:15.731930 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2e77a7d8e74543bab76ac11418f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.734162 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8881af9c27854058bd198d8a5bd2b1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.735034 11797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f60ac2c79f045c18e7c1eed3af5f12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.738610 11795 tablet_service.cc:1511] Processing CreateTablet for tablet 8c066f250eb042dcb608879783345178 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:15.716889 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f60ac2c79f045c18e7c1eed3af5f12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.740466 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c066f250eb042dcb608879783345178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.765487 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f748295a5651478fad54cf62835b6d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.766013 11615 heartbeater.cc:499] Master 127.2.243.126:42969 was elected leader, sending a full tablet report...
I20260709 13:22:15.766366 11802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f32f35d73c4f83a13beccdbaac3a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.769906 11572 tablet_service.cc:1511] Processing CreateTablet for tablet e5305a21fc0049f69c387e0811febd16 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:15.772007 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5305a21fc0049f69c387e0811febd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.777904 11655 tablet_service.cc:1511] Processing CreateTablet for tablet e5305a21fc0049f69c387e0811febd16 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:15.778185 11571 tablet_service.cc:1511] Processing CreateTablet for tablet 78a9c38790c24ddebcc9556c8e2356ea (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:15.799176 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a9c38790c24ddebcc9556c8e2356ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.809168 11652 tablet_service.cc:1511] Processing CreateTablet for tablet 78a9c38790c24ddebcc9556c8e2356ea (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:15.812603 11646 tablet_service.cc:1511] Processing CreateTablet for tablet 96d8d45c6521413ab41e0897d088fe75 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:22:15.809671 11859 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:15.799852 11728 tablet_service.cc:1511] Processing CreateTablet for tablet fe570064606c49e8ae9eeeacac9a6920 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:15.787882 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5305a21fc0049f69c387e0811febd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.824247 11729 tablet_service.cc:1511] Processing CreateTablet for tablet 96d8d45c6521413ab41e0897d088fe75 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:22:15.837903 11646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d8d45c6521413ab41e0897d088fe75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.834077 11794 tablet_service.cc:1511] Processing CreateTablet for tablet 78a9c38790c24ddebcc9556c8e2356ea (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:15.862895 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a9c38790c24ddebcc9556c8e2356ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.864163 11652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a9c38790c24ddebcc9556c8e2356ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.839145 11857 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:15.865779 11579 tablet_service.cc:1511] Processing CreateTablet for tablet fe570064606c49e8ae9eeeacac9a6920 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:15.867636 11579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe570064606c49e8ae9eeeacac9a6920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.833091 11727 tablet_service.cc:1511] Processing CreateTablet for tablet f15a85cd24ff436eaa26a81455d6c7fa (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:15.868610 11726 tablet_service.cc:1511] Processing CreateTablet for tablet 4aaa30e70122417dbf41d98488d2528e (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:15.841674 11651 tablet_service.cc:1511] Processing CreateTablet for tablet f15a85cd24ff436eaa26a81455d6c7fa (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:15.870886 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15a85cd24ff436eaa26a81455d6c7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.836548 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe570064606c49e8ae9eeeacac9a6920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.837857 11725 tablet_service.cc:1511] Processing CreateTablet for tablet ec71cc0340da4c8fac91f96fa561a0bb (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:15.833477 11858 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:15.864380 11580 tablet_service.cc:1511] Processing CreateTablet for tablet f15a85cd24ff436eaa26a81455d6c7fa (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:15.876071 11580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15a85cd24ff436eaa26a81455d6c7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.851383 11649 tablet_service.cc:1511] Processing CreateTablet for tablet 49ff1167f81242bd839fd9e4fc0b7196 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:15.885715 11649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ff1167f81242bd839fd9e4fc0b7196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.897430 11859 tablet_bootstrap.cc:654] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.903146 11653 tablet_service.cc:1511] Processing CreateTablet for tablet ec71cc0340da4c8fac91f96fa561a0bb (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:15.909371 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec71cc0340da4c8fac91f96fa561a0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.886646 11729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d8d45c6521413ab41e0897d088fe75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.916923 11576 tablet_service.cc:1511] Processing CreateTablet for tablet 4aaa30e70122417dbf41d98488d2528e (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:15.933575 11727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15a85cd24ff436eaa26a81455d6c7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.911970 11650 tablet_service.cc:1511] Processing CreateTablet for tablet 04373c0b8b6d47c5a1e07da5a04be2a4 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:15.934973 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec71cc0340da4c8fac91f96fa561a0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.936370 11726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aaa30e70122417dbf41d98488d2528e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.941423 11857 tablet_bootstrap.cc:654] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.948593 11577 tablet_service.cc:1511] Processing CreateTablet for tablet 49ff1167f81242bd839fd9e4fc0b7196 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:15.951418 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aaa30e70122417dbf41d98488d2528e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.955572 11650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04373c0b8b6d47c5a1e07da5a04be2a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.963981 11858 tablet_bootstrap.cc:654] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.964583 11690 heartbeater.cc:499] Master 127.2.243.126:42969 was elected leader, sending a full tablet report...
I20260709 13:22:15.946559 11724 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9e763e4e8f45e0a5d8a830dd1f93b5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:15.966120 11577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ff1167f81242bd839fd9e4fc0b7196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.970340 11647 tablet_service.cc:1511] Processing CreateTablet for tablet f06a77efc3a8409b991b0bb8bb957517 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:15.997512 11575 tablet_service.cc:1511] Processing CreateTablet for tablet f06a77efc3a8409b991b0bb8bb957517 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:15.999100 11575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06a77efc3a8409b991b0bb8bb957517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.000957 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06a77efc3a8409b991b0bb8bb957517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.974225 11578 tablet_service.cc:1511] Processing CreateTablet for tablet 04373c0b8b6d47c5a1e07da5a04be2a4 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:16.042217 11801 tablet_service.cc:1511] Processing CreateTablet for tablet fe570064606c49e8ae9eeeacac9a6920 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:16.043915 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe570064606c49e8ae9eeeacac9a6920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.990962 11721 tablet_service.cc:1511] Processing CreateTablet for tablet 04373c0b8b6d47c5a1e07da5a04be2a4 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:16.054461 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9e763e4e8f45e0a5d8a830dd1f93b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.028118 11720 tablet_service.cc:1511] Processing CreateTablet for tablet afee18061f56422e9609aa51229df7a9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:16.069504 11574 tablet_service.cc:1511] Processing CreateTablet for tablet afee18061f56422e9609aa51229df7a9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:16.072780 11728 tablet_service.cc:1511] Processing CreateTablet for tablet 57cac998e80f41198894f93a70c4e9ce (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:16.074771 11857 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:16.075389 11857 ts_tablet_manager.cc:1403] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.237s	user 0.015s	sys 0.002s
I20260709 13:22:16.078935 11857 raft_consensus.cc:359] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.079816 11857 raft_consensus.cc:385] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.044269 11803 tablet_service.cc:1511] Processing CreateTablet for tablet 96d8d45c6521413ab41e0897d088fe75 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:22:16.103677 11857 raft_consensus.cc:740] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.056660 11648 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9e763e4e8f45e0a5d8a830dd1f93b5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:16.108076 11648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9e763e4e8f45e0a5d8a830dd1f93b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.082248 11764 heartbeater.cc:499] Master 127.2.243.126:42969 was elected leader, sending a full tablet report...
I20260709 13:22:16.113689 11803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d8d45c6521413ab41e0897d088fe75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.116892 11857 consensus_queue.cc:260] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.063098 11578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04373c0b8b6d47c5a1e07da5a04be2a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.073347 11799 tablet_service.cc:1511] Processing CreateTablet for tablet 49ff1167f81242bd839fd9e4fc0b7196 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:16.103099 11858 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:16.123653 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cac998e80f41198894f93a70c4e9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.126715 11859 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:16.131650 11655 tablet_service.cc:1511] Processing CreateTablet for tablet b8e8930dda4e488d9427d8e6e487f4ab (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:16.084197 11802 tablet_service.cc:1511] Processing CreateTablet for tablet 4aaa30e70122417dbf41d98488d2528e (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:16.133045 11796 tablet_service.cc:1511] Processing CreateTablet for tablet ec71cc0340da4c8fac91f96fa561a0bb (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:16.138294 11798 tablet_service.cc:1511] Processing CreateTablet for tablet f06a77efc3a8409b991b0bb8bb957517 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:16.138726 11729 tablet_service.cc:1511] Processing CreateTablet for tablet 2157764af6d24b3b8f6f36257e76c5c7 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:22:16.151051 11859 ts_tablet_manager.cc:1403] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.342s	user 0.025s	sys 0.010s
I20260709 13:22:16.151353 11863 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:16.151897 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afee18061f56422e9609aa51229df7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.160449 11859 raft_consensus.cc:359] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:16.161350 11859 raft_consensus.cc:385] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.161700 11859 raft_consensus.cc:740] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.163100 11859 consensus_queue.cc:260] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:16.151432 11858 ts_tablet_manager.cc:1403] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.318s	user 0.016s	sys 0.011s
I20260709 13:22:16.164841 11572 tablet_service.cc:1511] Processing CreateTablet for tablet 57cac998e80f41198894f93a70c4e9ce (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:16.166993 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cac998e80f41198894f93a70c4e9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.105973 11797 tablet_service.cc:1511] Processing CreateTablet for tablet afee18061f56422e9609aa51229df7a9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:16.178129 11653 tablet_service.cc:1511] Processing CreateTablet for tablet 57cac998e80f41198894f93a70c4e9ce (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:16.178939 11858 raft_consensus.cc:359] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:16.180310 11858 raft_consensus.cc:385] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.153535 11857 ts_tablet_manager.cc:1434] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.078s	user 0.018s	sys 0.004s
I20260709 13:22:16.153856 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afee18061f56422e9609aa51229df7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.156029 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e8930dda4e488d9427d8e6e487f4ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.182358 11573 tablet_service.cc:1511] Processing CreateTablet for tablet b8e8930dda4e488d9427d8e6e487f4ab (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:16.183215 11858 raft_consensus.cc:740] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.184595 11863 tablet_bootstrap.cc:654] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.204114 11857 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:16.204842 11838 heartbeater.cc:499] Master 127.2.243.126:42969 was elected leader, sending a full tablet report...
I20260709 13:22:16.206267 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e8930dda4e488d9427d8e6e487f4ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.225245 11858 consensus_queue.cc:260] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:16.227568 11864 raft_consensus.cc:493] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.228255 11864 raft_consensus.cc:515] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.240773 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04373c0b8b6d47c5a1e07da5a04be2a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.250242 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cac998e80f41198894f93a70c4e9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.238520 11864 leader_election.cc:290] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:16.266894 11616 tablet.cc:2406] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:16.268949 11729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2157764af6d24b3b8f6f36257e76c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.269671 11857 tablet_bootstrap.cc:654] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.272678 11800 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9e763e4e8f45e0a5d8a830dd1f93b5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:16.273412 11858 ts_tablet_manager.cc:1434] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.109s	user 0.018s	sys 0.006s
I20260709 13:22:16.276244 11863 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:16.276686 11858 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:16.276903 11863 ts_tablet_manager.cc:1403] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.008s
I20260709 13:22:16.288302 11725 tablet_service.cc:1511] Processing CreateTablet for tablet 11338158fbbd4a72bb1c7f9375a25d6a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:16.290514 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11338158fbbd4a72bb1c7f9375a25d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.294600 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 11338158fbbd4a72bb1c7f9375a25d6a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:16.297051 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11338158fbbd4a72bb1c7f9375a25d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.294687 11580 tablet_service.cc:1511] Processing CreateTablet for tablet 2157764af6d24b3b8f6f36257e76c5c7 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:22:16.302256 11580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2157764af6d24b3b8f6f36257e76c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.305619 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ff1167f81242bd839fd9e4fc0b7196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.309810 11802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aaa30e70122417dbf41d98488d2528e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.313107 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec71cc0340da4c8fac91f96fa561a0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.292683 11863 raft_consensus.cc:359] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:16.317016 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06a77efc3a8409b991b0bb8bb957517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.317806 11797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afee18061f56422e9609aa51229df7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.323060 11800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9e763e4e8f45e0a5d8a830dd1f93b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.332299 11868 raft_consensus.cc:493] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.333326 11868 raft_consensus.cc:515] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:16.338008 11868 leader_election.cc:290] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:16.345609 11795 tablet_service.cc:1511] Processing CreateTablet for tablet b8e8930dda4e488d9427d8e6e487f4ab (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:16.347587 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e8930dda4e488d9427d8e6e487f4ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.350793 11801 tablet_service.cc:1511] Processing CreateTablet for tablet 2157764af6d24b3b8f6f36257e76c5c7 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 13:22:16.354422 11472 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 60552.6us
W20260709 13:22:16.355471 11474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 49588.7us
I20260709 13:22:16.361660 11572 tablet_service.cc:1511] Processing CreateTablet for tablet 290688edb81143ac8abfb02f7060a88a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:16.363287 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290688edb81143ac8abfb02f7060a88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.364971 11859 ts_tablet_manager.cc:1434] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.208s	user 0.016s	sys 0.015s
I20260709 13:22:16.327219 11863 raft_consensus.cc:385] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.384786 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2157764af6d24b3b8f6f36257e76c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.377032 11858 tablet_bootstrap.cc:654] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.387409 11728 tablet_service.cc:1511] Processing CreateTablet for tablet 290688edb81143ac8abfb02f7060a88a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:16.384583 11863 raft_consensus.cc:740] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.389277 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290688edb81143ac8abfb02f7060a88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.390316 11863 consensus_queue.cc:260] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:16.373725 11794 tablet_service.cc:1511] Processing CreateTablet for tablet 11338158fbbd4a72bb1c7f9375a25d6a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:16.392143 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11338158fbbd4a72bb1c7f9375a25d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.384315 11859 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:16.477648 11803 tablet_service.cc:1511] Processing CreateTablet for tablet 397c649b857e402ca8b1d21f4f416704 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:16.479342 11803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397c649b857e402ca8b1d21f4f416704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.492103 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:16.496448 11555 leader_election.cc:343] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.521605 11574 tablet_service.cc:1511] Processing CreateTablet for tablet 397c649b857e402ca8b1d21f4f416704 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:16.523424 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397c649b857e402ca8b1d21f4f416704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.526347 11653 tablet_service.cc:1511] Processing CreateTablet for tablet 290688edb81143ac8abfb02f7060a88a (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:16.528367 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290688edb81143ac8abfb02f7060a88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.545636 11865 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.546269 11865 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:16.549234 11859 tablet_bootstrap.cc:654] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.462258 11857 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:16.555395 11865 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:16.559298 11857 ts_tablet_manager.cc:1403] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.354s	user 0.026s	sys 0.025s
I20260709 13:22:16.572808 11858 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:16.573567 11858 ts_tablet_manager.cc:1403] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.297s	user 0.027s	sys 0.010s
I20260709 13:22:16.577740 11648 tablet_service.cc:1511] Processing CreateTablet for tablet 397c649b857e402ca8b1d21f4f416704 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:16.579483 11648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397c649b857e402ca8b1d21f4f416704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.585652 11858 raft_consensus.cc:359] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.587018 11858 raft_consensus.cc:385] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.587390 11858 raft_consensus.cc:740] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.588285 11858 consensus_queue.cc:260] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.590802 11858 ts_tablet_manager.cc:1434] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:22:16.610832 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8cc1b52ce4b45866ae912c00828e5" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:16.611132 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:16.612016 11665 raft_consensus.cc:2468] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:16.609119 11863 ts_tablet_manager.cc:1434] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.332s	user 0.019s	sys 0.015s
W20260709 13:22:16.618656 11628 leader_election.cc:343] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:16.623519 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:16.612282 11857 raft_consensus.cc:359] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.626523 11553 leader_election.cc:304] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:16.625449 11858 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:16.630154 11867 raft_consensus.cc:2804] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.635955 11867 raft_consensus.cc:493] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.636531 11867 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.643203 11578 tablet_service.cc:1511] Processing CreateTablet for tablet 4407206cd8ba4bd19c922dd8b3accb96 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:16.645924 11578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4407206cd8ba4bd19c922dd8b3accb96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.651341 11863 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:16.651939 11858 tablet_bootstrap.cc:654] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.657135 11794 tablet_service.cc:1511] Processing CreateTablet for tablet a3d0026358c345e890910be3c24e3da0 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:16.658833 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d0026358c345e890910be3c24e3da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.660318 11647 tablet_service.cc:1511] Processing CreateTablet for tablet a3d0026358c345e890910be3c24e3da0 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:16.674527 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d0026358c345e890910be3c24e3da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.661288 11799 tablet_service.cc:1511] Processing CreateTablet for tablet 4407206cd8ba4bd19c922dd8b3accb96 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:16.677449 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4407206cd8ba4bd19c922dd8b3accb96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.649910 11857 raft_consensus.cc:385] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.669337 11580 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba6f809721a4ee98530e65fe13e1cae (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:16.680933 11857 raft_consensus.cc:740] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.681856 11580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba6f809721a4ee98530e65fe13e1cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.672499 11653 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba6f809721a4ee98530e65fe13e1cae (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:16.683768 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba6f809721a4ee98530e65fe13e1cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.632851 11859 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:16.687714 11859 ts_tablet_manager.cc:1403] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.304s	user 0.027s	sys 0.004s
I20260709 13:22:16.691536 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8cc1b52ce4b45866ae912c00828e5" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:16.692227 11721 tablet_service.cc:1511] Processing CreateTablet for tablet a3d0026358c345e890910be3c24e3da0 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:16.691592 11728 tablet_service.cc:1511] Processing CreateTablet for tablet 4407206cd8ba4bd19c922dd8b3accb96 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:16.688566 11857 consensus_queue.cc:260] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.694710 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d0026358c345e890910be3c24e3da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.695683 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4407206cd8ba4bd19c922dd8b3accb96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.675078 11867 raft_consensus.cc:515] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:16.699527 11630 leader_election.cc:343] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.700212 11630 leader_election.cc:304] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:16.702188 11874 raft_consensus.cc:2749] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.699994 11725 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba6f809721a4ee98530e65fe13e1cae (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:16.703769 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:16.704293 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba6f809721a4ee98530e65fe13e1cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.708992 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:16.709854 11665 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.718654 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:16.720995 11704 leader_election.cc:343] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.727452 11857 ts_tablet_manager.cc:1434] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.160s	user 0.004s	sys 0.004s
I20260709 13:22:16.727958 11801 tablet_service.cc:1511] Processing CreateTablet for tablet f452676fac6242168986700b221e358e (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:16.729940 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f452676fac6242168986700b221e358e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.732301 11859 raft_consensus.cc:359] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.740782 11859 raft_consensus.cc:385] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.741308 11859 raft_consensus.cc:740] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.742331 11863 tablet_bootstrap.cc:654] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.729053 11867 leader_election.cc:290] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:16.738874 11572 tablet_service.cc:1511] Processing CreateTablet for tablet f452676fac6242168986700b221e358e (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:16.746498 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f452676fac6242168986700b221e358e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.743239 11859 consensus_queue.cc:260] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.751186 11739 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.753655 11648 tablet_service.cc:1511] Processing CreateTablet for tablet f452676fac6242168986700b221e358e (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:16.755707 11648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f452676fac6242168986700b221e358e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.736027 11857 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:16.764937 11665 raft_consensus.cc:2468] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:16.766772 11553 leader_election.cc:304] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:16.768364 11867 raft_consensus.cc:2804] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.770149 11867 raft_consensus.cc:697] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:16.771522 11867 consensus_queue.cc:237] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.778616 11725 tablet_service.cc:1511] Processing CreateTablet for tablet 0fae0c5c6645438dadaa067b0d5d92cb (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:16.779829 11798 tablet_service.cc:1511] Processing CreateTablet for tablet 0fae0c5c6645438dadaa067b0d5d92cb (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:16.781001 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fae0c5c6645438dadaa067b0d5d92cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.781469 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fae0c5c6645438dadaa067b0d5d92cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.789142 11574 tablet_service.cc:1511] Processing CreateTablet for tablet 0fae0c5c6645438dadaa067b0d5d92cb (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:16.791040 11864 raft_consensus.cc:493] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.791682 11864 raft_consensus.cc:515] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.795897 11864 leader_election.cc:290] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:16.798135 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458610efe1f94a709b0a77f938cc539b" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:16.801316 11553 leader_election.cc:343] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.804594 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fae0c5c6645438dadaa067b0d5d92cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.810839 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458610efe1f94a709b0a77f938cc539b" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:16.813391 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:16.815198 11555 leader_election.cc:343] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.815800 11555 leader_election.cc:304] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:16.817193 11864 raft_consensus.cc:2749] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.825325 11655 tablet_service.cc:1511] Processing CreateTablet for tablet b046224b89c645faacf4c9feb1def01b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:22:16.827018 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b046224b89c645faacf4c9feb1def01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.837368 11721 tablet_service.cc:1511] Processing CreateTablet for tablet b046224b89c645faacf4c9feb1def01b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:22:16.842128 11702 leader_election.cc:343] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.842831 11702 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:16.843705 11865 raft_consensus.cc:2749] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.847069 11739 raft_consensus.cc:2468] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:16.855952 11859 ts_tablet_manager.cc:1434] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.164s	user 0.011s	sys 0.002s
I20260709 13:22:16.857621 11859 tablet_bootstrap.cc:492] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:16.866247 11857 tablet_bootstrap.cc:654] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.870116 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b046224b89c645faacf4c9feb1def01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.856030 11858 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:16.875845 11858 ts_tablet_manager.cc:1403] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.258s	user 0.058s	sys 0.061s
I20260709 13:22:16.880927 11858 raft_consensus.cc:359] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.882149 11858 raft_consensus.cc:385] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.882561 11858 raft_consensus.cc:740] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.884052 11858 consensus_queue.cc:260] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.889118 11858 ts_tablet_manager.cc:1434] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:22:16.889515 11879 raft_consensus.cc:493] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.890493 11858 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:16.890139 11879 raft_consensus.cc:515] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:16.893306 11879 leader_election.cc:290] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:16.903045 11858 tablet_bootstrap.cc:654] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.926527 11863 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:16.928674 11863 ts_tablet_manager.cc:1403] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.278s	user 0.026s	sys 0.043s
I20260709 13:22:16.940444 11799 tablet_service.cc:1511] Processing CreateTablet for tablet b046224b89c645faacf4c9feb1def01b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:22:16.941313 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:16.945053 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b046224b89c645faacf4c9feb1def01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.945370 11857 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:16.946360 11857 ts_tablet_manager.cc:1403] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.211s	user 0.020s	sys 0.004s
W20260709 13:22:16.946360 11778 leader_election.cc:343] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.947137 11859 tablet_bootstrap.cc:654] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.951206 11857 raft_consensus.cc:359] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.952080 11857 raft_consensus.cc:385] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.952494 11857 raft_consensus.cc:740] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.952165 11485 catalog_manager.cc:5697] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.953421 11857 consensus_queue.cc:260] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.953498 11572 tablet_service.cc:1511] Processing CreateTablet for tablet e4b038f2a3164f739083461a162ce7df (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:16.956101 11857 ts_tablet_manager.cc:1434] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:22:16.956161 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b038f2a3164f739083461a162ce7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.956255 11725 tablet_service.cc:1511] Processing CreateTablet for tablet e4b038f2a3164f739083461a162ce7df (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:16.958736 11857 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:16.959110 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b038f2a3164f739083461a162ce7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.961335 11647 tablet_service.cc:1511] Processing CreateTablet for tablet e4b038f2a3164f739083461a162ce7df (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:16.966780 11794 tablet_service.cc:1511] Processing CreateTablet for tablet f34ebde4550a418cbfe562463c26adc4 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:16.977449 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34ebde4550a418cbfe562463c26adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.977880 11801 tablet_service.cc:1511] Processing CreateTablet for tablet e51f715c50984a62b3ff88c9fe9c4a91 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:16.979475 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51f715c50984a62b3ff88c9fe9c4a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.969853 11857 tablet_bootstrap.cc:654] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.971849 11864 raft_consensus.cc:493] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.968036 11578 tablet_service.cc:1511] Processing CreateTablet for tablet f34ebde4550a418cbfe562463c26adc4 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:16.971323 11728 tablet_service.cc:1511] Processing CreateTablet for tablet e51f715c50984a62b3ff88c9fe9c4a91 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:16.971530 11655 tablet_service.cc:1511] Processing CreateTablet for tablet f34ebde4550a418cbfe562463c26adc4 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:16.973455 11863 raft_consensus.cc:359] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:16.982244 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b038f2a3164f739083461a162ce7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.983978 11573 tablet_service.cc:1511] Processing CreateTablet for tablet e51f715c50984a62b3ff88c9fe9c4a91 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:16.984536 11648 tablet_service.cc:1511] Processing CreateTablet for tablet aa6f3a61bd92477db40d5dcb52285b38 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:16.989326 11724 tablet_service.cc:1511] Processing CreateTablet for tablet aa6f3a61bd92477db40d5dcb52285b38 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:16.996989 11578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34ebde4550a418cbfe562463c26adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.003023 11796 tablet_service.cc:1511] Processing CreateTablet for tablet aa6f3a61bd92477db40d5dcb52285b38 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:17.005411 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51f715c50984a62b3ff88c9fe9c4a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.992179 11864 raft_consensus.cc:515] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:17.011415 11864 leader_election.cc:290] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:17.012861 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51f715c50984a62b3ff88c9fe9c4a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.012516 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:17.013808 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6f3a61bd92477db40d5dcb52285b38. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:17.014640 11555 leader_election.cc:343] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.994313 11863 raft_consensus.cc:385] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.016654 11863 raft_consensus.cc:740] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.016975 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:17.017851 11665 raft_consensus.cc:2468] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:17.017623 11863 consensus_queue.cc:260] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:17.019188 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:17.021308 11776 leader_election.cc:343] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.021900 11776 leader_election.cc:304] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:17.023613 11879 raft_consensus.cc:2749] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:17.024890 11863 ts_tablet_manager.cc:1434] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.004s
I20260709 13:22:17.034166 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34ebde4550a418cbfe562463c26adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.033016 11553 leader_election.cc:304] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:17.041558 11864 raft_consensus.cc:2804] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.042068 11864 raft_consensus.cc:493] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.042438 11864 raft_consensus.cc:3060] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.045482 11648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6f3a61bd92477db40d5dcb52285b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.048498 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6f3a61bd92477db40d5dcb52285b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.095088 11572 tablet_service.cc:1511] Processing CreateTablet for tablet ce5a110a6f28455596def9d91be0d7a0 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:22:17.095666 11653 tablet_service.cc:1511] Processing CreateTablet for tablet ce5a110a6f28455596def9d91be0d7a0 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:22:17.096828 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5a110a6f28455596def9d91be0d7a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.097060 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5a110a6f28455596def9d91be0d7a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.097571 11859 tablet_bootstrap.cc:492] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:17.098212 11859 ts_tablet_manager.cc:1403] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.241s	user 0.010s	sys 0.010s
I20260709 13:22:17.110023 11859 raft_consensus.cc:359] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.110848 11859 raft_consensus.cc:385] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.111162 11859 raft_consensus.cc:740] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.115931 11858 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:17.119683 11858 ts_tablet_manager.cc:1403] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.229s	user 0.017s	sys 0.018s
I20260709 13:22:17.118247 11799 tablet_service.cc:1511] Processing CreateTablet for tablet e497ab473ebd4e6e9f4b651ca4382280 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:17.118238 11720 tablet_service.cc:1511] Processing CreateTablet for tablet ce5a110a6f28455596def9d91be0d7a0 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:22:17.122838 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5a110a6f28455596def9d91be0d7a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.126636 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e497ab473ebd4e6e9f4b651ca4382280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.123631 11858 raft_consensus.cc:359] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.135370 11858 raft_consensus.cc:385] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.135787 11858 raft_consensus.cc:740] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.136756 11858 consensus_queue.cc:260] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.139288 11858 ts_tablet_manager.cc:1434] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:22:17.132771 11864 raft_consensus.cc:515] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:17.143359 11864 leader_election.cc:290] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:17.143489 11574 tablet_service.cc:1511] Processing CreateTablet for tablet e497ab473ebd4e6e9f4b651ca4382280 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:17.131029 11863 tablet_bootstrap.cc:492] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:17.144230 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:17.148526 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:17.150064 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e497ab473ebd4e6e9f4b651ca4382280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.149920 11653 tablet_service.cc:1511] Processing CreateTablet for tablet e497ab473ebd4e6e9f4b651ca4382280 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:17.112123 11859 consensus_queue.cc:260] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.157261 11665 raft_consensus.cc:3060] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:17.159454 11555 leader_election.cc:343] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.159812 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e497ab473ebd4e6e9f4b651ca4382280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.165617 11857 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:17.166599 11857 ts_tablet_manager.cc:1403] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.208s	user 0.041s	sys 0.020s
I20260709 13:22:17.168136 11859 ts_tablet_manager.cc:1434] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:22:17.169816 11859 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:17.180889 11859 tablet_bootstrap.cc:654] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.192896 11867 consensus_queue.cc:1048] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.207549 11665 raft_consensus.cc:2468] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:17.173434 11858 tablet_bootstrap.cc:492] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:17.238188 11725 tablet_service.cc:1511] Processing CreateTablet for tablet d1bbd404c86c44709ebe400b6a9026d6 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:17.239966 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bbd404c86c44709ebe400b6a9026d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.241789 11864 consensus_queue.cc:1048] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.234236 11553 leader_election.cc:304] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:17.258016 11864 raft_consensus.cc:2804] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.258651 11864 raft_consensus.cc:697] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:17.259618 11864 consensus_queue.cc:237] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:17.260597 11794 tablet_service.cc:1511] Processing CreateTablet for tablet d1bbd404c86c44709ebe400b6a9026d6 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:17.269759 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bbd404c86c44709ebe400b6a9026d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.270573 11863 tablet_bootstrap.cc:654] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.282546 11572 tablet_service.cc:1511] Processing CreateTablet for tablet d1bbd404c86c44709ebe400b6a9026d6 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:17.285144 11647 tablet_service.cc:1511] Processing CreateTablet for tablet d7f3321b4876472e8e02c6bda6b80ad9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:17.286229 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bbd404c86c44709ebe400b6a9026d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.286948 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f3321b4876472e8e02c6bda6b80ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.305286 11857 raft_consensus.cc:359] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.306885 11857 raft_consensus.cc:385] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.307195 11857 raft_consensus.cc:740] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.308097 11857 consensus_queue.cc:260] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.315514 11859 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:17.316248 11859 ts_tablet_manager.cc:1403] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.147s	user 0.046s	sys 0.035s
I20260709 13:22:17.326148 11858 tablet_bootstrap.cc:654] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.330164 11859 raft_consensus.cc:359] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.331214 11859 raft_consensus.cc:385] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.331662 11859 raft_consensus.cc:740] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.355289 11857 ts_tablet_manager.cc:1434] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.188s	user 0.010s	sys 0.000s
I20260709 13:22:17.356748 11857 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:17.357343 11728 tablet_service.cc:1511] Processing CreateTablet for tablet d7f3321b4876472e8e02c6bda6b80ad9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:17.359045 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f3321b4876472e8e02c6bda6b80ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.361626 11578 tablet_service.cc:1511] Processing CreateTablet for tablet a80057d517d74e239a32fbe7ad0fe8c3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:17.363724 11578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80057d517d74e239a32fbe7ad0fe8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.363515 11794 tablet_service.cc:1511] Processing CreateTablet for tablet d7f3321b4876472e8e02c6bda6b80ad9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:17.366513 11724 tablet_service.cc:1511] Processing CreateTablet for tablet a80057d517d74e239a32fbe7ad0fe8c3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:17.370287 11653 tablet_service.cc:1511] Processing CreateTablet for tablet a80057d517d74e239a32fbe7ad0fe8c3 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:17.370471 11796 tablet_service.cc:1511] Processing CreateTablet for tablet 36fcdc9e0ad5475990fbcb8439ad5485 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:22:17.368919 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80057d517d74e239a32fbe7ad0fe8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.372624 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80057d517d74e239a32fbe7ad0fe8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.374496 11859 consensus_queue.cc:260] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.376463 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fcdc9e0ad5475990fbcb8439ad5485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.381057 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f3321b4876472e8e02c6bda6b80ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.385272 11859 ts_tablet_manager.cc:1434] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 13:22:17.388844 11859 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:17.384177 11857 tablet_bootstrap.cc:654] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.399268 11865 raft_consensus.cc:493] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.402791 11574 tablet_service.cc:1511] Processing CreateTablet for tablet 36fcdc9e0ad5475990fbcb8439ad5485 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:22:17.402915 11865 raft_consensus.cc:515] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.407096 11863 tablet_bootstrap.cc:492] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:17.408061 11863 ts_tablet_manager.cc:1403] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.337s	user 0.016s	sys 0.006s
I20260709 13:22:17.407325 11858 tablet_bootstrap.cc:492] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:17.408936 11865 leader_election.cc:290] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:17.409266 11858 ts_tablet_manager.cc:1403] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.236s	user 0.015s	sys 0.004s
I20260709 13:22:17.422082 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fcdc9e0ad5475990fbcb8439ad5485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.433166 11488 catalog_manager.cc:5697] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:17.413287 11555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 77398.4us
I20260709 13:22:17.448204 11865 raft_consensus.cc:493] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.459218 11865 raft_consensus.cc:515] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.461083 11903 raft_consensus.cc:493] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.461762 11903 raft_consensus.cc:515] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.462188 11799 tablet_service.cc:1511] Processing CreateTablet for tablet 226c4a2348e44e7797324eb4b36fe5fa (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:17.463255 11865 leader_election.cc:290] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:17.463796 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226c4a2348e44e7797324eb4b36fe5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.438916 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 36fcdc9e0ad5475990fbcb8439ad5485 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:22:17.464071 11903 leader_election.cc:290] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:17.469854 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fcdc9e0ad5475990fbcb8439ad5485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.473122 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:17.475234 11704 leader_election.cc:343] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.478528 11572 tablet_service.cc:1511] Processing CreateTablet for tablet 226c4a2348e44e7797324eb4b36fe5fa (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:17.480544 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226c4a2348e44e7797324eb4b36fe5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.487501 11879 raft_consensus.cc:493] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.488231 11879 raft_consensus.cc:515] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:17.489228 11720 tablet_service.cc:1511] Processing CreateTablet for tablet 226c4a2348e44e7797324eb4b36fe5fa (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:17.491333 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226c4a2348e44e7797324eb4b36fe5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.500847 11863 raft_consensus.cc:359] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.475772 11858 raft_consensus.cc:359] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.512192 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f60ac2c79f045c18e7c1eed3af5f12b" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:17.508704 11858 raft_consensus.cc:385] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.514286 11858 raft_consensus.cc:740] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.515273 11655 tablet_service.cc:1511] Processing CreateTablet for tablet 30e0b15fa5004d8ea57f63e1bebb2103 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:17.517777 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e0b15fa5004d8ea57f63e1bebb2103. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:17.518901 11776 leader_election.cc:343] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.525178 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8cc1b52ce4b45866ae912c00828e5" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:17.526666 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8881af9c27854058bd198d8a5bd2b1e3" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:17.527449 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8881af9c27854058bd198d8a5bd2b1e3" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:17.531291 11555 leader_election.cc:343] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:17.532603 11555 leader_election.cc:343] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.533336 11555 leader_election.cc:304] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:17.534713 11864 raft_consensus.cc:2749] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:17.503319 11863 raft_consensus.cc:385] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.538420 11863 raft_consensus.cc:740] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.515280 11858 consensus_queue.cc:260] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.539759 11863 consensus_queue.cc:260] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.552275 11879 leader_election.cc:290] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:17.557693 11702 leader_election.cc:343] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.558177 11857 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:17.565573 11859 tablet_bootstrap.cc:654] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.582427 11857 ts_tablet_manager.cc:1403] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.226s	user 0.008s	sys 0.009s
I20260709 13:22:17.585065 11879 raft_consensus.cc:493] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.601159 11879 raft_consensus.cc:515] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.603680 11879 leader_election.cc:290] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:17.611994 11720 tablet_service.cc:1511] Processing CreateTablet for tablet 30e0b15fa5004d8ea57f63e1bebb2103 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:17.621665 11874 raft_consensus.cc:493] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.622403 11874 raft_consensus.cc:515] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.625021 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f748295a5651478fad54cf62835b6d71" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:17.592808 11858 ts_tablet_manager.cc:1434] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.183s	user 0.008s	sys 0.004s
I20260709 13:22:17.629582 11858 tablet_bootstrap.cc:492] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
W20260709 13:22:17.630412 11778 leader_election.cc:343] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.636839 11578 tablet_service.cc:1511] Processing CreateTablet for tablet 181ec31526954dedb65074b8c24fd570 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:22:17.637636 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:17.638639 11578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ec31526954dedb65074b8c24fd570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.641155 11874 leader_election.cc:290] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:17.603533 11857 raft_consensus.cc:359] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.645202 11857 raft_consensus.cc:385] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.650050 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:17.650246 11725 tablet_service.cc:1511] Processing CreateTablet for tablet 181ec31526954dedb65074b8c24fd570 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:22:17.613628 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e0b15fa5004d8ea57f63e1bebb2103. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:17.654011 11630 leader_election.cc:343] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.654289 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ec31526954dedb65074b8c24fd570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.657101 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:17.657505 11653 tablet_service.cc:1511] Processing CreateTablet for tablet 181ec31526954dedb65074b8c24fd570 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:22:17.657968 11665 raft_consensus.cc:2468] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:17.659054 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ec31526954dedb65074b8c24fd570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.657390 11801 tablet_service.cc:1511] Processing CreateTablet for tablet ba936b69ea784d3aa5af76a721bdb29d (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:17.659420 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:17.663175 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba936b69ea784d3aa5af76a721bdb29d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.665719 11702 leader_election.cc:304] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:17.666635 11863 ts_tablet_manager.cc:1434] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.258s	user 0.006s	sys 0.031s
I20260709 13:22:17.667613 11865 raft_consensus.cc:2804] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.668159 11863 tablet_bootstrap.cc:492] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:17.668322 11865 raft_consensus.cc:493] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.669098 11865 raft_consensus.cc:3060] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.676677 11863 tablet_bootstrap.cc:654] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.689086 11859 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:17.689787 11859 ts_tablet_manager.cc:1403] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.301s	user 0.010s	sys 0.013s
I20260709 13:22:17.689992 11865 raft_consensus.cc:515] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.693902 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:17.693692 11859 raft_consensus.cc:359] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.694656 11665 raft_consensus.cc:3060] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.694824 11859 raft_consensus.cc:385] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.695415 11859 raft_consensus.cc:740] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.652870 11857 raft_consensus.cc:740] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.696718 11859 consensus_queue.cc:260] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.697408 11857 consensus_queue.cc:260] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.702051 11857 ts_tablet_manager.cc:1434] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 13:22:17.703383 11857 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:17.707237 11865 leader_election.cc:290] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:17.707648 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
W20260709 13:22:17.711550 11628 leader_election.cc:343] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.707872 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8cc1b52ce4b45866ae912c00828e5" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:17.710711 11665 raft_consensus.cc:2468] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:17.714726 11859 ts_tablet_manager.cc:1434] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.001s
W20260709 13:22:17.717592 11704 leader_election.cc:343] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.717451 11664 raft_consensus.cc:2468] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:17.718766 11702 leader_election.cc:304] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:17.720844 11702 leader_election.cc:304] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:17.721774 11918 raft_consensus.cc:2804] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.722244 11865 raft_consensus.cc:2804] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.722710 11865 raft_consensus.cc:493] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.724391 11799 tablet_service.cc:1511] Processing CreateTablet for tablet 30e0b15fa5004d8ea57f63e1bebb2103 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:17.726868 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e0b15fa5004d8ea57f63e1bebb2103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.725737 11865 raft_consensus.cc:3060] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.715633 11628 leader_election.cc:304] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:17.735846 11858 tablet_bootstrap.cc:654] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.737469 11915 raft_consensus.cc:2749] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:17.743156 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f60ac2c79f045c18e7c1eed3af5f12b" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:17.747900 11728 tablet_service.cc:1511] Processing CreateTablet for tablet eea5a35807cf47a18b69b5d51e415e5b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:17.749747 11859 tablet_bootstrap.cc:492] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:17.751022 11655 tablet_service.cc:1511] Processing CreateTablet for tablet ba936b69ea784d3aa5af76a721bdb29d (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:17.749799 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea5a35807cf47a18b69b5d51e415e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.738852 11863 tablet_bootstrap.cc:492] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:17.760509 11863 ts_tablet_manager.cc:1403] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.021s
I20260709 13:22:17.767985 11572 tablet_service.cc:1511] Processing CreateTablet for tablet eea5a35807cf47a18b69b5d51e415e5b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:17.769157 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f748295a5651478fad54cf62835b6d71" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:17.769778 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea5a35807cf47a18b69b5d51e415e5b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:17.771988 11776 leader_election.cc:343] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.772617 11776 leader_election.cc:304] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:17.773679 11912 raft_consensus.cc:2749] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:17.782810 11794 tablet_service.cc:1511] Processing CreateTablet for tablet eea5a35807cf47a18b69b5d51e415e5b (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:17.785861 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba936b69ea784d3aa5af76a721bdb29d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.789886 11574 tablet_service.cc:1511] Processing CreateTablet for tablet ba936b69ea784d3aa5af76a721bdb29d (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:17.796485 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea5a35807cf47a18b69b5d51e415e5b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:17.805459 11776 leader_election.cc:343] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.806634 11776 leader_election.cc:304] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:17.808260 11912 raft_consensus.cc:2749] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:17.800964 11857 tablet_bootstrap.cc:654] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.809206 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba936b69ea784d3aa5af76a721bdb29d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.813495 11864 consensus_queue.cc:1048] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.817312 11865 raft_consensus.cc:515] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.795241 11918 raft_consensus.cc:697] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:17.823083 11919 raft_consensus.cc:493] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.828887 11919 raft_consensus.cc:515] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.830977 11858 tablet_bootstrap.cc:492] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:17.824184 11653 tablet_service.cc:1511] Processing CreateTablet for tablet 48797993d22f487c9076c8f7d2c70245 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:17.831918 11858 ts_tablet_manager.cc:1403] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.203s	user 0.018s	sys 0.000s
I20260709 13:22:17.833750 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48797993d22f487c9076c8f7d2c70245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.836526 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8881af9c27854058bd198d8a5bd2b1e3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:17.839263 11704 leader_election.cc:343] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:17.843086 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8cc1b52ce4b45866ae912c00828e5" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:17.844156 11590 raft_consensus.cc:3060] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.849102 11863 raft_consensus.cc:359] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.850338 11863 raft_consensus.cc:385] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.850737 11863 raft_consensus.cc:740] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.851886 11863 consensus_queue.cc:260] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.860824 11865 leader_election.cc:290] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:17.874414 11863 ts_tablet_manager.cc:1434] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.005s
I20260709 13:22:17.860325 11859 tablet_bootstrap.cc:654] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.869014 11919 leader_election.cc:290] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:17.870438 11858 raft_consensus.cc:359] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.897593 11858 raft_consensus.cc:385] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.898006 11858 raft_consensus.cc:740] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.898392 11590 raft_consensus.cc:2468] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:17.864578 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8cc1b52ce4b45866ae912c00828e5" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:17.870740 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8881af9c27854058bd198d8a5bd2b1e3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:17.901947 11702 leader_election.cc:304] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:17.902073 11589 raft_consensus.cc:2468] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:17.906201 11863 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:17.900743 11918 consensus_queue.cc:237] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.904323 11664 raft_consensus.cc:3060] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.921015 11801 tablet_service.cc:1511] Processing CreateTablet for tablet 48797993d22f487c9076c8f7d2c70245 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:17.903955 11919 raft_consensus.cc:2804] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.922670 11919 raft_consensus.cc:697] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:17.923712 11919 consensus_queue.cc:237] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:17.898950 11858 consensus_queue.cc:260] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:17.926833 11858 ts_tablet_manager.cc:1434] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 13:22:17.928071 11858 tablet_bootstrap.cc:492] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:17.930840 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48797993d22f487c9076c8f7d2c70245. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:17.932003 11555 consensus_peers.cc:597] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff -> Peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Couldn't send request to peer 01c914cf532f4dc19c1bab3514524ac2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:17.933297 11702 leader_election.cc:304] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:17.933881 11728 tablet_service.cc:1511] Processing CreateTablet for tablet 48797993d22f487c9076c8f7d2c70245 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:17.934288 11865 raft_consensus.cc:2804] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.934713 11865 raft_consensus.cc:493] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.935084 11865 raft_consensus.cc:3060] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.935328 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48797993d22f487c9076c8f7d2c70245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.957187 11857 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:17.958456 11857 ts_tablet_manager.cc:1403] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.255s	user 0.018s	sys 0.019s
I20260709 13:22:17.958534 11865 raft_consensus.cc:515] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.963534 11664 raft_consensus.cc:2468] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:17.965487 11857 raft_consensus.cc:359] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.966428 11857 raft_consensus.cc:385] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.966943 11857 raft_consensus.cc:740] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.976917 11863 tablet_bootstrap.cc:654] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.968163 11857 consensus_queue.cc:260] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:17.981724 11653 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce85d6ba19f471b90132d5118bc8478 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:17.983637 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce85d6ba19f471b90132d5118bc8478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.989902 11858 tablet_bootstrap.cc:654] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.991140 11720 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce85d6ba19f471b90132d5118bc8478 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:17.992926 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce85d6ba19f471b90132d5118bc8478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.949559 11578 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce85d6ba19f471b90132d5118bc8478 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:17.999509 11578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce85d6ba19f471b90132d5118bc8478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.002840 11487 catalog_manager.cc:5697] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.004796 11865 leader_election.cc:290] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:18.010357 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8881af9c27854058bd198d8a5bd2b1e3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:18.011123 11589 raft_consensus.cc:3060] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.029639 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8881af9c27854058bd198d8a5bd2b1e3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:18.031101 11794 tablet_service.cc:1511] Processing CreateTablet for tablet cbb9d5e7bf3a47a5bfae29dc73636ec9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:22:18.033317 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb9d5e7bf3a47a5bfae29dc73636ec9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:18.036191 11704 leader_election.cc:343] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.046334 11572 tablet_service.cc:1511] Processing CreateTablet for tablet cbb9d5e7bf3a47a5bfae29dc73636ec9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:22:18.050294 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb9d5e7bf3a47a5bfae29dc73636ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.060093 11859 tablet_bootstrap.cc:492] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:18.069200 11859 ts_tablet_manager.cc:1403] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.320s	user 0.023s	sys 0.012s
I20260709 13:22:18.083204 11653 tablet_service.cc:1511] Processing CreateTablet for tablet cbb9d5e7bf3a47a5bfae29dc73636ec9 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:22:18.088888 11553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 96332.9us
I20260709 13:22:18.089386 11857 ts_tablet_manager.cc:1434] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.128s	user 0.012s	sys 0.034s
I20260709 13:22:18.089895 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb9d5e7bf3a47a5bfae29dc73636ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.090703 11857 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:18.095043 11864 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.096112 11864 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.098553 11863 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:18.099181 11863 ts_tablet_manager.cc:1403] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.193s	user 0.029s	sys 0.021s
I20260709 13:22:18.100641 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:18.101501 11739 raft_consensus.cc:2468] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:18.103113 11555 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:18.102906 11863 raft_consensus.cc:359] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.103924 11863 raft_consensus.cc:385] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.104256 11863 raft_consensus.cc:740] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.105363 11929 raft_consensus.cc:2804] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:18.105288 11863 consensus_queue.cc:260] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.105834 11929 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:18.106323 11929 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.105863 11728 tablet_service.cc:1511] Processing CreateTablet for tablet cd44a633335a4f7f94505d7f37d1dc5c (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:18.107460 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd44a633335a4f7f94505d7f37d1dc5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.108074 11857 tablet_bootstrap.cc:654] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.110303 11859 raft_consensus.cc:359] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.110737 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:18.111186 11859 raft_consensus.cc:385] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.111518 11859 raft_consensus.cc:740] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
W20260709 13:22:18.112707 11555 leader_election.cc:343] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.116760 11912 raft_consensus.cc:493] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.117933 11912 raft_consensus.cc:515] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.120493 11863 ts_tablet_manager.cc:1434] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:22:18.122354 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.123435 11664 raft_consensus.cc:2393] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:18.125391 11799 tablet_service.cc:1511] Processing CreateTablet for tablet cd44a633335a4f7f94505d7f37d1dc5c (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:18.126847 11912 leader_election.cc:290] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:18.126889 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:18.126982 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd44a633335a4f7f94505d7f37d1dc5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.129141 11863 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:18.129509 11778 leader_election.cc:304] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:18.131323 11912 raft_consensus.cc:3060] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.135726 11864 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:18.148483 11589 raft_consensus.cc:2468] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:18.150393 11702 leader_election.cc:304] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:18.150962 11863 tablet_bootstrap.cc:654] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.151405 11865 raft_consensus.cc:2804] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:18.158500 11865 raft_consensus.cc:697] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:18.159587 11865 consensus_queue.cc:237] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.160602 11912 raft_consensus.cc:2749] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:18.154911 11574 tablet_service.cc:1511] Processing CreateTablet for tablet cd44a633335a4f7f94505d7f37d1dc5c (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:18.164542 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd44a633335a4f7f94505d7f37d1dc5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.168505 11858 tablet_bootstrap.cc:492] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:18.169167 11858 ts_tablet_manager.cc:1403] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.241s	user 0.012s	sys 0.012s
I20260709 13:22:18.170164 11488 catalog_manager.cc:5697] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:18.171687 11857 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:18.172323 11857 ts_tablet_manager.cc:1403] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.003s
I20260709 13:22:18.152371 11859 consensus_queue.cc:260] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.175246 11859 ts_tablet_manager.cc:1434] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.106s	user 0.011s	sys 0.000s
I20260709 13:22:18.176085 11857 raft_consensus.cc:359] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.176618 11859 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:18.177008 11857 raft_consensus.cc:385] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.177410 11857 raft_consensus.cc:740] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.178529 11857 consensus_queue.cc:260] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.181475 11857 ts_tablet_manager.cc:1434] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:18.190085 11863 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:18.190800 11863 ts_tablet_manager.cc:1403] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.007s
I20260709 13:22:18.172713 11858 raft_consensus.cc:359] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.191519 11858 raft_consensus.cc:385] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.194483 11858 raft_consensus.cc:740] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.195438 11929 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.196293 11858 consensus_queue.cc:260] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.198067 11859 tablet_bootstrap.cc:654] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.194461 11863 raft_consensus.cc:359] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.200224 11863 raft_consensus.cc:385] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.200755 11863 raft_consensus.cc:740] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.200484 11858 ts_tablet_manager.cc:1434] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.004s
I20260709 13:22:18.201771 11863 consensus_queue.cc:260] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.205260 11858 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:18.207839 11655 tablet_service.cc:1511] Processing CreateTablet for tablet b066170aeea34d52be3000a5f02c1804 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:18.209455 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b066170aeea34d52be3000a5f02c1804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.210641 11863 ts_tablet_manager.cc:1434] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:22:18.211958 11863 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:18.216856 11858 tablet_bootstrap.cc:654] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.223169 11485 catalog_manager.cc:5697] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.226953 11863 tablet_bootstrap.cc:654] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.231617 11857 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:18.251003 11863 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:18.251911 11863 ts_tablet_manager.cc:1403] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.007s
I20260709 13:22:18.252758 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:18.253470 11739 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.257017 11929 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:18.258756 11801 tablet_service.cc:1511] Processing CreateTablet for tablet b066170aeea34d52be3000a5f02c1804 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:18.258934 11720 tablet_service.cc:1511] Processing CreateTablet for tablet b066170aeea34d52be3000a5f02c1804 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:18.261171 11801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b066170aeea34d52be3000a5f02c1804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.261549 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
W20260709 13:22:18.263494 11555 leader_election.cc:343] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.264379 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b066170aeea34d52be3000a5f02c1804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.270159 11863 raft_consensus.cc:359] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.271130 11863 raft_consensus.cc:385] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.271481 11863 raft_consensus.cc:740] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.272470 11863 consensus_queue.cc:260] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.275149 11863 ts_tablet_manager.cc:1434] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:22:18.285063 11857 tablet_bootstrap.cc:654] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.285260 11863 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:18.289692 11572 tablet_service.cc:1511] Processing CreateTablet for tablet d4660f6f974c4c96bc3c2ef61e90405f (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:18.291450 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4660f6f974c4c96bc3c2ef61e90405f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.299846 11859 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:18.300611 11859 ts_tablet_manager.cc:1403] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.124s	user 0.037s	sys 0.015s
I20260709 13:22:18.302790 11858 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:18.303399 11858 ts_tablet_manager.cc:1403] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.098s	user 0.025s	sys 0.027s
I20260709 13:22:18.303973 11859 raft_consensus.cc:359] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.304894 11859 raft_consensus.cc:385] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.305218 11859 raft_consensus.cc:740] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.306259 11859 consensus_queue.cc:260] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.307878 11655 tablet_service.cc:1511] Processing CreateTablet for tablet d4660f6f974c4c96bc3c2ef61e90405f (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:18.308661 11863 tablet_bootstrap.cc:654] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.309314 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4660f6f974c4c96bc3c2ef61e90405f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.311105 11858 raft_consensus.cc:359] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.313585 11859 ts_tablet_manager.cc:1434] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:22:18.321377 11799 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3893d7c0374a12933e175ada5b42de (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:22:18.321857 11858 raft_consensus.cc:385] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.325285 11739 raft_consensus.cc:2468] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:18.324587 11858 raft_consensus.cc:740] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.326782 11555 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:18.322926 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3893d7c0374a12933e175ada5b42de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.327077 11858 consensus_queue.cc:260] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.328177 11929 raft_consensus.cc:2804] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:18.328755 11929 raft_consensus.cc:697] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:18.329555 11858 ts_tablet_manager.cc:1434] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:22:18.329654 11929 consensus_queue.cc:237] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.330870 11858 tablet_bootstrap.cc:492] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:18.332728 11865 raft_consensus.cc:493] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.333273 11865 raft_consensus.cc:515] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.335554 11865 leader_election.cc:290] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:18.337225 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c066f250eb042dcb608879783345178" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:18.338222 11858 tablet_bootstrap.cc:654] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.337247 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c066f250eb042dcb608879783345178" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.339285 11664 raft_consensus.cc:2468] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:18.341042 11702 leader_election.cc:304] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:18.318307 11720 tablet_service.cc:1511] Processing CreateTablet for tablet d4660f6f974c4c96bc3c2ef61e90405f (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:18.322959 11859 tablet_bootstrap.cc:492] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
W20260709 13:22:18.343354 11704 leader_election.cc:343] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.318140 11863 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:18.344772 11863 ts_tablet_manager.cc:1403] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.005s
I20260709 13:22:18.351363 11865 raft_consensus.cc:2804] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:18.352283 11865 raft_consensus.cc:493] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:18.353032 11865 raft_consensus.cc:3060] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.352806 11863 raft_consensus.cc:359] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.354565 11863 raft_consensus.cc:385] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.355122 11863 raft_consensus.cc:740] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.361210 11863 consensus_queue.cc:260] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.363767 11864 raft_consensus.cc:493] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.357177 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4660f6f974c4c96bc3c2ef61e90405f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.364578 11864 raft_consensus.cc:515] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.361440 11653 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3893d7c0374a12933e175ada5b42de (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:22:18.366799 11653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3893d7c0374a12933e175ada5b42de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.367479 11728 tablet_service.cc:1511] Processing CreateTablet for tablet bb2b87661f184408bcc049ddd64425c5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:18.355954 11859 tablet_bootstrap.cc:654] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.368818 11728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2b87661f184408bcc049ddd64425c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.371469 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.372546 11664 raft_consensus.cc:2468] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:18.373648 11915 raft_consensus.cc:493] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.374226 11915 raft_consensus.cc:515] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.374280 11553 leader_election.cc:304] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:18.375515 11928 raft_consensus.cc:2804] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:18.375931 11928 raft_consensus.cc:493] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:18.376245 11928 raft_consensus.cc:3060] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.377377 11574 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3893d7c0374a12933e175ada5b42de (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:22:18.378743 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3893d7c0374a12933e175ada5b42de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.379110 11915 leader_election.cc:290] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:18.382948 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f748295a5651478fad54cf62835b6d71" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:18.389261 11864 leader_election.cc:290] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:18.388983 11928 raft_consensus.cc:515] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.391683 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:18.393574 11919 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.394156 11919 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.395257 11578 tablet_service.cc:1511] Processing CreateTablet for tablet bb2b87661f184408bcc049ddd64425c5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:18.396698 11919 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:18.397058 11578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2b87661f184408bcc049ddd64425c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.399016 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:18.400790 11555 leader_election.cc:343] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.399610 11488 catalog_manager.cc:5697] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:18.403292 11702 leader_election.cc:343] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.407298 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:18.408383 11664 raft_consensus.cc:3060] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.411158 11912 raft_consensus.cc:493] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.431146 11928 leader_election.cc:290] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:18.417397 11857 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:18.424083 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:18.417609 11859 tablet_bootstrap.cc:492] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:18.432444 11857 ts_tablet_manager.cc:1403] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.201s	user 0.008s	sys 0.013s
I20260709 13:22:18.432865 11859 ts_tablet_manager.cc:1403] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.004s
I20260709 13:22:18.410777 11863 ts_tablet_manager.cc:1434] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
W20260709 13:22:18.433583 11555 leader_election.cc:343] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.435200 11863 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:18.436892 11859 raft_consensus.cc:359] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.437753 11859 raft_consensus.cc:385] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.431329 11912 raft_consensus.cc:515] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.438068 11859 raft_consensus.cc:740] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.438480 11664 raft_consensus.cc:2468] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:18.440125 11553 leader_election.cc:304] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:18.440660 11857 raft_consensus.cc:359] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.441540 11857 raft_consensus.cc:385] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.441846 11857 raft_consensus.cc:740] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.441903 11928 raft_consensus.cc:2804] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:18.442739 11857 consensus_queue.cc:260] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.444069 11928 raft_consensus.cc:697] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:18.445185 11928 consensus_queue.cc:237] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.448845 11859 consensus_queue.cc:260] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.451112 11857 ts_tablet_manager.cc:1434] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:22:18.450677 11919 consensus_queue.cc:1048] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.452258 11857 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:18.454437 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.459136 11857 tablet_bootstrap.cc:654] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.463791 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458610efe1f94a709b0a77f938cc539b" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:18.465267 11589 raft_consensus.cc:2468] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:18.466323 11487 catalog_manager.cc:5697] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.470118 11859 ts_tablet_manager.cc:1434] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.004s
I20260709 13:22:18.440253 11912 leader_election.cc:290] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:18.489215 11776 leader_election.cc:304] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:18.489537 11799 tablet_service.cc:1511] Processing CreateTablet for tablet bb2b87661f184408bcc049ddd64425c5 (DEFAULT_TABLE table=test-workload [id=8f242d9cca0d4d5c93a8295411cd501d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:18.490656 11919 consensus_queue.cc:1048] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.492228 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458610efe1f94a709b0a77f938cc539b" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.512966 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2b87661f184408bcc049ddd64425c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:18.515240 11863 tablet_bootstrap.cc:654] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.516901 11912 raft_consensus.cc:2804] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:18.517644 11912 raft_consensus.cc:493] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:18.518153 11912 raft_consensus.cc:3060] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.519006 11865 raft_consensus.cc:515] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.505990 11857 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:18.504508 11859 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:18.521343 11857 ts_tablet_manager.cc:1403] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.033s
W20260709 13:22:18.481546 11630 leader_election.cc:343] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:18.517082 11776 leader_election.cc:343] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:18.526141 11630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 44481.1us
W20260709 13:22:18.527609 11702 leader_election.cc:343] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.528075 11702 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:18.529877 11919 raft_consensus.cc:2749] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:18.537355 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c066f250eb042dcb608879783345178" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:18.538475 11664 raft_consensus.cc:3060] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.510673 11950 consensus_queue.cc:1048] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.546663 11857 raft_consensus.cc:359] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.550012 11857 raft_consensus.cc:385] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.550299 11857 raft_consensus.cc:740] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.551131 11857 consensus_queue.cc:260] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.552240 11859 tablet_bootstrap.cc:654] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.571376 11912 raft_consensus.cc:515] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.590006 11912 leader_election.cc:290] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:18.582369 11863 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:18.557778 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f748295a5651478fad54cf62835b6d71" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:18.591209 11863 ts_tablet_manager.cc:1403] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.003s
I20260709 13:22:18.567828 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c066f250eb042dcb608879783345178" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:18.591439 11812 raft_consensus.cc:2468] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:18.558909 11952 raft_consensus.cc:493] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.583565 11865 leader_election.cc:290] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:18.593292 11952 raft_consensus.cc:515] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.569480 11664 raft_consensus.cc:2468] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:18.594805 11810 raft_consensus.cc:3060] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:18.597856 11704 leader_election.cc:343] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.597856 11858 tablet_bootstrap.cc:492] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:18.598892 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458610efe1f94a709b0a77f938cc539b" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:18.600939 11630 leader_election.cc:304] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:18.598971 11858 ts_tablet_manager.cc:1403] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.268s	user 0.045s	sys 0.059s
W20260709 13:22:18.601447 11776 leader_election.cc:343] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.601883 11915 raft_consensus.cc:2804] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:18.602411 11915 raft_consensus.cc:493] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:18.602762 11915 raft_consensus.cc:3060] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.595541 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458610efe1f94a709b0a77f938cc539b" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:18.603943 11589 raft_consensus.cc:3060] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.605582 11863 raft_consensus.cc:359] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.607244 11863 raft_consensus.cc:385] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.607985 11863 raft_consensus.cc:740] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.563896 11857 ts_tablet_manager.cc:1434] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 13:22:18.615221 11857 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:18.615440 11858 raft_consensus.cc:359] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.616631 11858 raft_consensus.cc:385] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.617012 11858 raft_consensus.cc:740] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.617960 11858 consensus_queue.cc:260] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.622699 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8881af9c27854058bd198d8a5bd2b1e3" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:18.624274 11857 tablet_bootstrap.cc:654] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.632994 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8881af9c27854058bd198d8a5bd2b1e3" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:18.634112 11590 raft_consensus.cc:2393] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:18.635285 11858 ts_tablet_manager.cc:1434] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.012s
I20260709 13:22:18.635432 11865 consensus_queue.cc:1048] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.635506 11952 leader_election.cc:290] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:18.646328 11702 leader_election.cc:304] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:18.647476 11857 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:18.648216 11857 ts_tablet_manager.cc:1403] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.004s
I20260709 13:22:18.651563 11857 raft_consensus.cc:359] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.652242 11857 raft_consensus.cc:385] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.652598 11857 raft_consensus.cc:740] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.647527 11951 raft_consensus.cc:2804] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:18.654819 11951 raft_consensus.cc:697] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:18.653795 11857 consensus_queue.cc:260] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.655804 11951 consensus_queue.cc:237] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.662474 11857 ts_tablet_manager.cc:1434] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:22:18.664196 11857 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:18.664295 11589 raft_consensus.cc:2468] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:18.669428 11953 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.669615 11776 leader_election.cc:304] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:18.670244 11953 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.678133 11776 leader_election.cc:304] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:18.682111 11857 tablet_bootstrap.cc:654] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.685101 11952 raft_consensus.cc:2749] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:18.695801 11952 raft_consensus.cc:2804] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:18.696458 11952 raft_consensus.cc:697] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:18.698186 11865 consensus_queue.cc:1048] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.638489 11915 raft_consensus.cc:515] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.642232 11858 tablet_bootstrap.cc:492] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
W20260709 13:22:18.642423 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:18.642989 11960 raft_consensus.cc:493] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.701174 11960 raft_consensus.cc:515] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.642899 11863 consensus_queue.cc:260] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.702327 11915 leader_election.cc:290] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:18.704442 11863 ts_tablet_manager.cc:1434] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.113s	user 0.011s	sys 0.000s
I20260709 13:22:18.704312 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f748295a5651478fad54cf62835b6d71" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:18.705319 11810 raft_consensus.cc:3060] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.706115 11960 leader_election.cc:290] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:18.706393 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f60ac2c79f045c18e7c1eed3af5f12b" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:18.707156 11589 raft_consensus.cc:2468] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:18.708276 11912 raft_consensus.cc:493] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.709115 11912 raft_consensus.cc:515] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.713622 11628 leader_election.cc:304] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:18.715054 11960 raft_consensus.cc:2804] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:18.715729 11960 raft_consensus.cc:493] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:18.716291 11960 raft_consensus.cc:3060] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.716866 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f60ac2c79f045c18e7c1eed3af5f12b" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:18.717849 11813 raft_consensus.cc:2468] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:18.719046 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f748295a5651478fad54cf62835b6d71" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:18.719913 11739 raft_consensus.cc:3060] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.722856 11858 tablet_bootstrap.cc:654] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.643774 11859 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:18.726980 11859 ts_tablet_manager.cc:1403] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.223s	user 0.005s	sys 0.010s
I20260709 13:22:18.730445 11859 raft_consensus.cc:359] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.715124 11863 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:18.734935 11928 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.762550 11928 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.731294 11859 raft_consensus.cc:385] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.764801 11967 raft_consensus.cc:493] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.765156 11859 raft_consensus.cc:740] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.755435 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:18.757193 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a9c38790c24ddebcc9556c8e2356ea" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.733578 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:18.773763 11738 raft_consensus.cc:2393] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:18.773469 11859 consensus_queue.cc:260] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.719102 11952 consensus_queue.cc:237] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.750877 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a9c38790c24ddebcc9556c8e2356ea" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:18.765413 11967 raft_consensus.cc:515] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.765398 11954 consensus_queue.cc:1048] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:22:18.781292 11967 leader_election.cc:290] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:18.750182 11960 raft_consensus.cc:515] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.757241 11810 raft_consensus.cc:2468] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:18.785480 11960 leader_election.cc:290] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:18.756589 11488 catalog_manager.cc:5697] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.767416 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.767791 11928 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:18.768620 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:18.789322 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f60ac2c79f045c18e7c1eed3af5f12b" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
W20260709 13:22:18.789696 11553 leader_election.cc:343] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.789994 11589 raft_consensus.cc:3060] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.789350 11737 raft_consensus.cc:2468] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:18.791962 11555 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:18.735113 11912 leader_election.cc:290] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:18.793354 11928 raft_consensus.cc:2804] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:18.793905 11928 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:18.794274 11928 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.734362 11953 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:18.731081 11739 raft_consensus.cc:2468] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:18.802734 11630 leader_election.cc:304] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:18.804090 11960 raft_consensus.cc:2804] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:18.805532 11960 raft_consensus.cc:697] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:18.806524 11960 consensus_queue.cc:237] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.753187 11863 tablet_bootstrap.cc:654] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.814155 11964 raft_consensus.cc:493] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.815172 11964 raft_consensus.cc:515] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.820595 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:18.806460 11859 ts_tablet_manager.cc:1434] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.001s
I20260709 13:22:18.823985 11859 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:18.825399 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.833258 11664 raft_consensus.cc:2393] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:18.836009 11915 raft_consensus.cc:493] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.837321 11915 raft_consensus.cc:515] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
W20260709 13:22:18.839754 11776 leader_election.cc:343] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.826797 11964 leader_election.cc:290] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:18.828584 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:18.825997 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:18.829278 11929 consensus_queue.cc:1048] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.854260 11859 tablet_bootstrap.cc:654] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.855816 11857 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:18.856460 11857 ts_tablet_manager.cc:1403] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.193s	user 0.025s	sys 0.032s
I20260709 13:22:18.841295 11589 raft_consensus.cc:2468] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:18.840070 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f60ac2c79f045c18e7c1eed3af5f12b" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:18.841508 11928 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.842520 11487 catalog_manager.cc:5697] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.843830 11702 leader_election.cc:304] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:18.840045 11915 leader_election.cc:290] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:18.805385 11858 tablet_bootstrap.cc:492] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:18.871142 11858 ts_tablet_manager.cc:1403] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.229s	user 0.010s	sys 0.006s
I20260709 13:22:18.872038 11964 raft_consensus.cc:3060] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.874864 11858 raft_consensus.cc:359] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.875694 11858 raft_consensus.cc:385] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.875972 11858 raft_consensus.cc:740] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.876951 11858 consensus_queue.cc:260] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:18.878460 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:18.879470 11737 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.879918 11858 ts_tablet_manager.cc:1434] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:18.880024 11857 raft_consensus.cc:359] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.880841 11857 raft_consensus.cc:385] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:18.881160 11857 raft_consensus.cc:740] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.881531 11858 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:18.882004 11857 consensus_queue.cc:260] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.864069 11628 leader_election.cc:304] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:18.864564 11810 raft_consensus.cc:3060] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.889317 11915 raft_consensus.cc:2804] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:18.889998 11915 raft_consensus.cc:697] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:18.890949 11915 consensus_queue.cc:237] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.869982 11928 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:18.845259 11776 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
W20260709 13:22:18.908710 11776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 63553.5us
W20260709 13:22:18.909721 11776 leader_election.cc:343] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.910259 11776 leader_election.cc:304] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:18.897447 11858 tablet_bootstrap.cc:654] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.897132 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d8d45c6521413ab41e0897d088fe75" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:18.912473 11630 leader_election.cc:343] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.897742 11857 ts_tablet_manager.cc:1434] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:22:18.860733 11488 catalog_manager.cc:5697] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.915544 11857 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:18.898360 11813 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:18.904130 11964 raft_consensus.cc:2749] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:18.920306 11928 raft_consensus.cc:493] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:18.921375 11928 raft_consensus.cc:515] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:18.919196 11953 raft_consensus.cc:2749] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:18.925983 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:18.927938 11555 leader_election.cc:343] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.929315 11928 leader_election.cc:290] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:18.931370 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:18.933265 11553 leader_election.cc:343] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.933806 11553 leader_election.cc:304] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:18.935144 11928 consensus_queue.cc:1048] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.914007 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:18.936249 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d8d45c6521413ab41e0897d088fe75" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:18.936194 11776 leader_election.cc:304] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:18.938540 11737 raft_consensus.cc:2468] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:18.939293 11953 raft_consensus.cc:2749] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:18.939546 11630 leader_election.cc:343] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.940181 11630 leader_election.cc:304] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:18.940675 11857 tablet_bootstrap.cc:654] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:18.941183 11555 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:18.942210 11960 raft_consensus.cc:2749] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:18.940124 11928 raft_consensus.cc:2749] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:18.943135 11864 raft_consensus.cc:2804] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:18.955998 11864 raft_consensus.cc:697] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:18.960865 11952 raft_consensus.cc:2749] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:18.965920 11929 consensus_queue.cc:1048] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.967707 11929 consensus_queue.cc:1048] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:18.957620 11864 consensus_queue.cc:237] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:18.968698 11859 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:18.969321 11859 ts_tablet_manager.cc:1403] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.146s	user 0.021s	sys 0.008s
I20260709 13:22:18.973505 11859 raft_consensus.cc:359] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.974898 11859 raft_consensus.cc:385] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:18.949867 11553 leader_election.cc:343] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:18.975206 11859 raft_consensus.cc:740] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:18.978116 11863 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:18.977839 11859 consensus_queue.cc:260] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:18.978710 11863 ts_tablet_manager.cc:1403] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.273s	user 0.039s	sys 0.019s
I20260709 13:22:18.980628 11859 ts_tablet_manager.cc:1434] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:18.990263 11859 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:18.968755 11810 raft_consensus.cc:2468] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:18.998518 11858 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:18.999375 11858 ts_tablet_manager.cc:1403] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.118s	user 0.027s	sys 0.004s
I20260709 13:22:19.001415 11863 raft_consensus.cc:359] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.003826 11863 raft_consensus.cc:385] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.004400 11863 raft_consensus.cc:740] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.005432 11863 consensus_queue.cc:260] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.007844 11863 ts_tablet_manager.cc:1434] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:22:19.010026 11863 tablet_bootstrap.cc:492] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:18.996742 11813 raft_consensus.cc:3060] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.027472 11858 raft_consensus.cc:359] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.035423 11858 raft_consensus.cc:385] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.035851 11858 raft_consensus.cc:740] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.036798 11858 consensus_queue.cc:260] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.039979 11858 ts_tablet_manager.cc:1434] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:22:19.047101 11858 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:19.050246 11486 catalog_manager.cc:5697] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:19.056581 11487 catalog_manager.cc:5697] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:19.059144 11858 tablet_bootstrap.cc:654] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.060835 11954 consensus_queue.cc:1048] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.082132 11915 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:19.102749 11704 consensus_peers.cc:597] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e -> Peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Couldn't send request to peer 01c914cf532f4dc19c1bab3514524ac2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:19.102948 11915 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.106202 11857 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:19.106874 11857 ts_tablet_manager.cc:1403] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.192s	user 0.031s	sys 0.017s
I20260709 13:22:19.108490 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:19.109594 11739 raft_consensus.cc:2393] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:19.113888 11857 raft_consensus.cc:359] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.116879 11857 raft_consensus.cc:385] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.117187 11857 raft_consensus.cc:740] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.118031 11857 consensus_queue.cc:260] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.106851 11915 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:19.124207 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:19.124858 11863 tablet_bootstrap.cc:654] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.125542 11859 tablet_bootstrap.cc:654] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.132296 11857 ts_tablet_manager.cc:1434] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:22:19.133561 11857 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:19.126946 11628 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.142030 11915 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.158649 11858 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:19.159610 11858 ts_tablet_manager.cc:1403] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.003s
I20260709 13:22:19.160518 11915 raft_consensus.cc:2749] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.169699 11858 raft_consensus.cc:359] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.170666 11858 raft_consensus.cc:385] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.171030 11858 raft_consensus.cc:740] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.172535 11858 consensus_queue.cc:260] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.175033 11858 ts_tablet_manager.cc:1434] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:22:19.176219 11858 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:19.191512 11859 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:19.192139 11863 tablet_bootstrap.cc:492] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:19.192207 11859 ts_tablet_manager.cc:1403] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.202s	user 0.017s	sys 0.007s
I20260709 13:22:19.192912 11863 ts_tablet_manager.cc:1403] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.183s	user 0.009s	sys 0.013s
I20260709 13:22:19.196168 11863 raft_consensus.cc:359] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.196864 11863 raft_consensus.cc:385] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.197129 11863 raft_consensus.cc:740] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.197901 11863 consensus_queue.cc:260] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.198801 11952 raft_consensus.cc:493] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.199908 11952 raft_consensus.cc:515] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.200670 11863 ts_tablet_manager.cc:1434] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:19.202490 11952 leader_election.cc:290] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.204921 11857 tablet_bootstrap.cc:654] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.205206 11863 tablet_bootstrap.cc:492] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:19.205612 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:19.206357 11589 raft_consensus.cc:2468] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:19.204749 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:19.211512 11776 leader_election.cc:304] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:19.212625 11912 raft_consensus.cc:2804] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.213052 11912 raft_consensus.cc:493] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.213413 11912 raft_consensus.cc:3060] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.214989 11737 raft_consensus.cc:2468] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:19.220398 11858 tablet_bootstrap.cc:654] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.222294 11952 consensus_queue.cc:1048] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:19.223151 11863 tablet_bootstrap.cc:654] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.230507 11912 raft_consensus.cc:515] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.231534 11859 raft_consensus.cc:359] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.232407 11859 raft_consensus.cc:385] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.232775 11859 raft_consensus.cc:740] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.236845 11859 consensus_queue.cc:260] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.239288 11859 ts_tablet_manager.cc:1434] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:22:19.240657 11859 tablet_bootstrap.cc:492] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:19.240890 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:19.241606 11737 raft_consensus.cc:3060] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.241822 11912 leader_election.cc:290] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.242733 11857 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:19.243321 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:19.243644 11857 ts_tablet_manager.cc:1403] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.017s
I20260709 13:22:19.244920 11588 raft_consensus.cc:3060] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.252889 11859 tablet_bootstrap.cc:654] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.253400 11857 raft_consensus.cc:359] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.254271 11857 raft_consensus.cc:385] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.254596 11857 raft_consensus.cc:740] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.255362 11857 consensus_queue.cc:260] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.258069 11857 ts_tablet_manager.cc:1434] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:22:19.259842 11665 raft_consensus.cc:3060] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.262954 11857 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:19.271078 11915 raft_consensus.cc:493] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.271713 11857 tablet_bootstrap.cc:654] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.271675 11915 raft_consensus.cc:515] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.276244 11915 leader_election.cc:290] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.277628 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458610efe1f94a709b0a77f938cc539b" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:19.277729 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458610efe1f94a709b0a77f938cc539b" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:19.279731 11588 raft_consensus.cc:2468] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:19.282555 11967 consensus_queue.cc:1048] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.283792 11630 leader_election.cc:304] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:19.285934 11915 raft_consensus.cc:2749] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:19.301424 11929 raft_consensus.cc:493] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.302376 11929 raft_consensus.cc:515] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.282673 11776 leader_election.cc:304] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:19.309517 11929 leader_election.cc:290] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:19.311070 11967 raft_consensus.cc:2804] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.311795 11967 raft_consensus.cc:697] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:19.312824 11863 tablet_bootstrap.cc:492] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:19.313688 11863 ts_tablet_manager.cc:1403] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.109s	user 0.035s	sys 0.015s
I20260709 13:22:19.314822 11737 raft_consensus.cc:2468] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:19.312691 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ff1167f81242bd839fd9e4fc0b7196" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:19.317245 11863 raft_consensus.cc:359] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.318043 11863 raft_consensus.cc:385] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.318315 11863 raft_consensus.cc:740] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
W20260709 13:22:19.318783 11553 leader_election.cc:343] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.319031 11863 consensus_queue.cc:260] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.319669 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ff1167f81242bd839fd9e4fc0b7196" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:19.312824 11967 consensus_queue.cc:237] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:19.321841 11555 leader_election.cc:343] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.322542 11555 leader_election.cc:304] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:19.322779 11915 consensus_queue.cc:1048] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:19.323896 11929 raft_consensus.cc:2749] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.329208 11863 ts_tablet_manager.cc:1434] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:22:19.334555 11863 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:19.336530 11487 catalog_manager.cc:5697] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:19.354866 11858 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:19.355455 11863 tablet_bootstrap.cc:654] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.356086 11859 tablet_bootstrap.cc:492] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:19.356750 11859 ts_tablet_manager.cc:1403] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.000s
I20260709 13:22:19.355510 11858 ts_tablet_manager.cc:1403] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.004s
I20260709 13:22:19.357875 11915 raft_consensus.cc:493] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.366875 11858 raft_consensus.cc:359] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.373594 11858 raft_consensus.cc:385] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.374006 11858 raft_consensus.cc:740] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.367475 11915 raft_consensus.cc:515] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.376590 11915 leader_election.cc:290] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:19.366138 11859 raft_consensus.cc:359] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.377197 11915 consensus_queue.cc:1048] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.378605 11952 raft_consensus.cc:493] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.379245 11915 consensus_queue.cc:1048] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.377643 11859 raft_consensus.cc:385] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.380445 11859 raft_consensus.cc:740] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.379478 11952 raft_consensus.cc:515] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.381305 11859 consensus_queue.cc:260] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.381759 11858 consensus_queue.cc:260] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.400467 11859 ts_tablet_manager.cc:1434] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.001s
I20260709 13:22:19.403920 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:19.404768 11929 consensus_queue.cc:1048] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.407373 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:19.408314 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c066f250eb042dcb608879783345178" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:19.409487 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c066f250eb042dcb608879783345178" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:19.394668 11952 leader_election.cc:290] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:19.428288 11630 leader_election.cc:343] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.424682 11859 tablet_bootstrap.cc:492] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:19.429965 11776 leader_election.cc:304] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.432780 11952 raft_consensus.cc:2749] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:19.436087 11630 leader_election.cc:343] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.436793 11630 leader_election.cc:304] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.448020 11857 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:19.439754 11965 raft_consensus.cc:2749] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.452643 11857 ts_tablet_manager.cc:1403] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.190s	user 0.025s	sys 0.009s
I20260709 13:22:19.452771 11863 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:19.456138 11952 raft_consensus.cc:493] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.449119 11858 ts_tablet_manager.cc:1434] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.091s	user 0.000s	sys 0.008s
I20260709 13:22:19.456897 11952 raft_consensus.cc:515] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.458035 11859 tablet_bootstrap.cc:654] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.458887 11954 raft_consensus.cc:493] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.459451 11954 raft_consensus.cc:515] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.462772 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:19.463837 11954 leader_election.cc:290] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.464214 11737 raft_consensus.cc:2468] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:19.457832 11858 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:19.466008 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:19.468312 11778 leader_election.cc:304] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:19.469972 11912 raft_consensus.cc:2804] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.470530 11912 raft_consensus.cc:493] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.458554 11857 raft_consensus.cc:359] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.471016 11912 raft_consensus.cc:3060] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.471305 11857 raft_consensus.cc:385] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.471700 11857 raft_consensus.cc:740] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.472599 11857 consensus_queue.cc:260] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.473713 11589 raft_consensus.cc:2468] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:19.456573 11863 ts_tablet_manager.cc:1403] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.123s	user 0.025s	sys 0.027s
I20260709 13:22:19.477643 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:19.480867 11858 tablet_bootstrap.cc:654] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.481542 11952 leader_election.cc:290] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.482599 11863 raft_consensus.cc:359] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.483882 11863 raft_consensus.cc:385] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.484275 11863 raft_consensus.cc:740] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.478965 11857 ts_tablet_manager.cc:1434] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:22:19.487568 11863 consensus_queue.cc:260] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.566857 11863 ts_tablet_manager.cc:1434] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:22:19.548018 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:19.557349 11965 raft_consensus.cc:493] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.560364 11702 leader_election.cc:304] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:19.569613 11863 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:19.567025 11857 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:19.591333 11965 raft_consensus.cc:515] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.597208 11929 raft_consensus.cc:493] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.601763 11915 consensus_queue.cc:1048] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.601904 11865 raft_consensus.cc:2804] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.603140 11865 raft_consensus.cc:493] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.603772 11865 raft_consensus.cc:3060] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.599921 11589 raft_consensus.cc:2468] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:19.598714 11929 raft_consensus.cc:515] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.619508 11929 leader_election.cc:290] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:19.627035 11965 leader_election.cc:290] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:19.627817 11952 raft_consensus.cc:493] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.629256 11952 raft_consensus.cc:515] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.629930 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:19.633126 11630 leader_election.cc:343] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.634902 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d8d45c6521413ab41e0897d088fe75" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:19.636211 11739 raft_consensus.cc:2468] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:19.638525 11778 leader_election.cc:304] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:19.639037 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d8d45c6521413ab41e0897d088fe75" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:19.640259 11967 raft_consensus.cc:2804] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.640450 11664 raft_consensus.cc:2468] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:19.640895 11967 raft_consensus.cc:493] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.641430 11967 raft_consensus.cc:3060] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.647570 11952 leader_election.cc:290] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:19.653306 11858 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:19.654565 11858 ts_tablet_manager.cc:1403] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.197s	user 0.028s	sys 0.038s
I20260709 13:22:19.653306 11859 tablet_bootstrap.cc:492] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:19.667330 11912 raft_consensus.cc:515] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.669149 11810 raft_consensus.cc:2393] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 01c914cf532f4dc19c1bab3514524ac2 in this term.
I20260709 13:22:19.671343 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:19.672904 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:19.673770 11589 raft_consensus.cc:2468] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:19.675822 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:19.677453 11912 leader_election.cc:290] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.677875 11863 tablet_bootstrap.cc:654] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.678953 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:19.684121 11589 raft_consensus.cc:3060] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:19.680044 11555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 62035.8us
I20260709 13:22:19.679632 11967 raft_consensus.cc:515] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.688773 11664 raft_consensus.cc:2468] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:19.696940 11813 raft_consensus.cc:3060] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.704469 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:19.715279 11555 leader_election.cc:343] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.672966 11865 raft_consensus.cc:515] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.717696 11739 raft_consensus.cc:2393] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:19.721352 11967 leader_election.cc:290] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:19.731194 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d8d45c6521413ab41e0897d088fe75" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:19.734422 11664 raft_consensus.cc:3060] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.735759 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:19.732148 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d8d45c6521413ab41e0897d088fe75" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:19.733635 11865 leader_election.cc:290] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.739331 11810 raft_consensus.cc:2393] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 01c914cf532f4dc19c1bab3514524ac2 in this term.
I20260709 13:22:19.742277 11859 ts_tablet_manager.cc:1403] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.320s	user 0.024s	sys 0.001s
I20260709 13:22:19.744429 12011 consensus_queue.cc:1048] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.744834 11553 leader_election.cc:304] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.738526 11737 raft_consensus.cc:3060] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.748010 12010 raft_consensus.cc:2804] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.748494 12010 raft_consensus.cc:493] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.748862 12010 raft_consensus.cc:3060] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.753142 11858 raft_consensus.cc:359] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.754161 11858 raft_consensus.cc:385] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.754546 11858 raft_consensus.cc:740] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.758044 11628 leader_election.cc:304] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.760033 11965 raft_consensus.cc:2804] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.760577 11965 raft_consensus.cc:493] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.755450 11858 consensus_queue.cc:260] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.761010 11965 raft_consensus.cc:3060] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.772176 11857 tablet_bootstrap.cc:654] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.774952 11863 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:19.780913 11967 consensus_queue.cc:1048] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.783175 11858 ts_tablet_manager.cc:1434] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.004s
I20260709 13:22:19.788658 11863 ts_tablet_manager.cc:1403] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.220s	user 0.020s	sys 0.010s
I20260709 13:22:19.793146 11859 raft_consensus.cc:359] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.794411 11859 raft_consensus.cc:385] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.794807 11859 raft_consensus.cc:740] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.795532 11863 raft_consensus.cc:359] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.797006 11863 raft_consensus.cc:385] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.796593 11859 consensus_queue.cc:260] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.791181 11858 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:19.797453 11863 raft_consensus.cc:740] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.800477 11859 ts_tablet_manager.cc:1434] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.001s
I20260709 13:22:19.816004 11859 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:19.788798 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:19.787415 11965 raft_consensus.cc:515] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.804260 11589 raft_consensus.cc:2468] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:19.819320 11664 raft_consensus.cc:2468] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:19.820303 11702 leader_election.cc:304] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
W20260709 13:22:19.810873 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:19.811936 11737 raft_consensus.cc:2468] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:19.824836 11953 consensus_queue.cc:1048] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:19.825578 11778 leader_election.cc:304] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:19.826687 11967 raft_consensus.cc:2804] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.827487 11967 raft_consensus.cc:697] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:19.824877 11865 raft_consensus.cc:2749] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.829130 11967 consensus_queue.cc:237] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:19.832073 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:19.832935 11965 leader_election.cc:290] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:19.833770 11859 tablet_bootstrap.cc:654] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.782371 12010 raft_consensus.cc:515] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.823197 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:19.823166 11776 leader_election.cc:304] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.837234 11589 raft_consensus.cc:2393] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:19.837532 11952 raft_consensus.cc:2804] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.838361 11952 raft_consensus.cc:697] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:19.839654 11952 consensus_queue.cc:237] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:19.843895 11630 leader_election.cc:343] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.844362 12010 leader_election.cc:290] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:19.844703 11630 leader_election.cc:304] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.851032 11965 raft_consensus.cc:2749] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.850584 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:19.853003 11665 raft_consensus.cc:2393] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:19.857744 11858 tablet_bootstrap.cc:654] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.858227 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:19.862226 11863 consensus_queue.cc:260] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:19.870517 11555 leader_election.cc:343] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.883246 11863 ts_tablet_manager.cc:1434] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.002s
I20260709 13:22:19.885679 11857 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:19.886390 11857 ts_tablet_manager.cc:1403] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.321s	user 0.021s	sys 0.021s
I20260709 13:22:19.887079 11863 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:19.894733 11857 raft_consensus.cc:359] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.896016 11857 raft_consensus.cc:385] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.896449 11857 raft_consensus.cc:740] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.887852 11555 leader_election.cc:304] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.909863 12010 raft_consensus.cc:2749] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.912730 11859 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:19.913473 11859 ts_tablet_manager.cc:1403] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.006s
I20260709 13:22:19.916746 11863 tablet_bootstrap.cc:654] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.916383 11857 consensus_queue.cc:260] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.919176 11915 raft_consensus.cc:493] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.919826 11915 raft_consensus.cc:515] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.923408 11915 leader_election.cc:290] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.924894 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a9c38790c24ddebcc9556c8e2356ea" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:19.930240 11628 leader_election.cc:343] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.930409 11857 ts_tablet_manager.cc:1434] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 13:22:19.931021 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a9c38790c24ddebcc9556c8e2356ea" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:19.931815 11857 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:19.931928 11810 raft_consensus.cc:2468] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:19.933928 11630 leader_election.cc:304] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:19.935711 11915 raft_consensus.cc:2804] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.936223 11915 raft_consensus.cc:493] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.936689 11915 raft_consensus.cc:3060] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.938833 11859 raft_consensus.cc:359] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.940217 11859 raft_consensus.cc:385] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.940953 11859 raft_consensus.cc:740] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.942670 11857 tablet_bootstrap.cc:654] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.948658 11859 consensus_queue.cc:260] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:19.953229 11858 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:19.953915 11858 ts_tablet_manager.cc:1403] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.163s	user 0.014s	sys 0.009s
I20260709 13:22:19.962960 11863 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:19.963680 11863 ts_tablet_manager.cc:1403] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.015s
I20260709 13:22:19.965184 11859 ts_tablet_manager.cc:1434] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 13:22:19.966745 11859 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:19.967710 11915 raft_consensus.cc:515] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.968546 11952 raft_consensus.cc:493] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.969096 11952 raft_consensus.cc:515] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.971833 11952 leader_election.cc:290] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.972736 11952 raft_consensus.cc:493] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.973305 11952 raft_consensus.cc:515] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:19.974388 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaa30e70122417dbf41d98488d2528e" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:19.976223 11778 leader_election.cc:343] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.976634 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a9c38790c24ddebcc9556c8e2356ea" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
W20260709 13:22:19.978358 11628 leader_election.cc:343] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.979676 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaa30e70122417dbf41d98488d2528e" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:19.980515 11588 raft_consensus.cc:2468] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:19.980837 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a9c38790c24ddebcc9556c8e2356ea" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:19.981423 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:19.979696 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:19.981986 11915 leader_election.cc:290] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:19.983799 11778 leader_election.cc:343] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.984541 11859 tablet_bootstrap.cc:654] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.981575 11810 raft_consensus.cc:3060] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.985169 11858 raft_consensus.cc:359] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.981853 11952 leader_election.cc:290] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:19.977224 11863 raft_consensus.cc:359] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.988703 11858 raft_consensus.cc:385] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.988979 11863 raft_consensus.cc:385] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.989168 11858 raft_consensus.cc:740] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.989383 11863 raft_consensus.cc:740] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.990443 11863 consensus_queue.cc:260] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.981746 11776 leader_election.cc:304] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: d59c3f822e674346af71ca9a5d899c2e
W20260709 13:22:19.992453 11776 leader_election.cc:343] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.992969 11776 leader_election.cc:304] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:19.993883 11967 raft_consensus.cc:2804] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.994086 11953 raft_consensus.cc:2749] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.994324 11967 raft_consensus.cc:493] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.994536 11858 consensus_queue.cc:260] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:19.994789 11967 raft_consensus.cc:3060] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.997627 11858 ts_tablet_manager.cc:1434] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:22:20.002007 11858 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:20.007700 11857 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:20.008456 11857 ts_tablet_manager.cc:1403] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.008s
I20260709 13:22:20.010782 11488 catalog_manager.cc:5697] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:20.000625 11863 ts_tablet_manager.cc:1434] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.006s
I20260709 13:22:20.012147 11857 raft_consensus.cc:359] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.016970 11857 raft_consensus.cc:385] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.017410 11857 raft_consensus.cc:740] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.014331 11858 tablet_bootstrap.cc:654] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.018543 11863 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:20.020542 11915 raft_consensus.cc:493] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.021299 11915 raft_consensus.cc:515] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.022176 11857 consensus_queue.cc:260] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.026185 11915 leader_election.cc:290] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:20.026074 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ff1167f81242bd839fd9e4fc0b7196" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:20.028177 11630 leader_election.cc:343] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.025983 11954 raft_consensus.cc:493] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.029422 11857 ts_tablet_manager.cc:1434] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:22:20.029316 11954 raft_consensus.cc:515] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.029670 11488 catalog_manager.cc:5697] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.030843 11857 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:20.033485 11863 tablet_bootstrap.cc:654] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.036613 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:20.037770 11664 raft_consensus.cc:2468] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:20.038995 11967 raft_consensus.cc:515] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.041491 11967 leader_election.cc:290] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:20.042810 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaa30e70122417dbf41d98488d2528e" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:20.044137 11858 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
W20260709 13:22:20.045217 11778 leader_election.cc:343] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.047354 11702 leader_election.cc:304] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:20.047695 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaa30e70122417dbf41d98488d2528e" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:20.044720 11858 ts_tablet_manager.cc:1403] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.004s
I20260709 13:22:20.049957 11954 leader_election.cc:290] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:20.048600 11865 raft_consensus.cc:2804] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.051294 11865 raft_consensus.cc:493] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.051683 11865 raft_consensus.cc:3060] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.052910 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:20.048450 11588 raft_consensus.cc:3060] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:20.058326 11704 leader_election.cc:343] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.061023 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ff1167f81242bd839fd9e4fc0b7196" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:20.062032 11589 raft_consensus.cc:2468] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:20.063854 11628 leader_election.cc:304] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:20.065425 11965 raft_consensus.cc:2804] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.065858 11965 raft_consensus.cc:493] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.066234 11965 raft_consensus.cc:3060] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.052558 11858 raft_consensus.cc:359] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.077064 11858 raft_consensus.cc:385] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.080858 11810 raft_consensus.cc:2468] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:20.080931 11965 raft_consensus.cc:515] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.082913 11630 leader_election.cc:304] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:20.084300 11960 raft_consensus.cc:2804] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.075963 11865 raft_consensus.cc:515] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.084877 11960 raft_consensus.cc:697] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:20.085862 11960 consensus_queue.cc:237] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.086602 11857 tablet_bootstrap.cc:654] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.089175 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:20.089771 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:20.090009 11664 raft_consensus.cc:3060] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:20.091539 11704 leader_election.cc:343] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.092442 11865 leader_election.cc:290] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:20.077414 11858 raft_consensus.cc:740] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.093658 11858 consensus_queue.cc:260] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.097381 11588 raft_consensus.cc:2468] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:20.098982 11858 ts_tablet_manager.cc:1434] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:22:20.099159 11776 leader_election.cc:304] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:20.101148 11858 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:20.101773 11967 raft_consensus.cc:2804] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.102758 11967 raft_consensus.cc:697] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:20.105747 11967 consensus_queue.cc:237] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.107506 11859 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:20.108497 11859 ts_tablet_manager.cc:1403] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.142s	user 0.019s	sys 0.006s
I20260709 13:22:20.112282 11952 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.113057 11952 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.114007 11859 raft_consensus.cc:359] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.115127 11859 raft_consensus.cc:385] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.115492 11859 raft_consensus.cc:740] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.115856 11952 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:20.115968 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ff1167f81242bd839fd9e4fc0b7196" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:20.118197 11859 consensus_queue.cc:260] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.120565 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:20.122349 11630 leader_election.cc:343] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.122768 11863 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
W20260709 13:22:20.124469 11776 leader_election.cc:343] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.124876 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:20.126296 11863 ts_tablet_manager.cc:1403] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.003s
W20260709 13:22:20.132735 11776 leader_election.cc:343] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.133661 11776 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:20.117100 11664 raft_consensus.cc:2468] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:20.141556 11952 raft_consensus.cc:2749] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:20.146366 11863 raft_consensus.cc:359] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.148139 11863 raft_consensus.cc:385] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.148617 11863 raft_consensus.cc:740] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.156924 11965 leader_election.cc:290] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:20.156144 11863 consensus_queue.cc:260] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.162497 11863 ts_tablet_manager.cc:1434] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:22:20.163985 11863 tablet_bootstrap.cc:492] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:20.163530 11702 leader_election.cc:304] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:20.172488 11863 tablet_bootstrap.cc:654] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.172081 11954 raft_consensus.cc:2804] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.179339 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ff1167f81242bd839fd9e4fc0b7196" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:20.179970 11865 raft_consensus.cc:493] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.180855 11865 raft_consensus.cc:515] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.192387 11858 tablet_bootstrap.cc:654] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.192848 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:20.195395 11588 raft_consensus.cc:3060] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.195456 11665 raft_consensus.cc:2393] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:20.184062 11865 leader_election.cc:290] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:20.200616 11859 ts_tablet_manager.cc:1434] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.092s	user 0.012s	sys 0.000s
I20260709 13:22:20.211002 12011 raft_consensus.cc:493] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.230549 11859 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:20.233191 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:20.236765 11589 raft_consensus.cc:2393] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:20.215224 12011 raft_consensus.cc:515] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.243853 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a9c38790c24ddebcc9556c8e2356ea" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:20.244937 11810 raft_consensus.cc:2393] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:20.246680 11863 tablet_bootstrap.cc:492] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:20.247372 11863 ts_tablet_manager.cc:1403] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.007s
I20260709 13:22:20.253185 12011 leader_election.cc:290] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:20.254884 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a9c38790c24ddebcc9556c8e2356ea" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:20.257050 11553 leader_election.cc:304] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:20.257642 11857 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:20.258286 11857 ts_tablet_manager.cc:1403] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.228s	user 0.016s	sys 0.002s
I20260709 13:22:20.258917 12011 raft_consensus.cc:3060] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.263229 11588 raft_consensus.cc:2468] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:20.263082 11857 raft_consensus.cc:359] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.234145 11954 raft_consensus.cc:697] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:20.241394 11487 catalog_manager.cc:5697] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:20.265131 11628 leader_election.cc:304] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:20.267678 11965 raft_consensus.cc:2804] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.268266 11965 raft_consensus.cc:697] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:20.268002 11954 consensus_queue.cc:237] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.269292 11965 consensus_queue.cc:237] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.264189 11857 raft_consensus.cc:385] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.271890 11857 raft_consensus.cc:740] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.275725 11859 tablet_bootstrap.cc:654] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.274950 11967 consensus_queue.cc:1048] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.281116 11858 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:20.282109 11858 ts_tablet_manager.cc:1403] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.003s
I20260709 13:22:20.283104 11857 consensus_queue.cc:260] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.286434 11857 ts_tablet_manager.cc:1434] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:22:20.289512 12011 raft_consensus.cc:2749] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:20.290187 11857 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:20.295370 11863 raft_consensus.cc:359] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.296288 11863 raft_consensus.cc:385] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.296612 11863 raft_consensus.cc:740] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.296676 11702 leader_election.cc:304] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:20.297572 11863 consensus_queue.cc:260] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.299638 11952 consensus_queue.cc:1048] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.300323 11863 ts_tablet_manager.cc:1434] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:22:20.303256 11865 raft_consensus.cc:3060] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.294621 11858 raft_consensus.cc:359] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.306008 11857 tablet_bootstrap.cc:654] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.305186 11863 tablet_bootstrap.cc:492] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:20.303349 12035 raft_consensus.cc:493] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.309525 11858 raft_consensus.cc:385] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.310156 11858 raft_consensus.cc:740] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.315028 11858 consensus_queue.cc:260] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.310698 11952 raft_consensus.cc:493] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.324415 11952 raft_consensus.cc:515] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.349328 11858 ts_tablet_manager.cc:1434] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.067s	user 0.011s	sys 0.000s
I20260709 13:22:20.351087 11858 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:20.317507 12035 raft_consensus.cc:515] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.356707 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaa30e70122417dbf41d98488d2528e" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:20.365247 11952 leader_election.cc:290] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:20.369099 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:20.368136 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaa30e70122417dbf41d98488d2528e" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:20.372743 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:20.380501 11859 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:20.381140 11859 ts_tablet_manager.cc:1403] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.027s
I20260709 13:22:20.381763 12011 raft_consensus.cc:493] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.382365 12011 raft_consensus.cc:515] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:20.377837 11778 leader_election.cc:343] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.379439 11588 raft_consensus.cc:2393] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 01c914cf532f4dc19c1bab3514524ac2 in this term.
I20260709 13:22:20.383796 12035 leader_election.cc:290] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:20.384986 12011 leader_election.cc:290] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:20.385272 11859 raft_consensus.cc:359] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.386335 11859 raft_consensus.cc:385] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.386701 11859 raft_consensus.cc:740] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
W20260709 13:22:20.385828 11776 leader_election.cc:343] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.387733 11859 consensus_queue.cc:260] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.389496 11776 leader_election.cc:304] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:20.388221 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:20.392217 11952 raft_consensus.cc:2749] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:20.394119 11555 leader_election.cc:343] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.394042 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:20.397962 11813 raft_consensus.cc:2468] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:20.398783 11865 raft_consensus.cc:2749] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:20.399235 11702 leader_election.cc:304] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:20.399843 11555 leader_election.cc:304] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:20.400550 11857 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:20.401664 11857 ts_tablet_manager.cc:1403] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.112s	user 0.022s	sys 0.008s
I20260709 13:22:20.402300 11965 raft_consensus.cc:493] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.403249 11859 ts_tablet_manager.cc:1434] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:22:20.402864 11965 raft_consensus.cc:515] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.404654 11859 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:20.401031 11865 raft_consensus.cc:3060] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.404711 12011 raft_consensus.cc:2804] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.407907 12011 raft_consensus.cc:493] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.408624 12011 raft_consensus.cc:3060] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.418257 11953 raft_consensus.cc:493] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.419103 11953 raft_consensus.cc:515] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.419143 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:20.424695 11588 raft_consensus.cc:2468] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:20.427469 11628 leader_election.cc:304] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:20.429358 11960 raft_consensus.cc:2804] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.429908 11960 raft_consensus.cc:493] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.430322 11960 raft_consensus.cc:3060] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.439447 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e8930dda4e488d9427d8e6e487f4ab" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:20.418430 11965 leader_election.cc:290] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:20.443308 11858 tablet_bootstrap.cc:654] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.448266 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:20.450435 11630 leader_election.cc:343] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.434840 11953 leader_election.cc:290] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:20.439471 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e8930dda4e488d9427d8e6e487f4ab" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:20.456826 11863 tablet_bootstrap.cc:654] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.466101 11859 tablet_bootstrap.cc:654] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.479246 11857 raft_consensus.cc:359] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.504510 11857 raft_consensus.cc:385] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.505002 11857 raft_consensus.cc:740] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.518240 11857 consensus_queue.cc:260] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.520605 11965 raft_consensus.cc:493] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.524682 11965 raft_consensus.cc:515] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.530233 11865 raft_consensus.cc:2749] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:20.530607 11776 leader_election.cc:343] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:20.538628 11776 leader_election.cc:343] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.538954 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:20.539120 11776 leader_election.cc:304] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:20.539296 11857 ts_tablet_manager.cc:1434] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.000s
I20260709 13:22:20.540308 11953 raft_consensus.cc:2749] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:20.541235 11857 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
W20260709 13:22:20.541630 11630 leader_election.cc:343] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.544585 11915 consensus_queue.cc:1048] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.548400 11953 consensus_queue.cc:1048] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.554076 11863 tablet_bootstrap.cc:492] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:20.554807 11863 ts_tablet_manager.cc:1403] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.250s	user 0.019s	sys 0.012s
I20260709 13:22:20.546554 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:20.536952 11965 leader_election.cc:290] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:20.566601 11965 consensus_queue.cc:1048] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:20.570595 11628 leader_election.cc:343] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.571344 11628 leader_election.cc:304] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:20.573112 11965 raft_consensus.cc:2749] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:20.577235 12049 consensus_queue.cc:1048] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.574376 11960 raft_consensus.cc:515] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.581288 11858 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:20.584008 11858 ts_tablet_manager.cc:1403] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.233s	user 0.018s	sys 0.001s
I20260709 13:22:20.572201 12011 raft_consensus.cc:515] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.600863 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
W20260709 13:22:20.603861 11555 leader_election.cc:343] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.610618 11858 raft_consensus.cc:359] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.618643 11858 raft_consensus.cc:385] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.619154 11858 raft_consensus.cc:740] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.622402 11859 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:20.621913 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:20.623127 11859 ts_tablet_manager.cc:1403] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.023s
I20260709 13:22:20.623756 11812 raft_consensus.cc:3060] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.620321 11858 consensus_queue.cc:260] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.632082 11858 ts_tablet_manager.cc:1434] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:22:20.617767 12011 leader_election.cc:290] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:20.642544 11859 raft_consensus.cc:359] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.643499 11859 raft_consensus.cc:385] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.643792 11859 raft_consensus.cc:740] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.644701 11960 leader_election.cc:290] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:20.650338 11863 raft_consensus.cc:359] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.651489 11863 raft_consensus.cc:385] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.651829 11863 raft_consensus.cc:740] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.653189 11858 tablet_bootstrap.cc:492] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:20.654114 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:20.656147 11859 consensus_queue.cc:260] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.658847 11859 ts_tablet_manager.cc:1434] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:22:20.660211 11960 raft_consensus.cc:493] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.660876 11960 raft_consensus.cc:515] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.662967 11857 tablet_bootstrap.cc:654] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.666069 11960 leader_election.cc:290] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:20.666417 11630 leader_election.cc:343] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.667080 12035 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.667687 11953 consensus_queue.cc:1048] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.670334 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:20.668212 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e8930dda4e488d9427d8e6e487f4ab" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:20.666136 11487 catalog_manager.cc:5697] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:20.675186 11859 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:20.673454 11863 consensus_queue.cc:260] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.678018 11587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e8930dda4e488d9427d8e6e487f4ab" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:20.676414 11590 raft_consensus.cc:3060] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.680773 11813 raft_consensus.cc:2468] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:20.670567 11484 catalog_manager.cc:5697] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.682905 11630 leader_election.cc:304] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
W20260709 13:22:20.685369 11628 leader_election.cc:343] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.697283 11858 tablet_bootstrap.cc:654] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.696692 12049 consensus_queue.cc:1048] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.676129 12035 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.707811 11590 raft_consensus.cc:2468] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
W20260709 13:22:20.710778 11704 consensus_peers.cc:597] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e -> Peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Couldn't send request to peer 01c914cf532f4dc19c1bab3514524ac2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.711256 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:20.713586 11857 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:20.715412 11960 raft_consensus.cc:2804] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.716331 11960 raft_consensus.cc:493] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.707180 12035 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:20.713093 11704 leader_election.cc:343] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.722926 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:20.725870 11702 leader_election.cc:343] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.726485 11702 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:20.728430 11863 ts_tablet_manager.cc:1434] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.173s	user 0.014s	sys 0.000s
I20260709 13:22:20.728575 11628 leader_election.cc:304] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:20.729075 11812 raft_consensus.cc:2468] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:20.730453 11954 raft_consensus.cc:2749] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:20.730890 12056 raft_consensus.cc:2804] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.731416 12056 raft_consensus.cc:697] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:20.734437 11555 leader_election.cc:304] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:20.735735 12064 raft_consensus.cc:2804] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.736858 12064 raft_consensus.cc:697] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:20.738030 12064 consensus_queue.cc:237] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.739737 12035 consensus_queue.cc:1048] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.736003 11960 raft_consensus.cc:3060] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.744935 12056 consensus_queue.cc:237] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.752822 11857 ts_tablet_manager.cc:1403] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.212s	user 0.011s	sys 0.007s
I20260709 13:22:20.760753 11863 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:20.765532 11857 raft_consensus.cc:359] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.766491 11857 raft_consensus.cc:385] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.766963 11857 raft_consensus.cc:740] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.774624 12062 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.775439 12062 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.776989 11857 consensus_queue.cc:260] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.779650 11857 ts_tablet_manager.cc:1434] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:22:20.785807 11857 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:20.780975 11960 raft_consensus.cc:515] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.781728 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:20.788973 11739 raft_consensus.cc:2468] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:20.791260 11555 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:20.782439 12062 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:20.782701 11859 tablet_bootstrap.cc:654] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.783365 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:20.794890 11553 leader_election.cc:343] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.795820 12062 raft_consensus.cc:2804] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.796389 12062 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.791501 11485 catalog_manager.cc:5697] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.807065 11863 tablet_bootstrap.cc:654] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.796821 12062 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.808377 11965 consensus_queue.cc:1048] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.809587 11857 tablet_bootstrap.cc:654] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:20.813282 11630 consensus_peers.cc:597] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Couldn't send request to peer 01c914cf532f4dc19c1bab3514524ac2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.846448 11960 leader_election.cc:290] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:20.851464 11858 tablet_bootstrap.cc:492] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:20.853145 11858 ts_tablet_manager.cc:1403] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.218s	user 0.012s	sys 0.013s
I20260709 13:22:20.883188 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e8930dda4e488d9427d8e6e487f4ab" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:20.884032 11811 raft_consensus.cc:3060] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.887774 11858 raft_consensus.cc:359] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.901306 11858 raft_consensus.cc:385] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.901583 11858 raft_consensus.cc:740] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.903365 11858 consensus_queue.cc:260] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:20.910243 11863 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:20.911309 11863 ts_tablet_manager.cc:1403] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.182s	user 0.020s	sys 0.016s
I20260709 13:22:20.910202 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e8930dda4e488d9427d8e6e487f4ab" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:20.919081 12062 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:20.919869 11590 raft_consensus.cc:3060] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.911556 11485 catalog_manager.cc:5697] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:20.927583 12062 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:20.928733 11857 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:20.928894 11859 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:20.929364 11859 ts_tablet_manager.cc:1403] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.269s	user 0.013s	sys 0.019s
I20260709 13:22:20.930886 11863 raft_consensus.cc:359] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.931753 11863 raft_consensus.cc:385] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.932025 11863 raft_consensus.cc:740] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.932858 11859 raft_consensus.cc:359] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.932943 11863 consensus_queue.cc:260] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:20.933732 11859 raft_consensus.cc:385] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.934201 11859 raft_consensus.cc:740] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.929342 11857 ts_tablet_manager.cc:1403] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.015s
I20260709 13:22:20.936956 11863 ts_tablet_manager.cc:1434] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:22:20.938117 11863 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:20.938722 11858 ts_tablet_manager.cc:1434] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
W20260709 13:22:20.940987 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:20.942020 11858 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:20.934913 11859 consensus_queue.cc:260] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.947503 11859 ts_tablet_manager.cc:1434] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:22:20.949532 11859 tablet_bootstrap.cc:492] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:20.927078 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:20.951843 11737 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.951596 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:20.938946 11857 raft_consensus.cc:359] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.953276 11857 raft_consensus.cc:385] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.953615 11857 raft_consensus.cc:740] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.955015 11811 raft_consensus.cc:2468] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:20.957046 11630 leader_election.cc:304] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:20.957901 11858 tablet_bootstrap.cc:654] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.959334 11863 tablet_bootstrap.cc:654] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.961226 12056 raft_consensus.cc:2804] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.961848 12056 raft_consensus.cc:697] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:20.962841 12056 consensus_queue.cc:237] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:20.967221 11553 leader_election.cc:343] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.965456 11590 raft_consensus.cc:2468] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:20.960727 11857 consensus_queue.cc:260] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.974661 11857 ts_tablet_manager.cc:1434] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.005s
I20260709 13:22:20.974942 11859 tablet_bootstrap.cc:654] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.976219 11857 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:20.980034 11858 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:20.980926 11858 ts_tablet_manager.cc:1403] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.000s
I20260709 13:22:20.982527 11486 catalog_manager.cc:5697] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:20.994719 11737 raft_consensus.cc:2468] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:20.996542 11555 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:20.997536 12064 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.998154 12063 raft_consensus.cc:2804] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.998055 12064 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:20.998768 12063 raft_consensus.cc:697] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:21.000001 12063 consensus_queue.cc:237] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.001536 12064 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:21.004822 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.005733 11737 raft_consensus.cc:2468] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:20.989305 11858 raft_consensus.cc:359] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.007632 11555 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:21.004827 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:21.011548 12062 raft_consensus.cc:2804] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:21.012001 11555 leader_election.cc:343] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.012094 12062 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.014307 12062 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.008505 11858 raft_consensus.cc:385] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.014752 11858 raft_consensus.cc:740] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.014920 11863 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:21.015607 11863 ts_tablet_manager.cc:1403] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.007s
I20260709 13:22:21.016937 11858 consensus_queue.cc:260] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.030205 11858 ts_tablet_manager.cc:1434] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:22:21.023789 11863 raft_consensus.cc:359] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.032121 11863 raft_consensus.cc:385] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.035003 11863 raft_consensus.cc:740] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.047884 11857 tablet_bootstrap.cc:654] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.051903 11858 tablet_bootstrap.cc:492] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:21.061381 11863 consensus_queue.cc:260] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.066493 11485 catalog_manager.cc:5697] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.074150 11859 tablet_bootstrap.cc:492] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:21.074977 11859 ts_tablet_manager.cc:1403] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.126s	user 0.017s	sys 0.011s
I20260709 13:22:21.075994 11487 catalog_manager.cc:5697] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:21.078642 11859 raft_consensus.cc:359] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.079622 11859 raft_consensus.cc:385] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.079901 11859 raft_consensus.cc:740] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.081655 12062 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.087090 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:21.087870 11737 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.087872 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
W20260709 13:22:21.092808 11555 leader_election.cc:343] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.094013 11863 ts_tablet_manager.cc:1434] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.000s
I20260709 13:22:21.095213 11857 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:21.086316 12062 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:21.095943 11857 ts_tablet_manager.cc:1403] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.010s
I20260709 13:22:21.095296 11863 tablet_bootstrap.cc:492] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:21.096462 11859 consensus_queue.cc:260] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.099004 11859 ts_tablet_manager.cc:1434] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:22:21.100082 11858 tablet_bootstrap.cc:654] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.103024 11953 raft_consensus.cc:493] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.103905 11863 tablet_bootstrap.cc:654] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.103644 11953 raft_consensus.cc:515] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.104367 11859 tablet_bootstrap.cc:492] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:21.106763 11953 leader_election.cc:290] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:21.107906 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.112040 11857 raft_consensus.cc:359] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.108752 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:21.115623 11857 raft_consensus.cc:385] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.116153 11857 raft_consensus.cc:740] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.120213 11857 consensus_queue.cc:260] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.121081 11776 leader_election.cc:304] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:21.122071 11953 raft_consensus.cc:2749] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.125505 11737 raft_consensus.cc:2468] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:21.127391 11555 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:21.128834 11954 raft_consensus.cc:493] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.129457 11954 raft_consensus.cc:515] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.132606 12062 raft_consensus.cc:2804] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.133330 12062 raft_consensus.cc:697] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:21.134325 12062 consensus_queue.cc:237] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.139299 11857 ts_tablet_manager.cc:1434] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.005s
I20260709 13:22:21.140924 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:21.141778 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:21.142534 11857 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:21.142875 11811 raft_consensus.cc:2393] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:21.145566 11704 leader_election.cc:304] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:21.146559 12035 raft_consensus.cc:3060] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.147467 11858 tablet_bootstrap.cc:492] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:21.148000 11858 ts_tablet_manager.cc:1403] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.106s	user 0.040s	sys 0.009s
I20260709 13:22:21.151132 11858 raft_consensus.cc:359] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.151914 11858 raft_consensus.cc:385] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.146637 11954 leader_election.cc:290] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:21.152173 11858 raft_consensus.cc:740] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.157174 11859 tablet_bootstrap.cc:654] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.156996 11487 catalog_manager.cc:5697] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:21.156927 12056 consensus_queue.cc:1048] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.159576 12035 raft_consensus.cc:2749] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.164942 11859 tablet_bootstrap.cc:492] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:21.165791 11859 ts_tablet_manager.cc:1403] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.001s
I20260709 13:22:21.168574 12062 raft_consensus.cc:493] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.169373 12062 raft_consensus.cc:515] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.169700 11859 raft_consensus.cc:359] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.172668 11859 raft_consensus.cc:385] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.172979 11859 raft_consensus.cc:740] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.172930 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290688edb81143ac8abfb02f7060a88a" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:21.173801 11863 tablet_bootstrap.cc:492] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:21.174341 11863 ts_tablet_manager.cc:1403] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.006s
I20260709 13:22:21.174139 11859 consensus_queue.cc:260] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
W20260709 13:22:21.175117 11553 leader_election.cc:343] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.177902 11863 raft_consensus.cc:359] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.178800 11863 raft_consensus.cc:385] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.179073 11863 raft_consensus.cc:740] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.179852 11863 consensus_queue.cc:260] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.182430 11811 raft_consensus.cc:3060] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.184477 11857 tablet_bootstrap.cc:654] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.187041 11863 ts_tablet_manager.cc:1434] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:22:21.188563 11863 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:21.189205 11960 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.189847 11960 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.193569 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.194497 11737 raft_consensus.cc:2393] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:21.196431 11960 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:21.197167 11863 tablet_bootstrap.cc:654] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.198345 11859 ts_tablet_manager.cc:1434] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:22:21.200603 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:21.206408 11859 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:21.208421 12056 consensus_queue.cc:1048] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.212750 11628 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:21.218472 12056 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.221588 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290688edb81143ac8abfb02f7060a88a" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.227309 12062 leader_election.cc:290] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:21.228019 11555 leader_election.cc:343] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.228832 11555 leader_election.cc:304] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:21.229693 11857 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:21.229885 12063 raft_consensus.cc:2749] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.230422 11857 ts_tablet_manager.cc:1403] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.005s
I20260709 13:22:21.234141 11812 raft_consensus.cc:3060] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.158535 11858 consensus_queue.cc:260] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.250972 12062 consensus_queue.cc:1048] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.252302 11813 raft_consensus.cc:3060] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.252749 11857 raft_consensus.cc:359] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.253567 11857 raft_consensus.cc:385] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.253881 11857 raft_consensus.cc:740] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.256821 11915 raft_consensus.cc:493] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.257515 11915 raft_consensus.cc:515] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.260289 11915 leader_election.cc:290] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:21.262702 12056 raft_consensus.cc:2749] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.269905 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:21.278821 11810 raft_consensus.cc:2468] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:21.277133 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.281498 11739 raft_consensus.cc:2468] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:21.283031 11630 leader_election.cc:304] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:21.285985 11915 raft_consensus.cc:2804] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.286634 11915 raft_consensus.cc:493] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.287696 11915 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.290414 11859 tablet_bootstrap.cc:654] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.266140 11857 consensus_queue.cc:260] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.296042 11857 ts_tablet_manager.cc:1434] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 13:22:21.296917 11858 ts_tablet_manager.cc:1434] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.149s	user 0.009s	sys 0.000s
I20260709 13:22:21.299330 11857 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:21.311684 11863 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:21.312605 11863 ts_tablet_manager.cc:1403] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.124s	user 0.025s	sys 0.009s
I20260709 13:22:21.316094 11863 raft_consensus.cc:359] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.317986 11863 raft_consensus.cc:385] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.318372 11863 raft_consensus.cc:740] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.319183 11863 consensus_queue.cc:260] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.321133 11858 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:21.321586 11863 ts_tablet_manager.cc:1434] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:21.322849 11863 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:21.333158 11863 tablet_bootstrap.cc:654] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.327294 11915 raft_consensus.cc:515] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.350822 12010 consensus_queue.cc:1048] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.356381 11857 tablet_bootstrap.cc:654] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.359622 12010 raft_consensus.cc:493] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.360399 12010 raft_consensus.cc:515] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.363811 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:21.359897 11858 tablet_bootstrap.cc:654] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.372892 11915 leader_election.cc:290] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:21.366402 11663 raft_consensus.cc:2468] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:21.381896 11553 leader_election.cc:304] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:21.383834 12011 raft_consensus.cc:2804] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.384536 12011 raft_consensus.cc:493] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.385057 12011 raft_consensus.cc:3060] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.382786 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:21.383054 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:21.396759 11737 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.404599 11812 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.409255 12010 leader_election.cc:290] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:21.410794 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.414835 11915 consensus_queue.cc:1048] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:21.416098 11555 leader_election.cc:343] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.452327 11859 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:21.453089 11859 ts_tablet_manager.cc:1403] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.247s	user 0.024s	sys 0.020s
I20260709 13:22:21.459790 11737 raft_consensus.cc:2468] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:21.460083 12011 raft_consensus.cc:515] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.461464 11630 leader_election.cc:304] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:21.462738 11863 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:21.463397 11863 ts_tablet_manager.cc:1403] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.141s	user 0.024s	sys 0.012s
I20260709 13:22:21.463861 11960 raft_consensus.cc:2804] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.464493 11960 raft_consensus.cc:697] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:21.465435 11960 consensus_queue.cc:237] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.466253 11857 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:21.467346 11863 raft_consensus.cc:359] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.468104 11863 raft_consensus.cc:385] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.468317 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:21.462677 12011 leader_election.cc:290] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:21.470525 11555 leader_election.cc:343] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.470404 11859 raft_consensus.cc:359] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.471168 11859 raft_consensus.cc:385] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.471103 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:21.471555 11859 raft_consensus.cc:740] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.471872 11663 raft_consensus.cc:3060] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.476444 11812 raft_consensus.cc:2468] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:21.477777 11857 ts_tablet_manager.cc:1403] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.181s	user 0.040s	sys 0.024s
I20260709 13:22:21.478307 11915 raft_consensus.cc:493] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.478906 11915 raft_consensus.cc:515] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.472244 11859 consensus_queue.cc:260] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.481564 11857 raft_consensus.cc:359] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.482477 11857 raft_consensus.cc:385] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.477458 12056 consensus_queue.cc:1048] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.468389 11863 raft_consensus.cc:740] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.484290 11859 ts_tablet_manager.cc:1434] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:22:21.482815 11857 raft_consensus.cc:740] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.482633 11915 leader_election.cc:290] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:21.499922 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11338158fbbd4a72bb1c7f9375a25d6a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:21.500882 11813 raft_consensus.cc:2468] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:21.503485 11630 leader_election.cc:304] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:21.505865 11965 raft_consensus.cc:2804] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.506361 11965 raft_consensus.cc:493] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.506703 11965 raft_consensus.cc:3060] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.514456 12056 raft_consensus.cc:493] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.515403 12056 raft_consensus.cc:515] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.518548 11863 consensus_queue.cc:260] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.522256 11863 ts_tablet_manager.cc:1434] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:22:21.523020 11858 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:21.523713 11858 ts_tablet_manager.cc:1403] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.203s	user 0.009s	sys 0.010s
I20260709 13:22:21.527424 12056 leader_election.cc:290] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:21.528246 11858 raft_consensus.cc:359] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.529711 11858 raft_consensus.cc:385] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.530246 11858 raft_consensus.cc:740] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.531258 11863 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:21.533674 11858 consensus_queue.cc:260] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.536293 11859 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:21.495579 11857 consensus_queue.cc:260] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.556994 11857 ts_tablet_manager.cc:1434] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.002s
I20260709 13:22:21.504161 11663 raft_consensus.cc:2468] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:21.566546 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11338158fbbd4a72bb1c7f9375a25d6a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.568378 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.581168 11965 raft_consensus.cc:515] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.594159 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:21.602986 11858 ts_tablet_manager.cc:1434] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.001s
I20260709 13:22:21.599822 11737 raft_consensus.cc:2468] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:21.605736 11589 raft_consensus.cc:2468] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:21.601400 11736 raft_consensus.cc:2468] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:21.613546 11553 leader_election.cc:304] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:21.613735 11965 leader_election.cc:290] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:21.614449 11628 leader_election.cc:304] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:21.615146 12010 raft_consensus.cc:2804] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.615731 12010 raft_consensus.cc:697] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:21.617219 12010 consensus_queue.cc:237] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.625317 12063 consensus_queue.cc:1048] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.626513 11859 tablet_bootstrap.cc:654] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.626221 12011 consensus_queue.cc:1048] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.628770 11857 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:21.630263 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11338158fbbd4a72bb1c7f9375a25d6a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:21.631923 11736 raft_consensus.cc:3060] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.637131 11915 raft_consensus.cc:2804] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:21.637872 11915 raft_consensus.cc:493] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.638229 11915 raft_consensus.cc:3060] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.635277 11487 catalog_manager.cc:5697] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.644914 11813 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.656844 11736 raft_consensus.cc:2468] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:21.659062 11630 leader_election.cc:304] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:21.660926 11858 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:21.662567 12056 raft_consensus.cc:2804] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.663228 12056 raft_consensus.cc:697] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:21.665505 12056 consensus_queue.cc:237] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:21.669906 12010 consensus_queue.cc:1048] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.678680 12010 consensus_queue.cc:1048] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.671624 11486 catalog_manager.cc:5697] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.686539 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11338158fbbd4a72bb1c7f9375a25d6a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:21.687793 11811 raft_consensus.cc:3060] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.691049 11915 raft_consensus.cc:515] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.692541 11953 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.693157 11953 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.695936 11953 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:21.676260 11863 tablet_bootstrap.cc:654] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.683436 11857 tablet_bootstrap.cc:654] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.708276 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:21.709170 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:21.717437 11776 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:21.720494 11858 tablet_bootstrap.cc:654] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.730377 11954 raft_consensus.cc:493] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.731630 11954 raft_consensus.cc:515] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.737851 12010 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.743881 11859 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:21.744861 11859 ts_tablet_manager.cc:1403] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.214s	user 0.027s	sys 0.006s
I20260709 13:22:21.747695 11953 raft_consensus.cc:2749] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:21.742444 12010 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.750095 12010 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:21.752801 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:21.751042 11954 leader_election.cc:290] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:21.752965 11915 leader_election.cc:290] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:21.756404 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:21.764231 11811 raft_consensus.cc:2468] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:21.766595 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:21.767484 11813 raft_consensus.cc:2468] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:21.767731 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:21.768755 11736 raft_consensus.cc:3060] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.759761 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15a85cd24ff436eaa26a81455d6c7fa" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:21.770072 11590 raft_consensus.cc:3060] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.773942 11555 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:21.775168 12064 raft_consensus.cc:2804] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.775594 12064 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.775918 12064 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:21.777057 11553 leader_election.cc:343] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.779172 11859 raft_consensus.cc:359] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.780045 11859 raft_consensus.cc:385] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.780315 11859 raft_consensus.cc:740] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.768440 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:21.782251 11663 raft_consensus.cc:2393] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:21.781873 11859 consensus_queue.cc:260] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.785949 11702 leader_election.cc:304] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:21.787513 12111 raft_consensus.cc:3060] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.797322 11859 ts_tablet_manager.cc:1434] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.004s
I20260709 13:22:21.807483 11863 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:21.811234 11863 ts_tablet_manager.cc:1403] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.288s	user 0.025s	sys 0.000s
I20260709 13:22:21.807978 11857 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:21.801503 12064 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.812090 11857 ts_tablet_manager.cc:1403] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.201s	user 0.015s	sys 0.015s
I20260709 13:22:21.817857 11858 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:21.818670 11858 ts_tablet_manager.cc:1403] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.158s	user 0.019s	sys 0.012s
I20260709 13:22:21.820751 11859 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:21.822078 11736 raft_consensus.cc:2468] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:21.823999 11630 leader_election.cc:304] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:21.825089 11915 raft_consensus.cc:2804] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:21.825652 11915 raft_consensus.cc:697] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:21.826644 11915 consensus_queue.cc:237] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.828467 12111 raft_consensus.cc:2749] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.829443 12064 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:21.830129 11590 raft_consensus.cc:2468] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:21.831882 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:21.832574 11811 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.837138 11859 tablet_bootstrap.cc:654] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.843804 11967 raft_consensus.cc:493] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.844962 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:21.870796 11858 raft_consensus.cc:359] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.872011 11858 raft_consensus.cc:385] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.880556 11858 raft_consensus.cc:740] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.845091 11967 raft_consensus.cc:515] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.911352 11967 leader_election.cc:290] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:21.914042 11863 raft_consensus.cc:359] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.913853 11662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:21.914963 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:21.917124 11776 leader_election.cc:343] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:21.918169 11776 leader_election.cc:343] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.918720 11776 leader_election.cc:304] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:21.920302 11953 raft_consensus.cc:2749] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.928310 11857 raft_consensus.cc:359] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.929593 11857 raft_consensus.cc:385] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.929935 11857 raft_consensus.cc:740] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.931664 11811 raft_consensus.cc:2468] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:21.936129 11555 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:21.937848 12064 raft_consensus.cc:2804] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.938647 12064 raft_consensus.cc:697] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:21.940209 11960 raft_consensus.cc:493] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.940446 11858 consensus_queue.cc:260] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.940896 11960 raft_consensus.cc:515] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:21.943470 11960 leader_election.cc:290] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:21.915024 12056 consensus_queue.cc:1048] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:22:21.939934 12064 consensus_queue.cc:237] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.914989 11863 raft_consensus.cc:385] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.950628 11863 raft_consensus.cc:740] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.946985 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290688edb81143ac8abfb02f7060a88a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:21.948251 11553 leader_election.cc:343] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.952210 11736 raft_consensus.cc:2468] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:21.953622 12056 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.954218 12056 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:21.954388 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290688edb81143ac8abfb02f7060a88a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:21.955415 11590 raft_consensus.cc:2468] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:21.957573 11630 leader_election.cc:304] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:21.958598 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:21.958902 11960 raft_consensus.cc:2804] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.960268 11863 consensus_queue.cc:260] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.945511 11858 ts_tablet_manager.cc:1434] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.000s
I20260709 13:22:21.964452 11960 raft_consensus.cc:493] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.973327 11857 consensus_queue.cc:260] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:21.972190 11813 raft_consensus.cc:2393] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:21.972965 11960 raft_consensus.cc:3060] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.972087 12056 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:21.987108 11857 ts_tablet_manager.cc:1434] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.173s	user 0.009s	sys 0.000s
I20260709 13:22:21.997551 11858 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:22.005136 11857 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:22.032835 11859 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:22.033515 11859 ts_tablet_manager.cc:1403] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.218s	user 0.050s	sys 0.083s
I20260709 13:22:22.044628 11859 raft_consensus.cc:359] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.045459 11859 raft_consensus.cc:385] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.045773 11859 raft_consensus.cc:740] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.051041 11858 tablet_bootstrap.cc:654] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.053098 11859 consensus_queue.cc:260] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.056556 11863 ts_tablet_manager.cc:1434] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.245s	user 0.006s	sys 0.014s
I20260709 13:22:22.058146 11859 ts_tablet_manager.cc:1434] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:22:22.058413 11863 tablet_bootstrap.cc:492] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:22.059773 11859 tablet_bootstrap.cc:492] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:22.064471 11915 consensus_queue.cc:1048] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.074684 11863 tablet_bootstrap.cc:654] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.075636 11857 tablet_bootstrap.cc:654] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.080219 11960 raft_consensus.cc:515] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.093050 11960 leader_election.cc:290] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:22.092329 11486 catalog_manager.cc:5697] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.093946 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:22.095999 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290688edb81143ac8abfb02f7060a88a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:22.100449 11590 raft_consensus.cc:3060] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.096048 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290688edb81143ac8abfb02f7060a88a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:22.104377 11736 raft_consensus.cc:3060] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.104759 11857 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:22.105350 11857 ts_tablet_manager.cc:1403] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.010s
I20260709 13:22:22.107409 12111 raft_consensus.cc:493] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.108021 12111 raft_consensus.cc:515] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.110472 12111 leader_election.cc:290] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:22.113649 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba6f809721a4ee98530e65fe13e1cae" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:22.115998 11702 leader_election.cc:343] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.120573 11736 raft_consensus.cc:2468] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:22.122563 11630 leader_election.cc:304] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:22.122999 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba6f809721a4ee98530e65fe13e1cae" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:22.124119 12056 raft_consensus.cc:2804] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.124907 12056 raft_consensus.cc:697] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:22.126200 12056 consensus_queue.cc:237] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.132931 11857 raft_consensus.cc:359] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:22.133764 11857 raft_consensus.cc:385] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.134080 11857 raft_consensus.cc:740] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.131881 11487 catalog_manager.cc:5697] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.134883 11857 consensus_queue.cc:260] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:22.137305 11702 leader_election.cc:343] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.137944 11702 leader_election.cc:304] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:22.139235 12111 raft_consensus.cc:2749] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.139580 11857 ts_tablet_manager.cc:1434] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 13:22:22.141842 11857 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:22.150782 12102 consensus_queue.cc:1048] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:22.094602 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:22.162177 12010 consensus_queue.cc:1048] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:22.165431 11553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 68308.2us
I20260709 13:22:22.166594 11628 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:22.173118 11858 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:22.173837 11858 ts_tablet_manager.cc:1403] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.199s	user 0.008s	sys 0.010s
I20260709 13:22:22.174528 12102 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.176151 11863 tablet_bootstrap.cc:492] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:22.178923 11965 consensus_queue.cc:1048] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.187050 11863 ts_tablet_manager.cc:1403] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.129s	user 0.028s	sys 0.001s
I20260709 13:22:22.199936 11863 raft_consensus.cc:359] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.124855 11590 raft_consensus.cc:2468] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:22.081923 11859 tablet_bootstrap.cc:654] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.179072 11858 raft_consensus.cc:359] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.201552 11858 raft_consensus.cc:385] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.181372 11857 tablet_bootstrap.cc:654] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.201895 11858 raft_consensus.cc:740] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.200917 11863 raft_consensus.cc:385] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.213713 11863 raft_consensus.cc:740] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.217298 11863 consensus_queue.cc:260] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.219722 11863 ts_tablet_manager.cc:1434] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:22:22.220943 12102 raft_consensus.cc:2749] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.229105 11858 consensus_queue.cc:260] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.235292 11863 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:22.239843 12010 consensus_queue.cc:1048] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.240365 11858 ts_tablet_manager.cc:1434] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.003s
I20260709 13:22:22.243474 11857 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:22.244206 11857 ts_tablet_manager.cc:1403] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.103s	user 0.015s	sys 0.013s
I20260709 13:22:22.247889 11857 raft_consensus.cc:359] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.248811 11857 raft_consensus.cc:385] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.249140 11857 raft_consensus.cc:740] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.249943 11857 consensus_queue.cc:260] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.252488 11857 ts_tablet_manager.cc:1434] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:22:22.253686 11857 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:22.258153 11486 catalog_manager.cc:5697] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.261206 11857 tablet_bootstrap.cc:654] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.272192 11737 raft_consensus.cc:1275] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:22.278371 11859 tablet_bootstrap.cc:492] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:22.279027 11859 ts_tablet_manager.cc:1403] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.220s	user 0.011s	sys 0.008s
I20260709 13:22:22.279263 11965 consensus_queue.cc:1048] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.282150 11863 tablet_bootstrap.cc:654] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.282828 11859 raft_consensus.cc:359] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.283727 11859 raft_consensus.cc:385] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.284005 11859 raft_consensus.cc:740] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.284956 11859 consensus_queue.cc:260] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.288133 11858 tablet_bootstrap.cc:492] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:22.288725 11859 ts_tablet_manager.cc:1434] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:22.289840 11859 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:22.292742 11486 catalog_manager.cc:5697] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.300774 11859 tablet_bootstrap.cc:654] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.307191 12102 raft_consensus.cc:493] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.310487 12102 raft_consensus.cc:515] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.312959 12102 leader_election.cc:290] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:22.316641 11857 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:22.317436 11858 tablet_bootstrap.cc:654] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.317943 11857 ts_tablet_manager.cc:1403] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.001s
I20260709 13:22:22.323601 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba6f809721a4ee98530e65fe13e1cae" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:22.326258 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba6f809721a4ee98530e65fe13e1cae" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:22.329406 11590 raft_consensus.cc:2468] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:22.341320 11736 raft_consensus.cc:2468] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:22.357475 12035 raft_consensus.cc:493] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.358541 12035 raft_consensus.cc:515] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.345539 11628 leader_election.cc:304] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:22.365849 11863 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:22.366514 11863 ts_tablet_manager.cc:1403] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.009s
I20260709 13:22:22.367192 12035 leader_election.cc:290] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:22.367666 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:22.368462 11812 raft_consensus.cc:2468] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:22.368806 12056 raft_consensus.cc:2804] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.369361 12056 raft_consensus.cc:493] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.369745 12056 raft_consensus.cc:3060] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.373987 11704 leader_election.cc:304] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:22.385251 12125 raft_consensus.cc:493] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.386132 12125 raft_consensus.cc:515] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.384436 11590 raft_consensus.cc:1275] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:22.388701 12111 raft_consensus.cc:2804] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.391599 12111 raft_consensus.cc:493] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.391925 11915 consensus_queue.cc:1048] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.392786 11863 raft_consensus.cc:359] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.393496 12056 raft_consensus.cc:515] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.393925 12125 leader_election.cc:290] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:22.393518 11863 raft_consensus.cc:385] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.392056 12111 raft_consensus.cc:3060] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.394868 11863 raft_consensus.cc:740] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.396868 11863 consensus_queue.cc:260] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.397554 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4407206cd8ba4bd19c922dd8b3accb96" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:22.398331 11589 raft_consensus.cc:2468] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:22.399111 11863 ts_tablet_manager.cc:1434] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 13:22:22.401191 11863 tablet_bootstrap.cc:492] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:22.401505 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:22.403390 11859 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:22.403985 11859 ts_tablet_manager.cc:1403] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.114s	user 0.026s	sys 0.003s
I20260709 13:22:22.404069 11776 leader_election.cc:304] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:22.405575 12124 raft_consensus.cc:2804] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.405992 12124 raft_consensus.cc:493] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.406329 12124 raft_consensus.cc:3060] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.409119 11859 raft_consensus.cc:359] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.409809 11859 raft_consensus.cc:385] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.410040 11859 raft_consensus.cc:740] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.417141 11859 consensus_queue.cc:260] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.433173 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4407206cd8ba4bd19c922dd8b3accb96" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:22.434192 11739 raft_consensus.cc:2468] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:22.440061 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba6f809721a4ee98530e65fe13e1cae" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:22.441443 11588 raft_consensus.cc:3060] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.442759 12124 raft_consensus.cc:515] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.443426 12063 consensus_queue.cc:1048] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.444582 12056 leader_election.cc:290] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:22.446137 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4407206cd8ba4bd19c922dd8b3accb96" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:22.446856 11736 raft_consensus.cc:3060] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.448187 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4407206cd8ba4bd19c922dd8b3accb96" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:22.448886 11590 raft_consensus.cc:3060] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.450034 11857 raft_consensus.cc:359] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.451085 11857 raft_consensus.cc:385] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.451432 11857 raft_consensus.cc:740] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.452500 12124 leader_election.cc:290] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:22.456303 11736 raft_consensus.cc:2468] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:22.457998 11778 leader_election.cc:304] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
W20260709 13:22:22.459347 11702 leader_election.cc:343] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.460796 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba6f809721a4ee98530e65fe13e1cae" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:22.461519 11737 raft_consensus.cc:3060] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.465672 12125 raft_consensus.cc:2804] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.466331 12125 raft_consensus.cc:697] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:22.471583 12063 raft_consensus.cc:493] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.472091 11859 ts_tablet_manager.cc:1434] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:22:22.472289 11590 raft_consensus.cc:2468] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:22.472213 12063 raft_consensus.cc:515] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:22.473609 11859 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:22.475548 12063 leader_election.cc:290] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:22.467701 12125 consensus_queue.cc:237] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.476224 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:22.476263 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:22.480727 11812 raft_consensus.cc:2468] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
W20260709 13:22:22.482064 11553 leader_election.cc:343] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.482797 11555 leader_election.cc:304] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:22.488276 12010 raft_consensus.cc:2804] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.488866 12010 raft_consensus.cc:493] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.489270 12010 raft_consensus.cc:3060] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.491214 11863 tablet_bootstrap.cc:654] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.496582 11857 consensus_queue.cc:260] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.497116 11737 raft_consensus.cc:2468] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:22.506578 11857 ts_tablet_manager.cc:1434] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.188s	user 0.009s	sys 0.000s
I20260709 13:22:22.508051 11857 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:22.509449 11859 tablet_bootstrap.cc:654] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.507800 11486 catalog_manager.cc:5697] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.512862 12011 consensus_queue.cc:1048] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.518829 12011 raft_consensus.cc:493] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.519500 12011 raft_consensus.cc:515] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.521536 12111 raft_consensus.cc:515] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.523598 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:22.524621 11630 leader_election.cc:304] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:22.518774 11857 tablet_bootstrap.cc:654] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.524143 11588 raft_consensus.cc:2468] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:22.530782 11858 tablet_bootstrap.cc:492] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:22.524878 12011 leader_election.cc:290] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:22.534351 12102 raft_consensus.cc:2804] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:22.536171 11553 leader_election.cc:343] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.548192 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:22.534096 12010 raft_consensus.cc:515] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:22.544967 11858 ts_tablet_manager.cc:1403] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.257s	user 0.015s	sys 0.007s
I20260709 13:22:22.550931 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:22.554358 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:22.570994 11811 raft_consensus.cc:3060] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:22.571610 11702 leader_election.cc:343] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:22.572664 11553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 44168.5us
I20260709 13:22:22.575146 12010 leader_election.cc:290] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:22.558933 12102 raft_consensus.cc:697] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:22.550168 12111 leader_election.cc:290] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:22.581292 12102 consensus_queue.cc:237] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:22.584689 11859 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:22.585449 11859 ts_tablet_manager.cc:1403] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.020s
I20260709 13:22:22.586617 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:22.589206 11859 raft_consensus.cc:359] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.590040 11859 raft_consensus.cc:385] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.590335 11859 raft_consensus.cc:740] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.591092 11859 consensus_queue.cc:260] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.593354 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:22.593632 11859 ts_tablet_manager.cc:1434] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:22.594094 11813 raft_consensus.cc:3060] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.594949 11859 tablet_bootstrap.cc:492] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:22.600148 11811 raft_consensus.cc:2468] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:22.603024 11859 tablet_bootstrap.cc:654] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.603447 11704 leader_election.cc:304] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:22.605265 12111 raft_consensus.cc:2804] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.605929 12111 raft_consensus.cc:697] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:22.607193 12111 consensus_queue.cc:237] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
W20260709 13:22:22.591380 11555 leader_election.cc:343] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:22.616957 11553 leader_election.cc:343] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.618270 11555 leader_election.cc:304] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:22.619959 12064 raft_consensus.cc:2749] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.626614 11965 consensus_queue.cc:1048] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.629489 12120 raft_consensus.cc:493] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.630380 12120 raft_consensus.cc:515] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.642313 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fae0c5c6645438dadaa067b0d5d92cb" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:22.643483 11736 raft_consensus.cc:2468] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:22.654238 11778 leader_election.cc:304] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:22.658048 12125 raft_consensus.cc:2804] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.658497 12125 raft_consensus.cc:493] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.659600 12125 raft_consensus.cc:3060] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.650507 11813 raft_consensus.cc:2468] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:22.662482 11858 raft_consensus.cc:359] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.665951 11857 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:22.667186 11858 raft_consensus.cc:385] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.667558 11857 ts_tablet_manager.cc:1403] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.160s	user 0.014s	sys 0.004s
I20260709 13:22:22.667598 11858 raft_consensus.cc:740] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.666610 12120 leader_election.cc:290] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:22.669036 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fae0c5c6645438dadaa067b0d5d92cb" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:22.668890 11858 consensus_queue.cc:260] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.688225 11915 consensus_queue.cc:1048] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.693168 11863 tablet_bootstrap.cc:492] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:22.693900 11863 ts_tablet_manager.cc:1403] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.293s	user 0.026s	sys 0.022s
W20260709 13:22:22.695437 11776 leader_election.cc:343] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.706898 11555 leader_election.cc:304] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:22.704454 11486 catalog_manager.cc:5697] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.708176 12011 raft_consensus.cc:2804] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.708843 12011 raft_consensus.cc:697] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:22.710801 12011 consensus_queue.cc:237] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:22.713259 11863 raft_consensus.cc:359] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.714167 11863 raft_consensus.cc:385] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.714371 11857 raft_consensus.cc:359] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.715355 11857 raft_consensus.cc:385] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.716414 11857 raft_consensus.cc:740] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.718043 11857 consensus_queue.cc:260] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.721868 11859 tablet_bootstrap.cc:492] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:22.732678 11859 ts_tablet_manager.cc:1403] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.138s	user 0.034s	sys 0.033s
I20260709 13:22:22.736327 11859 raft_consensus.cc:359] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.737398 11859 raft_consensus.cc:385] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.714478 11863 raft_consensus.cc:740] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.730576 11858 ts_tablet_manager.cc:1434] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.152s	user 0.009s	sys 0.002s
I20260709 13:22:22.738735 11863 consensus_queue.cc:260] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.737730 11859 raft_consensus.cc:740] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.735523 12125 raft_consensus.cc:515] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.746045 11857 ts_tablet_manager.cc:1434] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.005s
I20260709 13:22:22.747598 11863 ts_tablet_manager.cc:1434] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 13:22:22.753675 11858 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:22.756759 11857 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:22.754981 11859 consensus_queue.cc:260] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.757609 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fae0c5c6645438dadaa067b0d5d92cb" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:22.765039 11736 raft_consensus.cc:3060] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.766506 12125 leader_election.cc:290] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:22.771117 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fae0c5c6645438dadaa067b0d5d92cb" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:22.770982 12011 raft_consensus.cc:493] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.774252 12011 raft_consensus.cc:515] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.775936 11588 raft_consensus.cc:3060] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.783589 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fae0c5c6645438dadaa067b0d5d92cb" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:22.789723 11863 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:22.786370 12011 leader_election.cc:290] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:22.799018 11859 ts_tablet_manager.cc:1434] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:22:22.807288 11857 tablet_bootstrap.cc:654] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.807030 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fae0c5c6645438dadaa067b0d5d92cb" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:22.815382 11813 raft_consensus.cc:2393] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in current term 1: Already voted for candidate 01c914cf532f4dc19c1bab3514524ac2 in this term.
I20260709 13:22:22.813989 11859 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
W20260709 13:22:22.823465 12157 log.cc:927] Time spent T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:22:22.818020 11486 catalog_manager.cc:5697] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.829919 11736 raft_consensus.cc:2468] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:22.833624 11859 tablet_bootstrap.cc:654] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.835106 11858 tablet_bootstrap.cc:654] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.836321 11778 leader_election.cc:304] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:22.837710 11555 leader_election.cc:304] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:22.838845 12120 raft_consensus.cc:2804] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.843251 12120 raft_consensus.cc:697] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:22.844470 12120 consensus_queue.cc:237] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.851218 11487 catalog_manager.cc:5697] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.870071 11588 raft_consensus.cc:2468] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:22.870903 12010 raft_consensus.cc:2749] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.873068 12035 raft_consensus.cc:493] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.873931 12035 raft_consensus.cc:515] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.900804 12035 leader_election.cc:290] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:22.902390 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b046224b89c645faacf4c9feb1def01b" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:22.903252 11812 raft_consensus.cc:2468] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:22.907500 11863 tablet_bootstrap.cc:654] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.909116 11857 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:22.910105 11857 ts_tablet_manager.cc:1403] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.004s
I20260709 13:22:22.922612 11704 leader_election.cc:304] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:22.925913 11857 raft_consensus.cc:359] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.926801 11857 raft_consensus.cc:385] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.927084 11857 raft_consensus.cc:740] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.928447 12035 raft_consensus.cc:2804] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.929219 12035 raft_consensus.cc:493] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.929571 12035 raft_consensus.cc:3060] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.927810 11857 consensus_queue.cc:260] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:22.932152 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b046224b89c645faacf4c9feb1def01b" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:22.940069 11702 leader_election.cc:343] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.941681 11857 ts_tablet_manager.cc:1434] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:22:22.943732 11857 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:22.948374 11858 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:22.949293 11858 ts_tablet_manager.cc:1403] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.196s	user 0.022s	sys 0.022s
I20260709 13:22:22.951442 11857 tablet_bootstrap.cc:654] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.945304 11485 catalog_manager.cc:5697] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.958078 11858 raft_consensus.cc:359] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:22.972589 11858 raft_consensus.cc:385] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.974561 11858 raft_consensus.cc:740] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.979476 11858 consensus_queue.cc:260] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:22.982781 12035 raft_consensus.cc:515] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:22.989166 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b046224b89c645faacf4c9feb1def01b" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:22.991568 12035 leader_election.cc:290] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
W20260709 13:22:22.996433 11702 leader_election.cc:343] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.999673 11858 ts_tablet_manager.cc:1434] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:22:23.001350 11858 tablet_bootstrap.cc:492] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:23.001435 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b046224b89c645faacf4c9feb1def01b" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:23.002601 11812 raft_consensus.cc:3060] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.013863 11858 tablet_bootstrap.cc:654] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.016916 11664 raft_consensus.cc:3060] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.025592 12120 consensus_queue.cc:1048] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.029491 11863 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:23.030156 11863 ts_tablet_manager.cc:1403] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.241s	user 0.016s	sys 0.007s
I20260709 13:22:23.031711 11859 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:23.032281 11859 ts_tablet_manager.cc:1403] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.219s	user 0.015s	sys 0.003s
I20260709 13:22:23.034745 11863 raft_consensus.cc:359] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.035652 11863 raft_consensus.cc:385] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.035979 11863 raft_consensus.cc:740] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.036883 11863 consensus_queue.cc:260] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.039007 11863 ts_tablet_manager.cc:1434] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:23.040524 11863 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:23.049152 11863 tablet_bootstrap.cc:654] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.055497 11859 raft_consensus.cc:359] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.056543 11859 raft_consensus.cc:385] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.057183 11859 raft_consensus.cc:740] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.058045 11859 consensus_queue.cc:260] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.063891 11858 tablet_bootstrap.cc:492] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:23.064085 11857 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:23.064661 11859 ts_tablet_manager.cc:1434] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:22:23.065048 11857 ts_tablet_manager.cc:1403] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.122s	user 0.025s	sys 0.026s
I20260709 13:22:23.066130 11859 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:23.064584 11858 ts_tablet_manager.cc:1403] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.003s
I20260709 13:22:23.069208 11857 raft_consensus.cc:359] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.070052 11857 raft_consensus.cc:385] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.070358 11857 raft_consensus.cc:740] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.071172 11857 consensus_queue.cc:260] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.089689 11859 tablet_bootstrap.cc:654] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.100598 11857 ts_tablet_manager.cc:1434] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 13:22:23.102399 11857 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:23.105154 11858 raft_consensus.cc:359] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.106050 11858 raft_consensus.cc:385] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.106381 11858 raft_consensus.cc:740] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.109032 11858 consensus_queue.cc:260] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.114355 11858 ts_tablet_manager.cc:1434] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:22:23.134469 11965 raft_consensus.cc:493] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.133227 12125 consensus_queue.cc:1048] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:22:23.135063 11965 raft_consensus.cc:515] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.137552 11965 leader_election.cc:290] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:23.144932 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b046224b89c645faacf4c9feb1def01b" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:23.133626 11812 raft_consensus.cc:2468] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:23.146164 11739 raft_consensus.cc:2393] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:23.146770 11858 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:23.142011 12011 raft_consensus.cc:493] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.149255 12011 raft_consensus.cc:515] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:23.154019 11858 tablet_bootstrap.cc:654] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.156036 12011 leader_election.cc:290] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:23.156680 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f715c50984a62b3ff88c9fe9c4a91" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:23.159055 11555 leader_election.cc:343] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:23.153594 11704 leader_election.cc:304] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:23.161123 12035 raft_consensus.cc:2804] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:23.161697 12035 raft_consensus.cc:697] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:23.162842 12035 consensus_queue.cc:237] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.165525 12111 consensus_queue.cc:1048] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.184412 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f715c50984a62b3ff88c9fe9c4a91" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:23.198897 12011 consensus_queue.cc:1048] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:23.200623 11555 leader_election.cc:343] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:23.201287 11555 leader_election.cc:304] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:23.201237 11859 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:23.204617 11859 ts_tablet_manager.cc:1403] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.139s	user 0.020s	sys 0.013s
I20260709 13:22:23.202797 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b046224b89c645faacf4c9feb1def01b" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:23.203843 12011 raft_consensus.cc:2749] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:23.235941 11812 raft_consensus.cc:2393] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:23.234213 11965 raft_consensus.cc:493] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.244727 11858 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:23.245388 11858 ts_tablet_manager.cc:1403] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.113s	user 0.007s	sys 0.016s
I20260709 13:22:23.252260 11863 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:23.252990 11863 ts_tablet_manager.cc:1403] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.213s	user 0.041s	sys 0.055s
I20260709 13:22:23.260079 11857 tablet_bootstrap.cc:654] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.267306 11630 leader_election.cc:304] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:23.268442 12102 raft_consensus.cc:3060] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.248414 11965 raft_consensus.cc:515] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.268090 11858 raft_consensus.cc:359] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.271656 11858 raft_consensus.cc:385] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.271992 11858 raft_consensus.cc:740] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.278908 11960 raft_consensus.cc:493] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.277292 11858 consensus_queue.cc:260] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.279678 11960 raft_consensus.cc:515] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.282459 11858 ts_tablet_manager.cc:1434] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 13:22:23.282791 11863 raft_consensus.cc:359] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:23.290736 11859 raft_consensus.cc:359] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.292383 11665 raft_consensus.cc:3060] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.294817 12111 raft_consensus.cc:493] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.295449 12111 raft_consensus.cc:515] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.298311 12056 consensus_queue.cc:1048] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.300190 12111 leader_election.cc:290] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:23.304134 11858 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:23.306576 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:23.308010 11589 raft_consensus.cc:2468] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:23.311162 12102 raft_consensus.cc:2749] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:23.311136 11486 catalog_manager.cc:5697] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.318506 12035 consensus_queue.cc:1048] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.313226 11965 leader_election.cc:290] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:23.313428 11960 leader_election.cc:290] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:23.321192 11702 leader_election.cc:304] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:23.291826 11859 raft_consensus.cc:385] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.325259 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:23.325457 12035 raft_consensus.cc:2804] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:23.326311 12035 raft_consensus.cc:493] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:23.326826 12035 raft_consensus.cc:3060] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.327211 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:23.325752 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:23.284101 11863 raft_consensus.cc:385] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.329519 11863 raft_consensus.cc:740] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.325397 11859 raft_consensus.cc:740] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.338115 11859 consensus_queue.cc:260] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.340034 12125 consensus_queue.cc:1048] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.330657 11863 consensus_queue.cc:260] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:23.345374 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:23.350713 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:23.357800 11857 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:23.358647 11857 ts_tablet_manager.cc:1403] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.257s	user 0.029s	sys 0.005s
I20260709 13:22:23.361109 11858 tablet_bootstrap.cc:654] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.365167 11859 ts_tablet_manager.cc:1434] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.160s	user 0.007s	sys 0.001s
I20260709 13:22:23.362069 11857 raft_consensus.cc:359] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.371829 11857 raft_consensus.cc:385] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.372206 11857 raft_consensus.cc:740] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.362524 11863 ts_tablet_manager.cc:1434] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 13:22:23.386746 11857 consensus_queue.cc:260] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.386173 11858 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:23.389163 11858 ts_tablet_manager.cc:1403] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.005s
I20260709 13:22:23.361369 12011 consensus_queue.cc:1048] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:22:23.391628 12035 raft_consensus.cc:515] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.399772 11859 tablet_bootstrap.cc:492] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:23.401544 11858 raft_consensus.cc:359] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.402406 11858 raft_consensus.cc:385] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.402696 11858 raft_consensus.cc:740] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.403393 11858 consensus_queue.cc:260] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.406132 11858 ts_tablet_manager.cc:1434] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:22:23.409214 11857 ts_tablet_manager.cc:1434] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 13:22:23.415755 11858 tablet_bootstrap.cc:492] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:23.422035 11857 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:23.425482 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:23.426270 11589 raft_consensus.cc:3060] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.362849 11630 leader_election.cc:304] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:23.434789 11858 tablet_bootstrap.cc:654] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.440864 11857 tablet_bootstrap.cc:654] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.441548 12124 consensus_queue.cc:1048] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:23.442595 11630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 79874.1us
I20260709 13:22:23.442785 12120 raft_consensus.cc:493] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.453193 12035 leader_election.cc:290] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:23.457407 12179 log.cc:927] Time spent T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:22:23.443487 12120 raft_consensus.cc:515] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.456741 11863 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:23.454330 12010 raft_consensus.cc:493] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.475809 12120 leader_election.cc:290] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:23.477008 12010 raft_consensus.cc:515] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.481273 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:23.482780 12010 leader_election.cc:290] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:23.483667 11776 leader_election.cc:343] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:23.484135 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:23.485077 11736 raft_consensus.cc:2468] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:23.489640 11915 raft_consensus.cc:2749] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:23.491847 11859 tablet_bootstrap.cc:654] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.493222 11915 raft_consensus.cc:493] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.493805 11915 raft_consensus.cc:515] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.499285 11915 leader_election.cc:290] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:23.508416 11555 leader_election.cc:304] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:23.512398 11915 raft_consensus.cc:493] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.513134 11915 raft_consensus.cc:515] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.515555 11915 leader_election.cc:290] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:23.518064 11863 tablet_bootstrap.cc:654] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.464210 11630 leader_election.cc:304] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:23.505762 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:23.529338 11915 raft_consensus.cc:2749] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:23.520521 12010 raft_consensus.cc:2804] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:23.561242 11857 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:23.562198 11857 ts_tablet_manager.cc:1403] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.148s	user 0.028s	sys 0.034s
I20260709 13:22:23.569423 12187 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.570554 12187 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.574478 12187 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:23.535605 12010 raft_consensus.cc:493] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:23.587133 11857 raft_consensus.cc:359] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:23.554183 11630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 98574.4us
W20260709 13:22:23.589208 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:23.594249 11858 tablet_bootstrap.cc:492] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:23.609927 11858 ts_tablet_manager.cc:1403] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.194s	user 0.021s	sys 0.003s
W20260709 13:22:23.613341 11702 leader_election.cc:343] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:23.613641 11858 raft_consensus.cc:359] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.614445 11858 raft_consensus.cc:385] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.614742 11858 raft_consensus.cc:740] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.615468 11858 consensus_queue.cc:260] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.617311 11859 tablet_bootstrap.cc:492] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:23.613104 11589 raft_consensus.cc:2468] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:23.599941 12010 raft_consensus.cc:3060] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.617311 11863 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:23.618503 11863 ts_tablet_manager.cc:1403] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.173s	user 0.030s	sys 0.029s
I20260709 13:22:23.618855 11859 ts_tablet_manager.cc:1403] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.219s	user 0.021s	sys 0.001s
I20260709 13:22:23.603363 11857 raft_consensus.cc:385] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.620850 11857 raft_consensus.cc:740] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.621851 11857 consensus_queue.cc:260] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.622092 11859 raft_consensus.cc:359] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.622323 11863 raft_consensus.cc:359] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.622982 11859 raft_consensus.cc:385] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.623027 11863 raft_consensus.cc:385] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.623494 11863 raft_consensus.cc:740] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.623453 11859 raft_consensus.cc:740] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.624480 11863 consensus_queue.cc:260] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:23.605154 11776 leader_election.cc:343] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:23.625728 11776 leader_election.cc:304] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:23.629468 11857 ts_tablet_manager.cc:1434] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.066s	user 0.011s	sys 0.003s
I20260709 13:22:23.625056 11859 consensus_queue.cc:260] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.633067 11858 ts_tablet_manager.cc:1434] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
W20260709 13:22:23.633685 11555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 85863.4us
I20260709 13:22:23.637153 11702 leader_election.cc:304] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:23.638273 11863 ts_tablet_manager.cc:1434] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:22:23.641114 11857 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:23.634346 12120 raft_consensus.cc:2749] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:23.634580 12124 raft_consensus.cc:493] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.645972 11858 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:23.647418 11863 tablet_bootstrap.cc:492] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:23.659350 11859 ts_tablet_manager.cc:1434] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.004s
I20260709 13:22:23.641315 12146 raft_consensus.cc:2804] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:23.663084 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:23.663879 11665 raft_consensus.cc:2468] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:23.659155 12124 raft_consensus.cc:515] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:23.667677 12124 leader_election.cc:290] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:23.680326 11858 tablet_bootstrap.cc:654] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.683676 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:23.685603 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:23.675984 12146 raft_consensus.cc:697] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:23.705102 11665 raft_consensus.cc:3060] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:23.720033 11553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 84669.1us
I20260709 13:22:23.724190 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:23.727077 11737 raft_consensus.cc:2468] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:23.728758 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:23.730223 12146 consensus_queue.cc:237] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.732838 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:23.733829 11588 raft_consensus.cc:2393] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:23.702493 11811 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:23.698379 12102 consensus_queue.cc:1048] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:22:23.739279 11630 leader_election.cc:304] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:23.743530 11863 tablet_bootstrap.cc:654] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.721061 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f715c50984a62b3ff88c9fe9c4a91" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:23.753229 12181 raft_consensus.cc:2804] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:23.753867 12181 raft_consensus.cc:493] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:23.754257 12181 raft_consensus.cc:3060] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:23.754328 11778 leader_election.cc:343] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:23.762578 11858 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:23.763343 11858 ts_tablet_manager.cc:1403] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.128s	user 0.025s	sys 0.005s
I20260709 13:22:23.765357 12010 raft_consensus.cc:515] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.766749 11858 raft_consensus.cc:359] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.767546 11858 raft_consensus.cc:385] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.767868 11858 raft_consensus.cc:740] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.773218 11588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:23.774294 11588 raft_consensus.cc:2393] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:23.777287 11628 leader_election.cc:304] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:23.783313 11857 tablet_bootstrap.cc:654] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.784163 11662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:23.788951 12035 consensus_queue.cc:1048] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.791605 12199 raft_consensus.cc:493] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.791869 12010 leader_election.cc:290] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:23.792354 12199 raft_consensus.cc:515] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.795274 12181 raft_consensus.cc:515] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:23.796253 12035 consensus_queue.cc:1048] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.800446 11858 consensus_queue.cc:260] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.803102 11858 ts_tablet_manager.cc:1434] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.002s
W20260709 13:22:23.799479 11553 leader_election.cc:343] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:23.810452 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f715c50984a62b3ff88c9fe9c4a91" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:23.810777 12192 raft_consensus.cc:493] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.811518 11589 raft_consensus.cc:2468] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:23.811740 12192 raft_consensus.cc:515] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.813844 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6f3a61bd92477db40d5dcb52285b38" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:23.814121 11776 leader_election.cc:304] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:23.760087 11859 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:23.810451 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:23.814656 11664 raft_consensus.cc:2468] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:23.815199 12183 raft_consensus.cc:2804] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:23.815698 12183 raft_consensus.cc:493] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:23.816116 12183 raft_consensus.cc:3060] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.816908 11702 leader_election.cc:304] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:23.820605 11858 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:23.818648 12199 leader_election.cc:290] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:23.818833 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:23.814688 12192 leader_election.cc:290] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:23.825304 11813 raft_consensus.cc:2468] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:23.826224 11555 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:23.831303 11859 tablet_bootstrap.cc:654] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.835444 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:23.836555 11664 raft_consensus.cc:2468] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:23.830933 12194 raft_consensus.cc:2804] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:23.837527 12194 raft_consensus.cc:493] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:23.837922 12194 raft_consensus.cc:3060] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.828076 11663 raft_consensus.cc:2393] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:23.846227 11863 tablet_bootstrap.cc:492] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:23.847805 11863 ts_tablet_manager.cc:1403] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.201s	user 0.010s	sys 0.007s
I20260709 13:22:23.849342 11555 leader_election.cc:304] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:23.830483 12192 raft_consensus.cc:2804] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:23.858021 12192 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:23.850499 11665 raft_consensus.cc:2468] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:23.849539 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6f3a61bd92477db40d5dcb52285b38" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:23.883524 12102 raft_consensus.cc:2749] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:23.884796 12192 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.903576 11863 raft_consensus.cc:359] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.906944 11863 raft_consensus.cc:385] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.907246 11863 raft_consensus.cc:740] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.914206 11863 consensus_queue.cc:260] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.917546 12120 raft_consensus.cc:493] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:23.920513 12120 raft_consensus.cc:515] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.934949 12120 leader_election.cc:290] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:23.936606 12190 raft_consensus.cc:2804] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:23.937194 12190 raft_consensus.cc:493] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:23.937595 12190 raft_consensus.cc:3060] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.939896 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:23.939896 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6f3a61bd92477db40d5dcb52285b38" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:23.941268 11585 raft_consensus.cc:2393] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in this term.
I20260709 13:22:23.947630 12194 raft_consensus.cc:515] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:23.946784 11811 raft_consensus.cc:2468] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:23.971100 11736 raft_consensus.cc:2393] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:23.972000 12194 leader_election.cc:290] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:23.981552 11858 tablet_bootstrap.cc:654] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.993673 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:23.994539 11737 raft_consensus.cc:3060] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.994354 12190 raft_consensus.cc:515] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:23.996371 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6f3a61bd92477db40d5dcb52285b38" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:23.997330 11663 raft_consensus.cc:2468] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:23.999768 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6f3a61bd92477db40d5dcb52285b38" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:24.000507 11811 raft_consensus.cc:3060] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.001507 11859 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:24.004897 11859 ts_tablet_manager.cc:1403] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.245s	user 0.033s	sys 0.030s
I20260709 13:22:24.010126 11776 leader_election.cc:304] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:24.012264 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:24.013058 11810 raft_consensus.cc:3060] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.023475 11859 raft_consensus.cc:359] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.027693 11859 raft_consensus.cc:385] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.028118 11859 raft_consensus.cc:740] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.020032 11811 raft_consensus.cc:2468] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:24.040777 11859 consensus_queue.cc:260] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.042006 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:24.035181 12125 raft_consensus.cc:2764] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:22:24.044660 11859 ts_tablet_manager.cc:1434] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:22:24.046612 11859 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:24.046563 11810 raft_consensus.cc:2468] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:24.047053 11630 leader_election.cc:304] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:24.048085 11915 raft_consensus.cc:2749] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:24.048203 12190 leader_election.cc:290] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:24.049571 12181 leader_election.cc:290] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:24.054298 11555 leader_election.cc:304] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:24.055492 11859 tablet_bootstrap.cc:654] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.057963 11737 raft_consensus.cc:2468] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:24.058916 12190 raft_consensus.cc:2804] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.077793 12190 raft_consensus.cc:697] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:24.069130 11704 leader_election.cc:304] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:24.066983 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6f3a61bd92477db40d5dcb52285b38" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:24.080961 12190 consensus_queue.cc:237] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:24.087697 11663 raft_consensus.cc:3060] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.094794 11857 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:24.095579 11857 ts_tablet_manager.cc:1403] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.456s	user 0.015s	sys 0.007s
I20260709 13:22:24.092661 12194 raft_consensus.cc:2804] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.101055 12194 raft_consensus.cc:697] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:24.101822 11857 raft_consensus.cc:359] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.102154 12194 consensus_queue.cc:237] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:24.102841 11857 raft_consensus.cc:385] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.103209 11857 raft_consensus.cc:740] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.104067 11857 consensus_queue.cc:260] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.106132 11857 ts_tablet_manager.cc:1434] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:24.107522 11857 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:24.107574 11858 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:24.107342 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:24.108388 11858 ts_tablet_manager.cc:1403] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.304s	user 0.010s	sys 0.014s
I20260709 13:22:24.108709 11665 raft_consensus.cc:3060] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.115128 11555 leader_election.cc:304] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:24.117413 12187 raft_consensus.cc:2804] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.118199 12187 raft_consensus.cc:697] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:24.111742 11858 raft_consensus.cc:359] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:24.120232 11858 raft_consensus.cc:385] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.120709 11858 raft_consensus.cc:740] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.121721 11858 consensus_queue.cc:260] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:24.124289 11858 ts_tablet_manager.cc:1434] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:22:24.125545 11857 tablet_bootstrap.cc:654] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.145592 11486 catalog_manager.cc:5697] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:24.136226 12183 raft_consensus.cc:515] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.170370 11858 tablet_bootstrap.cc:492] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:24.119436 12187 consensus_queue.cc:237] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.189606 11863 ts_tablet_manager.cc:1434] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.341s	user 0.019s	sys 0.014s
I20260709 13:22:24.200543 11863 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:24.175709 12192 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:24.207383 12183 leader_election.cc:290] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:24.210692 11858 tablet_bootstrap.cc:654] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.212667 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f715c50984a62b3ff88c9fe9c4a91" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:24.216022 11589 raft_consensus.cc:3060] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.217262 11663 raft_consensus.cc:2468] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:24.220500 12195 consensus_queue.cc:1048] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:24.221016 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f715c50984a62b3ff88c9fe9c4a91" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:24.221760 11739 raft_consensus.cc:3060] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.227506 11857 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:24.228323 11857 ts_tablet_manager.cc:1403] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.121s	user 0.020s	sys 0.010s
I20260709 13:22:24.229996 12192 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:24.266010 11857 raft_consensus.cc:359] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.266872 11857 raft_consensus.cc:385] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.267182 11857 raft_consensus.cc:740] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.275329 11665 raft_consensus.cc:2468] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:24.267997 11857 consensus_queue.cc:260] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.276875 11485 catalog_manager.cc:5697] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:24.278731 11485 catalog_manager.cc:5697] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:24.280895 11739 raft_consensus.cc:2468] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:24.291464 11778 leader_election.cc:304] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:24.292865 12125 raft_consensus.cc:2804] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.257561 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:24.293447 12125 raft_consensus.cc:697] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:24.293850 11813 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.294520 12125 consensus_queue.cc:237] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.298578 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:24.299723 11665 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.305913 12011 raft_consensus.cc:493] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.317728 11589 raft_consensus.cc:2468] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:24.320904 11857 ts_tablet_manager.cc:1434] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:22:24.325193 11859 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:24.326063 11859 ts_tablet_manager.cc:1403] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.280s	user 0.011s	sys 0.035s
I20260709 13:22:24.311414 12011 raft_consensus.cc:515] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.355940 11859 raft_consensus.cc:359] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.358301 11665 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:24.337591 12195 consensus_queue.cc:1048] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:22:24.359738 11859 raft_consensus.cc:385] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.361604 11859 raft_consensus.cc:740] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.369884 11859 consensus_queue.cc:260] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.371053 11858 tablet_bootstrap.cc:492] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:24.371584 11858 ts_tablet_manager.cc:1403] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.213s	user 0.018s	sys 0.014s
I20260709 13:22:24.387028 11553 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:24.389091 12187 raft_consensus.cc:2804] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.389678 12187 raft_consensus.cc:697] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:24.390609 12187 consensus_queue.cc:237] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:24.396065 11813 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:24.396660 12011 leader_election.cc:290] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:24.398538 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:24.401526 11555 leader_election.cc:343] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.401963 11858 raft_consensus.cc:359] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:24.403012 11858 raft_consensus.cc:385] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.403368 11858 raft_consensus.cc:740] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.404181 11858 consensus_queue.cc:260] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:24.406850 11859 ts_tablet_manager.cc:1434] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.002s
I20260709 13:22:24.414572 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:24.415107 11863 tablet_bootstrap.cc:654] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.420331 11858 ts_tablet_manager.cc:1434] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.004s
I20260709 13:22:24.415473 11857 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:24.416702 11859 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:24.429550 11858 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
W20260709 13:22:24.447070 11555 leader_election.cc:343] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.447657 11555 leader_election.cc:304] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:24.447939 11858 tablet_bootstrap.cc:654] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.448567 12064 raft_consensus.cc:2749] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:24.457674 11859 tablet_bootstrap.cc:654] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.468858 11857 tablet_bootstrap.cc:654] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.477463 11863 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:24.478178 11863 ts_tablet_manager.cc:1403] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.281s	user 0.030s	sys 0.015s
I20260709 13:22:24.483888 11863 raft_consensus.cc:359] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.484736 11863 raft_consensus.cc:385] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.485044 11863 raft_consensus.cc:740] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.486675 11863 consensus_queue.cc:260] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.489845 11863 ts_tablet_manager.cc:1434] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:24.490070 11859 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:24.490916 11859 ts_tablet_manager.cc:1403] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.006s
I20260709 13:22:24.492748 11863 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:24.495044 11859 raft_consensus.cc:359] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.495978 11859 raft_consensus.cc:385] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.496327 11859 raft_consensus.cc:740] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.497197 11859 consensus_queue.cc:260] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.497797 12187 consensus_queue.cc:1048] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:22:24.502004 11859 ts_tablet_manager.cc:1434] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:24.500756 12125 raft_consensus.cc:493] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.504922 12125 raft_consensus.cc:515] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.510210 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bbd404c86c44709ebe400b6a9026d6" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:24.510725 12195 raft_consensus.cc:493] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.511176 11738 raft_consensus.cc:2468] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:24.510567 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bbd404c86c44709ebe400b6a9026d6" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:24.511487 12195 raft_consensus.cc:515] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.512377 11590 raft_consensus.cc:2468] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:24.514542 11778 leader_election.cc:304] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:24.515478 11859 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:24.520776 12207 raft_consensus.cc:2804] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.526952 11858 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:24.527040 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:24.527925 11858 ts_tablet_manager.cc:1403] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.004s
I20260709 13:22:24.513814 12125 leader_election.cc:290] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:24.537947 11704 leader_election.cc:343] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.523131 12207 raft_consensus.cc:493] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.539076 12207 raft_consensus.cc:3060] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.543313 11858 raft_consensus.cc:359] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.544431 11858 raft_consensus.cc:385] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.544763 11858 raft_consensus.cc:740] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.547317 11858 consensus_queue.cc:260] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.550999 12195 leader_election.cc:290] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:24.560547 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:24.562036 11590 raft_consensus.cc:2468] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:24.567175 11702 leader_election.cc:304] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:24.576594 12199 raft_consensus.cc:2804] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.577140 12199 raft_consensus.cc:493] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.577499 12199 raft_consensus.cc:3060] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.584319 12194 consensus_queue.cc:1048] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:24.597172 12207 raft_consensus.cc:515] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.603730 11737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bbd404c86c44709ebe400b6a9026d6" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:24.604722 11737 raft_consensus.cc:3060] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.600077 12207 leader_election.cc:290] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:24.614503 11858 ts_tablet_manager.cc:1434] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 13:22:24.626148 11858 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:24.615743 12102 raft_consensus.cc:493] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.627772 12102 raft_consensus.cc:515] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.634789 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80057d517d74e239a32fbe7ad0fe8c3" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:24.637540 12102 leader_election.cc:290] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:24.640448 11859 tablet_bootstrap.cc:654] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.641067 11863 tablet_bootstrap.cc:654] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.644033 11857 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:24.644719 11857 ts_tablet_manager.cc:1403] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.017s
I20260709 13:22:24.653832 11857 raft_consensus.cc:359] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.654822 11857 raft_consensus.cc:385] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.655171 11857 raft_consensus.cc:740] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.656169 11857 consensus_queue.cc:260] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.666222 11737 raft_consensus.cc:2468] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:24.669663 11863 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:24.670537 11863 ts_tablet_manager.cc:1403] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.178s	user 0.018s	sys 0.000s
I20260709 13:22:24.681500 12199 raft_consensus.cc:515] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.681730 11857 ts_tablet_manager.cc:1434] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 13:22:24.690403 11857 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:24.690475 12199 leader_election.cc:290] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:24.690726 11858 tablet_bootstrap.cc:654] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.701248 11863 raft_consensus.cc:359] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.702503 11863 raft_consensus.cc:385] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.703202 11863 raft_consensus.cc:740] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.706126 11859 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:24.707118 11859 ts_tablet_manager.cc:1403] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.203s	user 0.014s	sys 0.006s
I20260709 13:22:24.706431 11863 consensus_queue.cc:260] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.717202 11863 ts_tablet_manager.cc:1434] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.005s
I20260709 13:22:24.719022 11863 tablet_bootstrap.cc:492] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:24.720516 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80057d517d74e239a32fbe7ad0fe8c3" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:24.721882 11630 leader_election.cc:343] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.722244 11590 raft_consensus.cc:2468] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:24.729739 11628 leader_election.cc:304] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:24.735271 12056 raft_consensus.cc:2804] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.735957 12056 raft_consensus.cc:493] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.736485 12056 raft_consensus.cc:3060] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.754077 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bbd404c86c44709ebe400b6a9026d6" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:24.754961 11590 raft_consensus.cc:3060] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.755399 11859 raft_consensus.cc:359] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.757539 11859 raft_consensus.cc:385] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.757926 11859 raft_consensus.cc:740] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.758744 11859 consensus_queue.cc:260] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.772444 12183 raft_consensus.cc:493] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.773213 12183 raft_consensus.cc:515] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.775766 11857 tablet_bootstrap.cc:654] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.779523 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:24.781066 11589 raft_consensus.cc:2468] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 0.
I20260709 13:22:24.783284 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:24.784060 11585 raft_consensus.cc:3060] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.784617 11776 leader_election.cc:304] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:24.787356 12207 raft_consensus.cc:2804] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.787796 12207 raft_consensus.cc:493] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.788169 12207 raft_consensus.cc:3060] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.775681 12183 leader_election.cc:290] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:24.806558 12102 raft_consensus.cc:493] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.807267 12102 raft_consensus.cc:515] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:24.792876 12232 consensus_queue.cc:1048] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:24.815260 12187 consensus_queue.cc:1048] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:24.821199 11590 raft_consensus.cc:2468] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:24.817364 11736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:24.816404 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:24.827410 12102 leader_election.cc:290] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:24.835769 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f3321b4876472e8e02c6bda6b80ad9" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:24.841150 11630 leader_election.cc:343] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.833077 12010 consensus_queue.cc:1048] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:22:24.847010 11736 raft_consensus.cc:2393] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:24.844592 11859 ts_tablet_manager.cc:1434] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.001s
I20260709 13:22:24.842437 11778 leader_election.cc:304] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:24.851562 12125 raft_consensus.cc:2804] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.852177 12125 raft_consensus.cc:697] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:24.853157 12125 consensus_queue.cc:237] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:24.842319 12232 raft_consensus.cc:493] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.856276 12232 raft_consensus.cc:515] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.858764 12232 leader_election.cc:290] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:24.861994 11859 tablet_bootstrap.cc:492] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:24.867624 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80057d517d74e239a32fbe7ad0fe8c3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:24.869303 11589 raft_consensus.cc:2468] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:24.875562 11702 leader_election.cc:304] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:24.876868 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80057d517d74e239a32fbe7ad0fe8c3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:24.858973 12190 consensus_queue.cc:1048] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:22:24.884642 12232 raft_consensus.cc:2804] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.885325 12232 raft_consensus.cc:493] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.885772 12232 raft_consensus.cc:3060] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.894887 11863 tablet_bootstrap.cc:654] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.844527 12187 consensus_queue.cc:1048] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:22:24.847010 12212 consensus_queue.cc:1048] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:22:24.896226 12056 raft_consensus.cc:515] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:24.931759 11858 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:24.932533 11858 ts_tablet_manager.cc:1403] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.307s	user 0.040s	sys 0.045s
I20260709 13:22:24.965019 11664 raft_consensus.cc:2393] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:24.966526 11859 tablet_bootstrap.cc:654] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.965456 11857 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:24.968084 11857 ts_tablet_manager.cc:1403] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.278s	user 0.019s	sys 0.002s
W20260709 13:22:24.943496 11778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 86782.8us
I20260709 13:22:24.969245 12056 leader_election.cc:290] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:24.942013 11585 raft_consensus.cc:2468] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
W20260709 13:22:24.971503 11776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 125500us
I20260709 13:22:24.981864 11702 leader_election.cc:304] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:24.983846 12199 raft_consensus.cc:2804] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.984786 12199 raft_consensus.cc:697] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:24.978493 11857 raft_consensus.cc:359] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:24.987164 11857 raft_consensus.cc:385] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.987574 11857 raft_consensus.cc:740] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.995441 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80057d517d74e239a32fbe7ad0fe8c3" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:24.990983 12125 consensus_queue.cc:1048] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:22:24.992223 12199 consensus_queue.cc:237] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:25.014367 11590 raft_consensus.cc:3060] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.066834 11858 raft_consensus.cc:359] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.047168 12232 raft_consensus.cc:515] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.080526 11590 raft_consensus.cc:2468] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:25.083775 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80057d517d74e239a32fbe7ad0fe8c3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:25.084856 11585 raft_consensus.cc:2393] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:25.087182 11628 leader_election.cc:304] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:25.075392 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80057d517d74e239a32fbe7ad0fe8c3" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:25.092833 11658 raft_consensus.cc:2393] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:25.073900 12232 leader_election.cc:290] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:25.125767 12242 raft_consensus.cc:2804] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:25.126545 12242 raft_consensus.cc:697] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:25.127686 12242 consensus_queue.cc:237] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.239025 12207 raft_consensus.cc:515] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:25.240020 11859 tablet_bootstrap.cc:492] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:25.240881 11859 ts_tablet_manager.cc:1403] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.390s	user 0.021s	sys 0.003s
I20260709 13:22:25.241617 12207 leader_election.cc:290] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:25.244912 11859 raft_consensus.cc:359] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.245812 11859 raft_consensus.cc:385] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.246347 11859 raft_consensus.cc:740] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.247608 11859 consensus_queue.cc:260] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.249574 11859 ts_tablet_manager.cc:1434] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:22:25.250852 11859 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:25.250932 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
W20260709 13:22:25.258358 11776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 285379us
I20260709 13:22:25.259028 11859 tablet_bootstrap.cc:654] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.261644 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f3321b4876472e8e02c6bda6b80ad9" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:25.274180 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:25.275117 11589 raft_consensus.cc:2393] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:25.067782 11858 raft_consensus.cc:385] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.288264 11858 raft_consensus.cc:740] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.289212 11858 consensus_queue.cc:260] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:25.290474 11630 leader_election.cc:343] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.291131 11630 leader_election.cc:304] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:25.291795 11858 ts_tablet_manager.cc:1434] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.352s	user 0.010s	sys 0.000s
I20260709 13:22:25.292028 11960 raft_consensus.cc:2749] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:25.294651 11858 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:25.299146 11702 leader_election.cc:304] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:25.304212 12205 raft_consensus.cc:2749] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:25.313346 11863 tablet_bootstrap.cc:492] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:25.290726 11859 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:25.314043 11863 ts_tablet_manager.cc:1403] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.595s	user 0.021s	sys 0.005s
I20260709 13:22:25.314199 11859 ts_tablet_manager.cc:1403] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.008s
I20260709 13:22:25.326200 11776 leader_election.cc:304] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:25.328267 12125 raft_consensus.cc:2749] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:25.328510 11857 consensus_queue.cc:260] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.331732 11857 ts_tablet_manager.cc:1434] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.363s	user 0.013s	sys 0.000s
I20260709 13:22:25.332427 12064 raft_consensus.cc:493] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.333058 12064 raft_consensus.cc:515] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.338057 12064 leader_election.cc:290] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:25.339336 11857 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:25.342694 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:25.343914 11664 raft_consensus.cc:2468] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:25.346371 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:25.348402 11553 leader_election.cc:304] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:25.349121 11859 raft_consensus.cc:359] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.350872 12010 raft_consensus.cc:2804] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:25.317431 11863 raft_consensus.cc:359] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.355675 11859 raft_consensus.cc:385] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.356860 11863 raft_consensus.cc:385] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.357102 11859 raft_consensus.cc:740] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.357385 11863 raft_consensus.cc:740] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.360632 11858 tablet_bootstrap.cc:654] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.367843 11859 consensus_queue.cc:260] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.356624 12010 raft_consensus.cc:493] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:25.369812 12010 raft_consensus.cc:3060] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.372008 11859 ts_tablet_manager.cc:1434] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:22:25.375716 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80057d517d74e239a32fbe7ad0fe8c3" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:25.376641 11739 raft_consensus.cc:2393] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:25.376770 11859 tablet_bootstrap.cc:492] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:25.358225 11863 consensus_queue.cc:260] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
W20260709 13:22:25.383078 11555 leader_election.cc:343] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.395002 11863 ts_tablet_manager.cc:1434] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.001s
I20260709 13:22:25.399499 11859 tablet_bootstrap.cc:654] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.402882 12010 raft_consensus.cc:515] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.398474 11857 tablet_bootstrap.cc:654] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.404856 12125 consensus_queue.cc:1048] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.415629 12010 leader_election.cc:290] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:25.430254 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
W20260709 13:22:25.439522 11555 leader_election.cc:343] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.444329 11810 raft_consensus.cc:2393] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 01c914cf532f4dc19c1bab3514524ac2 in this term.
I20260709 13:22:25.430308 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:25.453097 12232 raft_consensus.cc:493] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.453558 11659 raft_consensus.cc:3060] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.453887 12232 raft_consensus.cc:515] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.458844 12232 leader_election.cc:290] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:25.465643 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f3321b4876472e8e02c6bda6b80ad9" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:25.466590 11658 raft_consensus.cc:2468] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:25.467110 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f3321b4876472e8e02c6bda6b80ad9" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:25.468060 11809 raft_consensus.cc:2468] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:25.469097 11863 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:25.471053 11704 leader_election.cc:304] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:25.476250 12232 raft_consensus.cc:2804] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:25.480029 11858 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:25.483470 11858 ts_tablet_manager.cc:1403] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.189s	user 0.016s	sys 0.011s
I20260709 13:22:25.487035 12232 raft_consensus.cc:493] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:25.482754 11859 tablet_bootstrap.cc:492] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:25.488168 11859 ts_tablet_manager.cc:1403] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.009s
I20260709 13:22:25.486776 11858 raft_consensus.cc:359] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.488878 11858 raft_consensus.cc:385] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.489347 11858 raft_consensus.cc:740] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.490216 11858 consensus_queue.cc:260] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.491848 11859 raft_consensus.cc:359] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.492632 11859 raft_consensus.cc:385] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:25.492931 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:25.493157 11858 ts_tablet_manager.cc:1434] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:22:25.494212 11486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57940 (request call id 70) took 1378 ms. Trace:
I20260709 13:22:25.494590 11858 tablet_bootstrap.cc:492] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:25.495318 12010 consensus_queue.cc:1048] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.494637 11486 rpcz_store.cc:276] 0709 13:22:24.116015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:24.116215 (+   200us) service_pool.cc:224] Handling call
0709 13:22:25.494105 (+1377890us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:22:24.338095 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:22:24.378185 (+ 40090us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:22:24.381853 (+  3668us) write_op.cc:435] Acquired schema lock
0709 13:22:24.407307 (+ 25454us) tablet.cc:662] Decoding operations
0709 13:22:24.420774 (+ 13467us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:22:24.420870 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:22:24.420906 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:22:24.421112 (+   206us) tablet.cc:701] Row locks acquired
0709 13:22:24.421133 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:22:24.421291 (+   158us) write_op.cc:270] Start()
0709 13:22:24.421430 (+   139us) write_op.cc:276] Timestamp: P: 1783603344421241 usec, L: 0
0709 13:22:24.421455 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:22:24.425461 (+  4006us) log.cc:844] Serialized 537 byte log entry
0709 13:22:24.624460 (+198999us) op_driver.cc:464] REPLICATION: finished
0709 13:22:24.802883 (+178423us) write_op.cc:301] APPLY: starting
0709 13:22:24.803008 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:22:24.803121 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:22:24.803657 (+   536us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:22:24.803906 (+   249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:22:24.804095 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:22:24.804144 (+    49us) write_op.cc:312] APPLY: finished
0709 13:22:24.804390 (+   246us) log.cc:844] Serialized 22 byte log entry
0709 13:22:24.833484 (+ 29094us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:22:24.838958 (+  5474us) write_op.cc:454] Released schema lock
0709 13:22:24.840275 (+  1317us) write_op.cc:341] FINISH: Updating metrics
0709 13:22:24.850107 (+  9832us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:22:24.850143 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11874,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":128883,"apply.run_cpu_time_us":2405,"apply.run_wall_time_us":78683,"mutex_wait_us":9166,"num_ops":1,"prepare.queue_time_us":155914,"prepare.run_cpu_time_us":17945,"prepare.run_wall_time_us":142324,"raft.queue_time_us":268602,"raft.run_cpu_time_us":8664,"raft.run_wall_time_us":139604,"replication_time_us":193363,"thread_start_us":154111,"threads_started":4,"wal-append.queue_time_us":56616}]]}
I20260709 13:22:25.506428 11487 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57950 (request call id 63) took 1315 ms. Trace:
I20260709 13:22:25.506876 11487 rpcz_store.cc:276] 0709 13:22:24.196980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:24.200373 (+  3393us) service_pool.cc:224] Handling call
0709 13:22:25.506350 (+1305977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238212,"reported_tablets":1}
I20260709 13:22:25.507766 11858 tablet_bootstrap.cc:654] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.492915 11859 raft_consensus.cc:740] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.524291 11659 raft_consensus.cc:2468] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:25.526564 11553 leader_election.cc:304] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:25.527936 12010 raft_consensus.cc:2804] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:25.528501 12010 raft_consensus.cc:697] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:25.529392 12010 consensus_queue.cc:237] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.532792 11863 tablet_bootstrap.cc:654] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.532999 12207 consensus_queue.cc:1048] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.542285 11485 catalog_manager.cc:5697] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:25.537026 11859 consensus_queue.cc:260] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.488556 12232 raft_consensus.cc:3060] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.554352 11859 ts_tablet_manager.cc:1434] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.000s
I20260709 13:22:25.555754 11859 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:25.561952 11857 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:25.575080 11857 ts_tablet_manager.cc:1403] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.236s	user 0.021s	sys 0.011s
I20260709 13:22:25.593612 11859 tablet_bootstrap.cc:654] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.614528 11857 raft_consensus.cc:359] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:25.630757 12102 consensus_queue.cc:1048] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.631927 11857 raft_consensus.cc:385] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.635921 11857 raft_consensus.cc:740] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.637718 11858 tablet_bootstrap.cc:492] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:25.638391 11858 ts_tablet_manager.cc:1403] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.144s	user 0.024s	sys 0.021s
I20260709 13:22:25.641778 11863 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:25.642699 11863 ts_tablet_manager.cc:1403] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.001s
I20260709 13:22:25.646548 12232 raft_consensus.cc:515] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.648248 11858 raft_consensus.cc:359] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.649323 11858 raft_consensus.cc:385] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.649667 11858 raft_consensus.cc:740] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.650992 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f3321b4876472e8e02c6bda6b80ad9" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:25.651964 11659 raft_consensus.cc:3060] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.654713 11863 raft_consensus.cc:359] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.650974 11858 consensus_queue.cc:260] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.655743 11863 raft_consensus.cc:385] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.658670 11859 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:25.659312 11859 ts_tablet_manager.cc:1403] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.104s	user 0.032s	sys 0.015s
I20260709 13:22:25.655174 11857 consensus_queue.cc:260] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:25.665824 11863 raft_consensus.cc:740] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.668844 12194 raft_consensus.cc:493] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.666874 11863 consensus_queue.cc:260] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.669485 12194 raft_consensus.cc:515] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.671083 11857 ts_tablet_manager.cc:1434] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.000s
I20260709 13:22:25.672479 11857 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:25.673103 12194 leader_election.cc:290] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:25.676040 11863 ts_tablet_manager.cc:1434] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:22:25.677238 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ec31526954dedb65074b8c24fd570" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
W20260709 13:22:25.678874 11702 leader_election.cc:343] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.686190 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ec31526954dedb65074b8c24fd570" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:25.690420 11658 raft_consensus.cc:2468] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:25.682945 11858 ts_tablet_manager.cc:1434] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 13:22:25.693939 11702 leader_election.cc:304] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:25.696421 12199 raft_consensus.cc:2804] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:25.699026 11859 raft_consensus.cc:359] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:25.700172 11859 raft_consensus.cc:385] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.700596 11859 raft_consensus.cc:740] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.701781 11858 tablet_bootstrap.cc:492] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:25.698462 12199 raft_consensus.cc:493] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:25.706185 12199 raft_consensus.cc:3060] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.714041 12102 consensus_queue.cc:1048] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.719291 11659 raft_consensus.cc:2468] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:25.701449 11859 consensus_queue.cc:260] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:25.723305 11863 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:25.723347 11702 leader_election.cc:304] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:25.725847 12146 raft_consensus.cc:2804] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:25.726616 12146 raft_consensus.cc:697] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:25.728233 12146 consensus_queue.cc:237] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.723395 11859 ts_tablet_manager.cc:1434] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.001s
I20260709 13:22:25.733374 12199 raft_consensus.cc:515] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.737064 11863 tablet_bootstrap.cc:654] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.739174 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ec31526954dedb65074b8c24fd570" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:25.743461 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f3321b4876472e8e02c6bda6b80ad9" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:25.744498 11809 raft_consensus.cc:3060] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.735867 12199 leader_election.cc:290] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:25.755879 11858 tablet_bootstrap.cc:654] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.748237 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ec31526954dedb65074b8c24fd570" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:25.757975 11659 raft_consensus.cc:3060] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.760545 11859 tablet_bootstrap.cc:492] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:25.736668 12232 leader_election.cc:290] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
W20260709 13:22:25.762878 11702 leader_election.cc:343] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.763247 11857 tablet_bootstrap.cc:654] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.770320 11809 raft_consensus.cc:2468] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:25.765422 12056 raft_consensus.cc:493] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.780543 12056 raft_consensus.cc:515] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.783039 12056 leader_election.cc:290] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:25.784047 12195 raft_consensus.cc:493] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.784700 12195 raft_consensus.cc:515] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.785117 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:25.786214 11739 raft_consensus.cc:2468] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:25.787554 11859 tablet_bootstrap.cc:654] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.787948 12195 leader_election.cc:290] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:25.788560 11630 leader_election.cc:304] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:25.790320 11960 raft_consensus.cc:2804] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:25.790732 11960 raft_consensus.cc:493] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:25.791113 11960 raft_consensus.cc:3060] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.793147 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:25.802546 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:25.815577 11630 leader_election.cc:343] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.821913 11857 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:25.822983 11857 ts_tablet_manager.cc:1403] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.151s	user 0.009s	sys 0.010s
I20260709 13:22:25.834728 11659 raft_consensus.cc:2468] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:25.839125 11857 raft_consensus.cc:359] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.840101 11857 raft_consensus.cc:385] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.840430 11857 raft_consensus.cc:740] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
W20260709 13:22:25.817632 11704 leader_election.cc:343] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.841336 11702 leader_election.cc:304] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:25.821542 12197 raft_consensus.cc:493] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.842422 12194 raft_consensus.cc:2804] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:25.843020 12194 raft_consensus.cc:697] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:25.843997 12194 consensus_queue.cc:237] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.842427 12197 raft_consensus.cc:515] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:25.841207 11857 consensus_queue.cc:260] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:25.849607 11857 ts_tablet_manager.cc:1434] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:22:25.816911 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:25.850831 11857 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:25.851192 12197 leader_election.cc:290] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:25.853163 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea5a35807cf47a18b69b5d51e415e5b" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:25.853965 11738 raft_consensus.cc:2468] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:25.859767 11555 leader_election.cc:304] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:25.859815 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea5a35807cf47a18b69b5d51e415e5b" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:25.865455 11857 tablet_bootstrap.cc:654] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.868497 12011 raft_consensus.cc:2804] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:25.869062 12011 raft_consensus.cc:493] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:25.869438 12011 raft_consensus.cc:3060] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.881197 11863 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:25.882246 11863 ts_tablet_manager.cc:1403] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.004s
I20260709 13:22:25.881368 11487 catalog_manager.cc:5697] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:25.883723 11555 leader_election.cc:343] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.890158 11487 catalog_manager.cc:5697] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } }
I20260709 13:22:25.895146 11863 raft_consensus.cc:359] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.896072 11863 raft_consensus.cc:385] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.896445 11863 raft_consensus.cc:740] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.901880 11960 raft_consensus.cc:515] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.904862 11658 raft_consensus.cc:2393] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:25.897429 11863 consensus_queue.cc:260] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.911032 11702 leader_election.cc:304] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:25.911509 11857 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:25.912397 11857 ts_tablet_manager.cc:1403] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.004s
I20260709 13:22:25.913136 11858 tablet_bootstrap.cc:492] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:25.913805 11858 ts_tablet_manager.cc:1403] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.214s	user 0.028s	sys 0.016s
I20260709 13:22:25.916077 11857 raft_consensus.cc:359] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.917642 11857 raft_consensus.cc:385] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.918166 11857 raft_consensus.cc:740] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.916970 11858 raft_consensus.cc:359] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.919529 11858 raft_consensus.cc:385] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.922523 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:25.923331 11738 raft_consensus.cc:3060] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.928701 11863 ts_tablet_manager.cc:1434] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.005s
I20260709 13:22:25.930124 11863 tablet_bootstrap.cc:492] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:25.931862 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:25.932614 12011 raft_consensus.cc:515] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:25.918998 11857 consensus_queue.cc:260] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:25.919858 11858 raft_consensus.cc:740] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
W20260709 13:22:25.936529 11630 leader_election.cc:343] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.940526 11484 catalog_manager.cc:5697] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:25.946295 11484 catalog_manager.cc:5697] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 1 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:25.949100 12199 consensus_queue.cc:1048] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.949544 11857 ts_tablet_manager.cc:1434] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:22:25.938004 11858 consensus_queue.cc:260] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.957032 11859 tablet_bootstrap.cc:492] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:25.957831 11859 ts_tablet_manager.cc:1403] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.207s	user 0.023s	sys 0.008s
I20260709 13:22:25.958835 11858 ts_tablet_manager.cc:1434] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:22:25.961892 11858 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:25.962955 11857 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:25.918998 11960 leader_election.cc:290] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:25.960528 11863 tablet_bootstrap.cc:654] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.972276 11859 raft_consensus.cc:359] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.972668 11486 catalog_manager.cc:5697] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:25.973227 11859 raft_consensus.cc:385] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.974009 11859 raft_consensus.cc:740] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.973806 12194 consensus_queue.cc:1048] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.974953 11859 consensus_queue.cc:260] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:25.975919 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea5a35807cf47a18b69b5d51e415e5b" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:25.978113 11859 ts_tablet_manager.cc:1434] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:22:25.970386 12011 leader_election.cc:290] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:25.979529 11859 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
W20260709 13:22:25.985822 11555 leader_election.cc:343] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:25.988310 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea5a35807cf47a18b69b5d51e415e5b" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:25.999948 11734 raft_consensus.cc:3060] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.938635 12010 consensus_queue.cc:1048] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 13:22:26.014871 11734 raft_consensus.cc:2468] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:26.019078 11738 raft_consensus.cc:2468] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:26.019943 12146 raft_consensus.cc:2749] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.024446 11555 leader_election.cc:304] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:26.032298 11630 leader_election.cc:304] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:26.035283 12247 raft_consensus.cc:2804] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.049202 11812 raft_consensus.cc:3060] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.050690 12247 raft_consensus.cc:697] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:26.052147 12247 consensus_queue.cc:237] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:26.044644 11960 raft_consensus.cc:2804] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.058945 11960 raft_consensus.cc:697] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:26.060027 11960 consensus_queue.cc:237] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
W20260709 13:22:26.071240 11686 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9040 after lost signal to thread 3024
W20260709 13:22:26.073185 11686 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed720 after lost signal to thread 11522
I20260709 13:22:26.074664 11863 tablet_bootstrap.cc:492] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:26.075670 11863 ts_tablet_manager.cc:1403] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.146s	user 0.007s	sys 0.016s
I20260709 13:22:26.088328 11857 tablet_bootstrap.cc:654] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.091523 11858 tablet_bootstrap.cc:654] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.100303 11863 raft_consensus.cc:359] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:26.112149 11863 raft_consensus.cc:385] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.112866 11863 raft_consensus.cc:740] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.102608 11485 catalog_manager.cc:5697] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.095806 12146 raft_consensus.cc:493] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.122026 12146 raft_consensus.cc:515] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:26.125767 12146 leader_election.cc:290] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
W20260709 13:22:26.095494 11686 debug-util.cc:398] Leaking SignalData structure 0x7b08001cee80 after lost signal to thread 11614
I20260709 13:22:26.128983 11863 consensus_queue.cc:260] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:26.152901 11863 ts_tablet_manager.cc:1434] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.000s
I20260709 13:22:26.133316 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:26.135499 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:26.176110 11659 raft_consensus.cc:2468] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
W20260709 13:22:26.178411 11686 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca9a0 after lost signal to thread 11689
W20260709 13:22:26.178970 11704 leader_election.cc:343] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:26.179864 11686 debug-util.cc:398] Leaking SignalData structure 0x7b0800208320 after lost signal to thread 11763
I20260709 13:22:26.182637 11702 leader_election.cc:304] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:26.184583 11863 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
W20260709 13:22:26.186724 11686 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0a00 after lost signal to thread 11837
I20260709 13:22:26.186357 12232 consensus_queue.cc:1048] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:26.187562 12258 raft_consensus.cc:2804] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.188100 12258 raft_consensus.cc:493] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.188491 12258 raft_consensus.cc:3060] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.199255 12064 raft_consensus.cc:493] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.211066 12190 raft_consensus.cc:493] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.211926 12190 raft_consensus.cc:515] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.214478 12190 leader_election.cc:290] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:26.215087 12258 raft_consensus.cc:515] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:26.199954 12064 raft_consensus.cc:515] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:26.219666 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ec31526954dedb65074b8c24fd570" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:26.221825 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ec31526954dedb65074b8c24fd570" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:26.223299 11487 catalog_manager.cc:5697] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.239431 11857 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:26.240542 11659 raft_consensus.cc:2393] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:26.241910 11859 tablet_bootstrap.cc:654] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.240167 11857 ts_tablet_manager.cc:1403] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.287s	user 0.034s	sys 0.017s
I20260709 13:22:26.244160 11858 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:26.280004 11858 ts_tablet_manager.cc:1403] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.318s	user 0.019s	sys 0.004s
I20260709 13:22:26.247737 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:26.280782 11809 raft_consensus.cc:2468] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:26.281522 11589 raft_consensus.cc:3060] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.281322 12232 consensus_queue.cc:1048] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:26.253145 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:26.254081 11553 leader_election.cc:304] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:26.256767 12258 leader_election.cc:290] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:26.260474 12064 leader_election.cc:290] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:26.260739 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:26.286738 12232 consensus_queue.cc:1048] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:26.263103 12246 raft_consensus.cc:493] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.287985 11863 tablet_bootstrap.cc:654] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.288285 12246 raft_consensus.cc:515] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:26.298967 11704 leader_election.cc:343] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.266281 11857 raft_consensus.cc:359] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.276234 12011 consensus_queue.cc:1048] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:26.278290 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:26.306933 11658 raft_consensus.cc:3060] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.307679 12246 leader_election.cc:290] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:26.297497 11486 catalog_manager.cc:5697] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:26.302842 11555 leader_election.cc:304] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
W20260709 13:22:26.313386 11553 leader_election.cc:343] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.315835 12011 raft_consensus.cc:2804] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.316601 12011 raft_consensus.cc:493] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.317111 12011 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.304610 11857 raft_consensus.cc:385] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.317902 11857 raft_consensus.cc:740] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.324177 11857 consensus_queue.cc:260] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.324509 11858 raft_consensus.cc:359] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:26.325325 11858 raft_consensus.cc:385] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.325642 11858 raft_consensus.cc:740] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.337235 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:26.340302 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:26.348212 11859 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:26.349148 11859 ts_tablet_manager.cc:1403] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.370s	user 0.012s	sys 0.011s
I20260709 13:22:26.335620 12247 raft_consensus.cc:2749] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.341856 12195 consensus_queue.cc:1048] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:22:26.357905 12011 raft_consensus.cc:515] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:26.365391 11658 raft_consensus.cc:2468] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:26.370873 11857 ts_tablet_manager.cc:1434] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.002s
I20260709 13:22:26.373659 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:26.374490 11810 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.378682 11776 leader_election.cc:304] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:26.369611 11702 leader_election.cc:304] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:26.375650 11858 consensus_queue.cc:260] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:26.393065 11553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 89525.7us
I20260709 13:22:26.396811 11857 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:26.400113 11859 raft_consensus.cc:359] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.401067 11859 raft_consensus.cc:385] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.401331 11859 raft_consensus.cc:740] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.401983 11859 consensus_queue.cc:260] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.407496 11858 ts_tablet_manager.cc:1434] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.127s	user 0.012s	sys 0.000s
I20260709 13:22:26.387087 12199 raft_consensus.cc:2804] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.388975 12011 leader_election.cc:290] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:26.435823 11858 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:26.455623 11859 ts_tablet_manager.cc:1434] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.106s	user 0.010s	sys 0.000s
I20260709 13:22:26.422716 12199 raft_consensus.cc:697] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:26.457991 11859 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:26.469630 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:26.470733 11661 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.476164 11863 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:26.476939 11863 ts_tablet_manager.cc:1403] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.319s	user 0.016s	sys 0.040s
I20260709 13:22:26.488451 12056 consensus_queue.cc:1048] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:26.489785 12199 consensus_queue.cc:237] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:26.498000 12207 raft_consensus.cc:493] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.498641 12207 raft_consensus.cc:515] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:26.519436 12183 raft_consensus.cc:2749] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:26.522820 11485 catalog_manager.cc:5697] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:26.525378 11485 catalog_manager.cc:5697] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.532601 12207 leader_election.cc:290] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:26.533998 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:26.540477 11859 tablet_bootstrap.cc:654] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.577891 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:26.587832 11810 raft_consensus.cc:2468] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:26.591971 11863 raft_consensus.cc:359] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:26.600548 11863 raft_consensus.cc:385] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.601168 11863 raft_consensus.cc:740] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.602010 11863 consensus_queue.cc:260] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:26.604529 11555 leader_election.cc:304] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:26.607025 11776 leader_election.cc:304] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:26.616448 12300 raft_consensus.cc:2804] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.617282 12300 raft_consensus.cc:697] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:26.618479 12300 consensus_queue.cc:237] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:26.619460 11812 raft_consensus.cc:3060] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.617326 12301 raft_consensus.cc:2749] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.627116 11863 ts_tablet_manager.cc:1434] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.001s
I20260709 13:22:26.652555 11863 tablet_bootstrap.cc:492] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:26.674835 11858 tablet_bootstrap.cc:654] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.676504 11859 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:26.692752 11859 ts_tablet_manager.cc:1403] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.235s	user 0.032s	sys 0.015s
I20260709 13:22:26.697474 11857 tablet_bootstrap.cc:654] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.713515 12064 raft_consensus.cc:493] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.714248 12064 raft_consensus.cc:515] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.719049 12064 leader_election.cc:290] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:26.689627 11808 raft_consensus.cc:3060] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.724447 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce85d6ba19f471b90132d5118bc8478" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:26.719499 11661 raft_consensus.cc:2468] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:26.696216 11859 raft_consensus.cc:359] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:26.728519 12064 consensus_queue.cc:1048] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:26.729207 11859 raft_consensus.cc:385] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.729628 11859 raft_consensus.cc:740] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.730436 11859 consensus_queue.cc:260] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:26.683658 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:26.746325 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce85d6ba19f471b90132d5118bc8478" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:26.747396 11738 raft_consensus.cc:2468] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
W20260709 13:22:26.743386 11553 leader_election.cc:343] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.759558 11859 ts_tablet_manager.cc:1434] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:22:26.795423 11859 tablet_bootstrap.cc:492] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:26.798434 11555 leader_election.cc:304] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:26.794800 12102 consensus_queue.cc:1048] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:22:26.810434 11863 tablet_bootstrap.cc:654] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:26.815454 11555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 61703.3us
I20260709 13:22:26.820147 11486 catalog_manager.cc:5697] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.816962 12301 raft_consensus.cc:493] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.819949 12064 raft_consensus.cc:2804] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.833292 12064 raft_consensus.cc:493] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.833703 12064 raft_consensus.cc:3060] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.834421 11857 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:26.835089 11857 ts_tablet_manager.cc:1403] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.444s	user 0.017s	sys 0.020s
I20260709 13:22:26.844570 12301 raft_consensus.cc:515] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:26.847682 12305 log.cc:927] Time spent T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:22:26.852670 12248 consensus_queue.cc:1048] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:26.869796 11857 raft_consensus.cc:359] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:26.870709 11857 raft_consensus.cc:385] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.871026 11857 raft_consensus.cc:740] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.877884 11859 tablet_bootstrap.cc:654] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.877619 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea5a35807cf47a18b69b5d51e415e5b" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:26.871819 11857 consensus_queue.cc:260] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:26.875977 12301 leader_election.cc:290] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:26.900014 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea5a35807cf47a18b69b5d51e415e5b" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:26.901718 11858 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:26.902462 11858 ts_tablet_manager.cc:1403] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.485s	user 0.016s	sys 0.015s
I20260709 13:22:26.921130 11857 ts_tablet_manager.cc:1434] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:22:26.933702 11485 catalog_manager.cc:5697] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.936178 11776 leader_election.cc:304] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:26.935457 11858 raft_consensus.cc:359] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.937166 11858 raft_consensus.cc:385] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.937503 11858 raft_consensus.cc:740] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.938261 11858 consensus_queue.cc:260] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.941143 11858 ts_tablet_manager.cc:1434] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 13:22:26.942411 11858 tablet_bootstrap.cc:492] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:26.954523 11863 tablet_bootstrap.cc:492] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:26.955183 11863 ts_tablet_manager.cc:1403] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.308s	user 0.012s	sys 0.006s
I20260709 13:22:26.958946 12190 raft_consensus.cc:493] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.959649 12190 raft_consensus.cc:515] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:26.961014 11863 raft_consensus.cc:359] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:26.961854 11863 raft_consensus.cc:385] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.962193 11863 raft_consensus.cc:740] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.963012 11863 consensus_queue.cc:260] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:26.966405 12183 raft_consensus.cc:2749] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:26.970516 11857 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:26.973891 11858 tablet_bootstrap.cc:654] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.952133 12064 raft_consensus.cc:515] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:26.987329 11859 tablet_bootstrap.cc:492] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:26.988082 11859 ts_tablet_manager.cc:1403] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.203s	user 0.014s	sys 0.011s
I20260709 13:22:26.977478 12190 leader_election.cc:290] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:26.993981 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce85d6ba19f471b90132d5118bc8478" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:26.994102 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce85d6ba19f471b90132d5118bc8478" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:26.995954 11658 raft_consensus.cc:3060] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.995117 11734 raft_consensus.cc:3060] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.000591 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:26.982483 12064 leader_election.cc:290] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:27.009406 11859 raft_consensus.cc:359] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:27.010571 11859 raft_consensus.cc:385] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.010916 11859 raft_consensus.cc:740] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
W20260709 13:22:27.012266 11553 leader_election.cc:343] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.012024 11859 consensus_queue.cc:260] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:27.020553 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:27.022378 11859 ts_tablet_manager.cc:1434] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 13:22:27.024801 11859 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:27.029052 11863 ts_tablet_manager.cc:1434] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.003s
W20260709 13:22:27.029767 11555 leader_election.cc:343] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.031814 11555 leader_election.cc:304] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:27.034474 11863 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:27.039038 12232 consensus_queue.cc:1048] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.041190 11859 tablet_bootstrap.cc:654] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.051663 12064 raft_consensus.cc:2749] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.058157 11812 raft_consensus.cc:3060] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.072134 12064 consensus_queue.cc:1048] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.147660 12232 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.149096 11858 tablet_bootstrap.cc:492] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:27.148756 12232 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.149737 11858 ts_tablet_manager.cc:1403] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.208s	user 0.010s	sys 0.023s
I20260709 13:22:27.156670 11857 tablet_bootstrap.cc:654] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.156412 11858 raft_consensus.cc:359] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:27.158444 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:27.158427 11858 raft_consensus.cc:385] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.160243 11858 raft_consensus.cc:740] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.161332 11858 consensus_queue.cc:260] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
W20260709 13:22:27.163194 11704 leader_election.cc:343] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.139168 11734 raft_consensus.cc:2468] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:27.167483 12183 raft_consensus.cc:493] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.169806 11555 leader_election.cc:304] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:27.180688 11858 ts_tablet_manager.cc:1434] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.006s
I20260709 13:22:27.168243 11658 raft_consensus.cc:2468] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:27.187870 12199 raft_consensus.cc:493] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.188241 11858 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:27.193598 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:27.175396 12247 raft_consensus.cc:2804] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:27.194875 11702 leader_election.cc:343] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.175382 12195 consensus_queue.cc:1048] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:22:27.174036 12183 raft_consensus.cc:515] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:27.196626 11702 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:27.193876 12199 raft_consensus.cc:515] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:27.198254 12258 raft_consensus.cc:2749] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.203488 12199 leader_election.cc:290] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:27.211228 11863 tablet_bootstrap.cc:654] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.201743 12247 raft_consensus.cc:697] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:27.213392 12247 consensus_queue.cc:237] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.194977 12232 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:27.219712 11858 tablet_bootstrap.cc:654] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.221813 12183 leader_election.cc:290] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:27.207306 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b066170aeea34d52be3000a5f02c1804" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:27.227160 11658 raft_consensus.cc:2468] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:27.227811 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:27.228755 11702 leader_election.cc:304] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:27.230497 12232 raft_consensus.cc:2804] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.231001 12232 raft_consensus.cc:493] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.231434 12232 raft_consensus.cc:3060] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.233618 11859 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:27.234231 12064 consensus_queue.cc:1048] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.238140 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:27.241048 11859 ts_tablet_manager.cc:1403] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.217s	user 0.026s	sys 0.026s
I20260709 13:22:27.244637 11778 leader_election.cc:304] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:27.256531 12212 raft_consensus.cc:2749] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:27.257962 11857 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:27.258656 11857 ts_tablet_manager.cc:1403] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.324s	user 0.021s	sys 0.000s
I20260709 13:22:27.252092 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b066170aeea34d52be3000a5f02c1804" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:27.275882 11704 leader_election.cc:343] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.292935 11857 raft_consensus.cc:359] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.294075 11857 raft_consensus.cc:385] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.294588 11857 raft_consensus.cc:740] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.295452 11857 consensus_queue.cc:260] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.298744 11857 ts_tablet_manager.cc:1434] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.005s
I20260709 13:22:27.300639 11857 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:27.307579 11857 tablet_bootstrap.cc:654] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.335999 11859 raft_consensus.cc:359] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.337756 11859 raft_consensus.cc:385] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.338075 11859 raft_consensus.cc:740] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.346967 11859 consensus_queue.cc:260] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.351572 11486 catalog_manager.cc:5697] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.360879 11859 ts_tablet_manager.cc:1434] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 13:22:27.376331 11863 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:27.377344 11863 ts_tablet_manager.cc:1403] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.343s	user 0.023s	sys 0.010s
I20260709 13:22:27.378335 11859 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e: Bootstrap starting.
I20260709 13:22:27.425110 12232 raft_consensus.cc:515] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:27.428824 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b066170aeea34d52be3000a5f02c1804" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:27.432050 11663 raft_consensus.cc:3060] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.436735 11858 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:27.437201 11857 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:27.437862 11857 ts_tablet_manager.cc:1403] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.007s
I20260709 13:22:27.437405 11858 ts_tablet_manager.cc:1403] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.249s	user 0.021s	sys 0.016s
I20260709 13:22:27.444227 11857 raft_consensus.cc:359] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.445670 11857 raft_consensus.cc:385] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.446426 11857 raft_consensus.cc:740] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.447360 11857 consensus_queue.cc:260] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.453810 11857 ts_tablet_manager.cc:1434] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:22:27.455215 11857 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:27.457494 11863 raft_consensus.cc:359] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.458781 11863 raft_consensus.cc:385] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.459461 11863 raft_consensus.cc:740] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.467499 11858 raft_consensus.cc:359] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.468583 11858 raft_consensus.cc:385] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.468895 11858 raft_consensus.cc:740] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.469689 11858 consensus_queue.cc:260] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.480119 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b066170aeea34d52be3000a5f02c1804" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:27.480489 12232 leader_election.cc:290] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
W20260709 13:22:27.483435 11704 leader_election.cc:343] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.484853 11863 consensus_queue.cc:260] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.488811 11859 tablet_bootstrap.cc:654] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.506618 11857 tablet_bootstrap.cc:654] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.507208 11663 raft_consensus.cc:2468] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:27.509824 11858 ts_tablet_manager.cc:1434] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:22:27.528978 11858 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:27.529632 11702 leader_election.cc:304] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:27.530845 12327 raft_consensus.cc:2804] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.531579 12327 raft_consensus.cc:697] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:27.512019 11863 ts_tablet_manager.cc:1434] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.001s
I20260709 13:22:27.532521 12327 consensus_queue.cc:237] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:27.533278 11863 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:27.533897 11857 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:27.534387 11857 ts_tablet_manager.cc:1403] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.003s
I20260709 13:22:27.527025 11859 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e: No bootstrap required, opened a new log
I20260709 13:22:27.536547 11859 ts_tablet_manager.cc:1403] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.003s
I20260709 13:22:27.538079 11857 raft_consensus.cc:359] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.538888 11857 raft_consensus.cc:385] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.539197 11857 raft_consensus.cc:740] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.540145 11857 consensus_queue.cc:260] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.543077 11857 ts_tablet_manager.cc:1434] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:27.543830 11863 tablet_bootstrap.cc:654] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.547911 11858 tablet_bootstrap.cc:654] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.554600 11857 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:27.569847 11485 catalog_manager.cc:5697] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.574154 11859 raft_consensus.cc:359] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.575058 11859 raft_consensus.cc:385] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.575361 11859 raft_consensus.cc:740] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.576224 11859 consensus_queue.cc:260] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.579761 11859 ts_tablet_manager.cc:1434] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:22:27.623454 11857 tablet_bootstrap.cc:654] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.625540 11863 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:27.626261 11863 ts_tablet_manager.cc:1403] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.093s	user 0.048s	sys 0.025s
I20260709 13:22:27.627907 12327 raft_consensus.cc:493] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.628602 12327 raft_consensus.cc:515] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.632109 12327 leader_election.cc:290] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:27.634681 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2b87661f184408bcc049ddd64425c5" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:27.635516 11586 raft_consensus.cc:2468] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 0.
I20260709 13:22:27.636150 11858 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:27.636507 12190 raft_consensus.cc:493] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.636890 11858 ts_tablet_manager.cc:1403] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.001s
I20260709 13:22:27.637070 11702 leader_election.cc:304] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:27.645364 12232 raft_consensus.cc:2804] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.645823 12232 raft_consensus.cc:493] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.646155 12232 raft_consensus.cc:3060] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.647832 11858 raft_consensus.cc:359] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.648752 11858 raft_consensus.cc:385] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.649045 11858 raft_consensus.cc:740] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.650663 11857 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: No bootstrap required, opened a new log
I20260709 13:22:27.651232 11857 ts_tablet_manager.cc:1403] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.007s
I20260709 13:22:27.638708 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2b87661f184408bcc049ddd64425c5" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:27.639250 12190 raft_consensus.cc:515] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.656064 12190 leader_election.cc:290] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
W20260709 13:22:27.657055 11704 leader_election.cc:343] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.657150 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2b87661f184408bcc049ddd64425c5" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:27.661350 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2b87661f184408bcc049ddd64425c5" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:27.663051 11858 consensus_queue.cc:260] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.661844 11857 raft_consensus.cc:359] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.666785 11857 raft_consensus.cc:385] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.667316 11857 raft_consensus.cc:740] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.672235 12181 raft_consensus.cc:493] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.672955 12181 raft_consensus.cc:515] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.678123 12181 leader_election.cc:290] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:27.678040 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:27.679073 11586 raft_consensus.cc:2468] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:27.679986 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:27.680114 12190 consensus_queue.cc:1048] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.680751 11811 raft_consensus.cc:2468] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:27.682055 11628 leader_election.cc:304] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:27.683609 12064 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.684218 12056 raft_consensus.cc:2804] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.684711 12056 raft_consensus.cc:493] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.685747 12056 raft_consensus.cc:3060] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.684260 12064 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.688805 12064 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
W20260709 13:22:27.689894 11555 leader_election.cc:343] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.694772 11863 raft_consensus.cc:359] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.695550 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:27.695554 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:27.671408 11857 consensus_queue.cc:260] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.665912 11858 ts_tablet_manager.cc:1434] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:22:27.670073 12232 raft_consensus.cc:515] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.696122 11863 raft_consensus.cc:385] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.721372 11863 raft_consensus.cc:740] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.721145 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2b87661f184408bcc049ddd64425c5" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:27.696818 11735 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
W20260709 13:22:27.722800 11704 leader_election.cc:343] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.700619 12064 consensus_queue.cc:1048] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:22:27.704238 12190 raft_consensus.cc:493] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.726174 12190 raft_consensus.cc:515] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.728969 12190 leader_election.cc:290] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:27.707093 11858 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0: Bootstrap starting.
I20260709 13:22:27.718293 11738 raft_consensus.cc:2393] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in current term 1: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:27.717303 11857 ts_tablet_manager.cc:1434] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.001s
I20260709 13:22:27.768250 11863 consensus_queue.cc:260] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.775697 11863 ts_tablet_manager.cc:1434] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.001s
I20260709 13:22:27.775790 11811 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:27.777055 11863 tablet_bootstrap.cc:492] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:27.735625 11555 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
W20260709 13:22:27.777801 11555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 49577.5us
I20260709 13:22:27.779280 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2b87661f184408bcc049ddd64425c5" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:27.779994 11586 raft_consensus.cc:3060] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.780582 11555 leader_election.cc:304] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:27.781812 12248 raft_consensus.cc:2804] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.782241 12248 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.782590 12248 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.796779 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:27.747221 12056 raft_consensus.cc:515] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.730304 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:27.719857 12232 leader_election.cc:290] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:27.797765 11735 raft_consensus.cc:2468] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:27.799074 11658 raft_consensus.cc:2468] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 0.
I20260709 13:22:27.800431 11555 leader_election.cc:304] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:27.802651 12064 raft_consensus.cc:2804] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.803460 12064 raft_consensus.cc:493] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.803987 12064 raft_consensus.cc:3060] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.806811 11586 raft_consensus.cc:2468] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:27.813688 12247 raft_consensus.cc:2749] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.817214 11702 leader_election.cc:304] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:27.818365 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:27.819061 11812 raft_consensus.cc:3060] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.819818 12056 leader_election.cc:290] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:27.836752 11858 tablet_bootstrap.cc:654] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.832096 12199 raft_consensus.cc:2804] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.839572 11812 raft_consensus.cc:2468] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:27.841622 11630 leader_election.cc:304] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:27.842638 12056 raft_consensus.cc:2804] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.843161 12056 raft_consensus.cc:697] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:27.843962 12056 consensus_queue.cc:237] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.837610 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
W20260709 13:22:27.871894 11536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:27.873044 12248 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.875567 12248 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:27.879307 11586 raft_consensus.cc:3060] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.879866 12011 raft_consensus.cc:493] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.880533 12011 raft_consensus.cc:515] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:27.886991 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:27.887719 11812 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.885671 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:27.910069 11812 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:27.912977 12011 leader_election.cc:290] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:27.911597 11735 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.932369 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:27.933894 11555 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:27.935628 12011 raft_consensus.cc:2804] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.936132 12011 raft_consensus.cc:697] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:27.927723 12199 raft_consensus.cc:697] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:27.937729 12011 consensus_queue.cc:237] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:27.936019 11555 leader_election.cc:343] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.959692 11735 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:27.962219 12064 raft_consensus.cc:515] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:27.965456 11863 tablet_bootstrap.cc:654] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.967653 12199 consensus_queue.cc:237] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:27.980396 12064 leader_election.cc:290] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:27.980472 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:27.981278 11735 raft_consensus.cc:3060] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.006471 11485 catalog_manager.cc:5697] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:28.013864 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:28.016615 11704 consensus_peers.cc:597] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e -> Peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Couldn't send request to peer 01c914cf532f4dc19c1bab3514524ac2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:28.017462 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:28.018281 11661 raft_consensus.cc:3060] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.018792 11858 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0: No bootstrap required, opened a new log
I20260709 13:22:28.019630 11858 ts_tablet_manager.cc:1403] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0: Time spent bootstrapping tablet: real 0.313s	user 0.014s	sys 0.009s
W20260709 13:22:28.026441 11553 leader_election.cc:343] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:28.027060 11553 leader_election.cc:304] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:28.033838 12340 raft_consensus.cc:2749] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:28.040681 11858 raft_consensus.cc:359] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:28.042516 11858 raft_consensus.cc:385] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:28.042922 11858 raft_consensus.cc:740] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Initialized, Role: FOLLOWER
I20260709 13:22:28.042965 11735 raft_consensus.cc:2468] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
I20260709 13:22:28.043865 11858 consensus_queue.cc:260] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:28.046607 11858 ts_tablet_manager.cc:1434] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 13:22:28.050094 11555 leader_election.cc:304] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:28.052202 12340 raft_consensus.cc:2804] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:28.052806 12340 raft_consensus.cc:697] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:28.053646 11586 raft_consensus.cc:2468] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:28.053851 12340 consensus_queue.cc:237] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
W20260709 13:22:28.083380 11553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 48699us
I20260709 13:22:28.113143 11484 catalog_manager.cc:5697] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:28.128223 11486 catalog_manager.cc:5697] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 1 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.135066 11863 tablet_bootstrap.cc:492] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:28.135706 11863 ts_tablet_manager.cc:1403] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.359s	user 0.012s	sys 0.019s
I20260709 13:22:28.157635 12327 consensus_queue.cc:1048] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:28.162060 12056 raft_consensus.cc:493] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:28.165496 11863 raft_consensus.cc:359] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:28.166464 11863 raft_consensus.cc:385] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:28.166769 11863 raft_consensus.cc:740] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:28.167585 11863 consensus_queue.cc:260] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:28.137926 11661 raft_consensus.cc:2468] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 1.
W20260709 13:22:28.172983 12345 log.cc:927] Time spent T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:22:28.185700 11863 ts_tablet_manager.cc:1434] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.002s
I20260709 13:22:28.162779 12056 raft_consensus.cc:515] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:28.189477 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:28.190518 11586 raft_consensus.cc:2468] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 0.
I20260709 13:22:28.189487 11863 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:28.192306 12056 leader_election.cc:290] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:28.204465 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:28.192734 11628 leader_election.cc:304] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:28.206261 12334 raft_consensus.cc:2804] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:28.206753 12334 raft_consensus.cc:493] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:22:28.206756 11630 leader_election.cc:343] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:28.207294 12334 raft_consensus.cc:3060] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.222460 11863 tablet_bootstrap.cc:654] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:28.234084 11485 catalog_manager.cc:5697] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 1 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.264441 12056 consensus_queue.cc:1048] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:28.257764 12334 raft_consensus.cc:515] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:28.276859 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:28.279987 12334 leader_election.cc:290] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:28.281392 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:28.282102 11586 raft_consensus.cc:3060] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.282931 12207 raft_consensus.cc:493] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:28.284205 12207 raft_consensus.cc:515] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:28.287305 12207 leader_election.cc:290] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:28.290280 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b066170aeea34d52be3000a5f02c1804" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:28.295212 11630 leader_election.cc:343] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:28.295962 11863 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:28.296918 11863 ts_tablet_manager.cc:1403] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.005s
I20260709 13:22:28.298416 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b066170aeea34d52be3000a5f02c1804" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:28.311386 11863 raft_consensus.cc:359] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:28.312531 11863 raft_consensus.cc:385] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:28.313372 11863 raft_consensus.cc:740] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:28.314425 11863 consensus_queue.cc:260] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:28.333992 11776 leader_election.cc:304] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:28.341082 11863 ts_tablet_manager.cc:1434] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.006s
I20260709 13:22:28.320863 11586 raft_consensus.cc:2468] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:28.347878 12341 raft_consensus.cc:2749] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:28.363438 12337 consensus_queue.cc:1048] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:28.371322 12346 consensus_queue.cc:1048] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:28.377748 11628 leader_election.cc:304] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:28.383680 12181 raft_consensus.cc:2804] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:28.384392 12181 raft_consensus.cc:697] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:28.385453 12181 consensus_queue.cc:237] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:28.394461 11863 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2: Bootstrap starting.
I20260709 13:22:28.394968 11960 consensus_queue.cc:1048] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.478663 11807 raft_consensus.cc:3060] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.481156 12346 consensus_queue.cc:1048] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:28.485723 12341 raft_consensus.cc:493] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:28.486394 12341 raft_consensus.cc:515] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:28.493193 12341 leader_election.cc:290] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:28.495302 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:28.496483 11585 raft_consensus.cc:2393] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 1: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:28.498347 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:28.500706 11776 leader_election.cc:304] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:28.509493 12341 raft_consensus.cc:3060] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.494482 11863 tablet_bootstrap.cc:654] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:28.512161 11704 consensus_peers.cc:597] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869): Couldn't send request to peer 01c914cf532f4dc19c1bab3514524ac2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:28.565789 12342 consensus_queue.cc:1048] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:28.578739 12342 consensus_queue.cc:1048] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.588590 12341 raft_consensus.cc:2749] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:28.647308 11484 catalog_manager.cc:5697] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:28.662779 11863 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2: No bootstrap required, opened a new log
I20260709 13:22:28.663512 11863 ts_tablet_manager.cc:1403] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2: Time spent bootstrapping tablet: real 0.269s	user 0.016s	sys 0.001s
I20260709 13:22:28.687899 11863 raft_consensus.cc:359] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:28.698995 11863 raft_consensus.cc:385] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:28.699342 11863 raft_consensus.cc:740] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Initialized, Role: FOLLOWER
I20260709 13:22:28.701560 11863 consensus_queue.cc:260] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:28.704233 11863 ts_tablet_manager.cc:1434] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:22:28.872203 11960 consensus_queue.cc:1048] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:28.919639 11812 raft_consensus.cc:3060] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:29.028308 12338 consensus_queue.cc:1048] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:29.888458 11778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 52878us
W20260709 13:22:29.934973 11778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 45120.6us
I20260709 13:22:30.496397  3021 tablet_server.cc:179] TabletServer@127.2.243.65:0 shutting down...
W20260709 13:22:30.536401 11628 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:22:30.543689 11628 consensus_peers.cc:597] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.557869 11776 consensus_peers.cc:597] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.583624 11628 consensus_peers.cc:597] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.596742 11628 consensus_peers.cc:597] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.645591  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:22:30.648170 11702 consensus_peers.cc:597] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.652751 11776 consensus_peers.cc:597] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.657598  3021 tablet_replica.cc:333] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.659216  3021 raft_consensus.cc:2243] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.660420  3021 raft_consensus.cc:2272] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:30.662350 11702 consensus_peers.cc:597] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.664942  3021 tablet_replica.cc:333] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.666322  3021 raft_consensus.cc:2243] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.667197  3021 raft_consensus.cc:2272] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.671268  3021 tablet_replica.cc:333] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.672524  3021 raft_consensus.cc:2243] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.673400  3021 raft_consensus.cc:2272] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.678669  3021 tablet_replica.cc:333] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
W20260709 13:22:30.680070 11702 consensus_peers.cc:597] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.681301  3021 raft_consensus.cc:2243] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:30.682189 11776 consensus_peers.cc:597] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.683139  3021 raft_consensus.cc:2272] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.688266  3021 tablet_replica.cc:333] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
W20260709 13:22:30.688457 11702 consensus_peers.cc:597] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.689504  3021 raft_consensus.cc:2243] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.690730  3021 raft_consensus.cc:2272] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.693730  3021 tablet_replica.cc:333] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.694583  3021 raft_consensus.cc:2243] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.695701  3021 raft_consensus.cc:2272] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.699465  3021 tablet_replica.cc:333] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.701170  3021 raft_consensus.cc:2243] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.701983  3021 raft_consensus.cc:2272] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:30.702867 11702 consensus_peers.cc:597] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.706073  3021 tablet_replica.cc:333] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
W20260709 13:22:30.706069 11628 consensus_peers.cc:597] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.707521  3021 raft_consensus.cc:2243] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:30.707849 11776 consensus_peers.cc:597] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.709357  3021 raft_consensus.cc:2272] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:30.713189 11776 consensus_peers.cc:597] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.714022  3021 tablet_replica.cc:333] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.715158  3021 raft_consensus.cc:2243] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.716125  3021 raft_consensus.cc:2272] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.720170  3021 tablet_replica.cc:333] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.721223  3021 raft_consensus.cc:2243] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.722208  3021 raft_consensus.cc:2272] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.726787  3021 tablet_replica.cc:333] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.727769  3021 raft_consensus.cc:2243] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.728955  3021 raft_consensus.cc:2272] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.733129  3021 tablet_replica.cc:333] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.733927  3021 raft_consensus.cc:2243] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.735095  3021 raft_consensus.cc:2272] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.738862  3021 tablet_replica.cc:333] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.740093  3021 raft_consensus.cc:2243] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.741604  3021 raft_consensus.cc:2272] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.745824  3021 tablet_replica.cc:333] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
W20260709 13:22:30.746400 11628 consensus_peers.cc:597] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.746768  3021 raft_consensus.cc:2243] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.747673  3021 raft_consensus.cc:2272] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.751749  3021 tablet_replica.cc:333] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.753024  3021 raft_consensus.cc:2243] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.754418  3021 raft_consensus.cc:2272] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.758227  3021 tablet_replica.cc:333] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.759310  3021 raft_consensus.cc:2243] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.760787  3021 raft_consensus.cc:2272] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.764561  3021 tablet_replica.cc:333] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.765693  3021 raft_consensus.cc:2243] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.766530  3021 raft_consensus.cc:2272] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:30.766307 11776 consensus_peers.cc:597] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.768514 11776 consensus_peers.cc:597] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.771003  3021 tablet_replica.cc:333] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.772017  3021 raft_consensus.cc:2243] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.772672  3021 raft_consensus.cc:2272] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.775627  3021 tablet_replica.cc:333] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.776654  3021 raft_consensus.cc:2243] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.777318  3021 raft_consensus.cc:2272] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.781219  3021 tablet_replica.cc:333] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.782003  3021 raft_consensus.cc:2243] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.783511  3021 raft_consensus.cc:2272] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.788098  3021 tablet_replica.cc:333] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.789626  3021 raft_consensus.cc:2243] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.796362  3021 raft_consensus.cc:2272] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.801057  3021 tablet_replica.cc:333] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.802029  3021 raft_consensus.cc:2243] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:30.802419 11628 consensus_peers.cc:597] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.803704  3021 raft_consensus.cc:2272] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.810750  3021 tablet_replica.cc:333] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.811900  3021 raft_consensus.cc:2243] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.813441  3021 raft_consensus.cc:2272] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.817101  3021 tablet_replica.cc:333] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.818090  3021 raft_consensus.cc:2243] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.819522  3021 raft_consensus.cc:2272] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.823459  3021 tablet_replica.cc:333] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.824153  3021 raft_consensus.cc:2243] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.824848  3021 raft_consensus.cc:2272] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.827592  3021 tablet_replica.cc:333] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.828476  3021 raft_consensus.cc:2243] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.829160  3021 raft_consensus.cc:2272] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.833891  3021 tablet_replica.cc:333] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.834807  3021 raft_consensus.cc:2243] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.835525  3021 raft_consensus.cc:2272] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.838546  3021 tablet_replica.cc:333] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.839208  3021 raft_consensus.cc:2243] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.839835  3021 raft_consensus.cc:2272] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.842830  3021 tablet_replica.cc:333] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.843869  3021 raft_consensus.cc:2243] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.844715  3021 raft_consensus.cc:2272] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.848588  3021 tablet_replica.cc:333] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.849583  3021 raft_consensus.cc:2243] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.850942  3021 raft_consensus.cc:2272] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.854353  3021 tablet_replica.cc:333] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
W20260709 13:22:30.855156 11628 consensus_peers.cc:597] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.855358  3021 raft_consensus.cc:2243] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.856666  3021 raft_consensus.cc:2272] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.860545  3021 tablet_replica.cc:333] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.861455  3021 raft_consensus.cc:2243] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.862931  3021 raft_consensus.cc:2272] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.866935  3021 tablet_replica.cc:333] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.867992  3021 raft_consensus.cc:2243] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.869390  3021 raft_consensus.cc:2272] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.873752  3021 tablet_replica.cc:333] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.874575  3021 raft_consensus.cc:2243] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.875243  3021 raft_consensus.cc:2272] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.879541  3021 tablet_replica.cc:333] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.880762  3021 raft_consensus.cc:2243] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.882376  3021 raft_consensus.cc:2272] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.886831  3021 tablet_replica.cc:333] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.888000  3021 raft_consensus.cc:2243] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.888836  3021 raft_consensus.cc:2272] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.892938  3021 tablet_replica.cc:333] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.894102  3021 raft_consensus.cc:2243] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.894901  3021 raft_consensus.cc:2272] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.898824  3021 tablet_replica.cc:333] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.899857  3021 raft_consensus.cc:2243] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.900574  3021 raft_consensus.cc:2272] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.904439  3021 tablet_replica.cc:333] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.905375  3021 raft_consensus.cc:2243] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.906807  3021 raft_consensus.cc:2272] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.910610  3021 tablet_replica.cc:333] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.911688  3021 raft_consensus.cc:2243] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.912600  3021 raft_consensus.cc:2272] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.916263  3021 tablet_replica.cc:333] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.917255  3021 raft_consensus.cc:2243] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.918051  3021 raft_consensus.cc:2272] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.921670  3021 tablet_replica.cc:333] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.922847  3021 raft_consensus.cc:2243] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.923745  3021 raft_consensus.cc:2272] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:30.925379 11702 consensus_peers.cc:597] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.927873  3021 tablet_replica.cc:333] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.929051  3021 raft_consensus.cc:2243] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.929821  3021 raft_consensus.cc:2272] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.933698  3021 tablet_replica.cc:333] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.934546  3021 raft_consensus.cc:2243] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.935869  3021 raft_consensus.cc:2272] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.939689  3021 tablet_replica.cc:333] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: stopping tablet replica
I20260709 13:22:30.940557  3021 raft_consensus.cc:2243] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.941241  3021 raft_consensus.cc:2272] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:30.957331 11628 consensus_peers.cc:597] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.988885 11628 consensus_peers.cc:597] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.998080 11628 consensus_peers.cc:597] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:31.005916 11628 consensus_peers.cc:597] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:31.062042 11776 consensus_peers.cc:597] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:31.085425  3021 tablet_server.cc:196] TabletServer@127.2.243.65:0 shutdown complete.
I20260709 13:22:31.727478  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:31.740100 12422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:31.742084 12423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:31.745990 12425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:31.746434  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:31.753163  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:31.753535  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:31.753782  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603351753758 us; error 0 us; skew 500 ppm
I20260709 13:22:31.754415  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:31.758495  3021 webserver.cc:533] Webserver started at http://127.2.243.65:43987/ using document root <none> and password file <none>
I20260709 13:22:31.759147  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:31.759392  3021 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:22:31.763767 12412 raft_consensus.cc:493] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.764736 12412 raft_consensus.cc:515] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:31.774111 12405 raft_consensus.cc:493] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.774837 12405 raft_consensus.cc:515] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.777040 12405 leader_election.cc:290] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:31.780215 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce85d6ba19f471b90132d5118bc8478" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:31.788225 11702 leader_election.cc:336] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.789216 12418 raft_consensus.cc:493] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.790058 12418 raft_consensus.cc:515] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:31.796778 11702 leader_election.cc:304] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:31.798698 12405 raft_consensus.cc:2749] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:31.801422 11776 leader_election.cc:336] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.803838 12412 leader_election.cc:290] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:31.804845 12418 leader_election.cc:290] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:31.809062 12405 raft_consensus.cc:493] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.809957 12405 raft_consensus.cc:515] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:31.814796 12405 leader_election.cc:290] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:31.815186 11628 leader_election.cc:336] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.816026 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:31.818521 12418 raft_consensus.cc:493] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.822738 12418 raft_consensus.cc:515] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.822932 11630 leader_election.cc:304] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:31.824486 12397 raft_consensus.cc:2749] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:31.826131 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:31.826660 12418 leader_election.cc:290] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:31.828012 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:31.830385  3021 fs_manager.cc:714] Time spent opening directory manager: real 0.070s	user 0.017s	sys 0.039s
I20260709 13:22:31.831959 11776 leader_election.cc:304] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:31.833412 12412 raft_consensus.cc:2749] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:31.834134 11628 leader_election.cc:336] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.835227 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce85d6ba19f471b90132d5118bc8478" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:31.836027 11735 raft_consensus.cc:2468] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:31.837651 12397 raft_consensus.cc:493] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.838321 12397 raft_consensus.cc:515] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.840764 11630 leader_election.cc:304] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:31.842834 12417 raft_consensus.cc:2804] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:31.843323 12417 raft_consensus.cc:493] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.843756 12417 raft_consensus.cc:3060] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:31.847105 12420 raft_consensus.cc:493] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.847894 12420 raft_consensus.cc:515] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
W20260709 13:22:31.848555 11628 leader_election.cc:336] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.851184 12420 leader_election.cc:290] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:31.852182 12397 leader_election.cc:290] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:31.843338 11702 leader_election.cc:336] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.857788 12430 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:22:31.857685 11628 leader_election.cc:336] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.857491 11702 leader_election.cc:304] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:31.859889 12411 raft_consensus.cc:2749] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:31.860397  3021 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:22:31.860883  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-ftjc"
I20260709 13:22:31.861493  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:31.862723 12417 raft_consensus.cc:515] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.863914 12411 raft_consensus.cc:493] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.864574 12411 raft_consensus.cc:515] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.866254 12417 leader_election.cc:290] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:31.867939 12411 leader_election.cc:290] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:31.875281 11628 leader_election.cc:336] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.881287 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:31.883443 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:31.887786 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce85d6ba19f471b90132d5118bc8478" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:31.888734 11735 raft_consensus.cc:3060] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:31.897540 12417 raft_consensus.cc:493] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.898311 12417 raft_consensus.cc:515] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.898790 11735 raft_consensus.cc:2468] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:31.900735 12417 leader_election.cc:290] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:31.918534 11628 leader_election.cc:336] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.925004 12412 raft_consensus.cc:493] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.926537 12412 raft_consensus.cc:515] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:31.933166 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:31.934165 11661 raft_consensus.cc:2468] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
W20260709 13:22:31.939332 11776 leader_election.cc:336] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:31.940153 11630 leader_election.cc:304] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:31.943341 12417 raft_consensus.cc:2749] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:31.945267 11630 leader_election.cc:304] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:31.946621 12417 raft_consensus.cc:2749] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:31.949910 11630 leader_election.cc:304] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:31.950994 12397 raft_consensus.cc:2804] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:31.951751 12397 raft_consensus.cc:697] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:31.953274 12397 consensus_queue.cc:237] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.958737 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:31.959514 11735 raft_consensus.cc:2468] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:31.960654 12411 raft_consensus.cc:493] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.961380 12411 raft_consensus.cc:515] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.963997 12411 leader_election.cc:290] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:31.965039 12418 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.965760 12418 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.968631 12418 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:31.972371 12412 leader_election.cc:290] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:31.978338 11702 leader_election.cc:304] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:31.981156 12411 raft_consensus.cc:2804] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:31.981812 12411 raft_consensus.cc:493] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.982496 12411 raft_consensus.cc:3060] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:31.993538 12411 raft_consensus.cc:515] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.995484 12420 raft_consensus.cc:493] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:31.996160 12420 raft_consensus.cc:515] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:31.996691 12411 leader_election.cc:290] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:31.998641 12420 leader_election.cc:290] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:32.007347 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.015110 11630 leader_election.cc:304] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.016481 12420 raft_consensus.cc:2804] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.017014 12420 raft_consensus.cc:493] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.017458 12420 raft_consensus.cc:3060] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.027920 11776 leader_election.cc:304] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:32.029502 12412 raft_consensus.cc:2749] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.029688 12420 raft_consensus.cc:515] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.031363 12412 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.032191 12412 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.034441 12414 raft_consensus.cc:493] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.035058 12414 raft_consensus.cc:515] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.036755 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.037262 12414 leader_election.cc:290] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.037868 11658 raft_consensus.cc:2468] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
W20260709 13:22:32.039597 11702 leader_election.cc:336] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.040060 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:32.044633 11487 catalog_manager.cc:5697] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.031322 12405 raft_consensus.cc:493] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.055327 12405 raft_consensus.cc:515] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.058451 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.062099 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:32.069679 11628 leader_election.cc:336] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.071734 11702 leader_election.cc:336] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.045002 12420 leader_election.cc:290] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:32.074303 11658 raft_consensus.cc:2393] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 2: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:32.044605 12412 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.079339 11702 leader_election.cc:304] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.078336 12420 raft_consensus.cc:493] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.078644 12412 raft_consensus.cc:493] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.080417 12411 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
W20260709 13:22:32.101389 12434 log.cc:927] Time spent T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:22:32.101876 12412 raft_consensus.cc:515] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.086920 12404 raft_consensus.cc:2804] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.099534 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:32.114967 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:32.111503 12404 raft_consensus.cc:493] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.103348 12411 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.112222 12397 raft_consensus.cc:493] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.122571 12397 raft_consensus.cc:515] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.124593 12404 raft_consensus.cc:3060] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.125530 12397 leader_election.cc:290] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.126338 12412 leader_election.cc:290] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.127751 12397 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.128369 12397 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.104157 12420 raft_consensus.cc:515] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.130791 12420 leader_election.cc:290] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.131791 11739 raft_consensus.cc:2393] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 2: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:32.131662 12399 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.124872 12405 leader_election.cc:290] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.132859 12405 raft_consensus.cc:493] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.132572 12399 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.133517 12405 raft_consensus.cc:515] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.135129 12399 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.135646 12405 leader_election.cc:290] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.131561 12397 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:32.140815 11702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 51696.6us
I20260709 13:22:32.143930 12414 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.144734 12414 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.145785 11630 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:32.146965 12397 raft_consensus.cc:2749] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.147807 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.146054 12436 raft_consensus.cc:493] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.149300 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.149209 12436 raft_consensus.cc:515] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.150180 11661 raft_consensus.cc:2468] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:32.148600 11658 raft_consensus.cc:2468] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
W20260709 13:22:32.152787 11702 leader_election.cc:336] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.153292 11702 leader_election.cc:304] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:32.154033 12414 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.154593 12412 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.155361 12412 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.157454 12397 raft_consensus.cc:493] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.157835 12412 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.158126 12397 raft_consensus.cc:515] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:32.158874 11628 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 88417.3us
I20260709 13:22:32.123855 12411 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.160566 12397 leader_election.cc:290] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.158703 12439 raft_consensus.cc:2749] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.163666 12436 leader_election.cc:290] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.159169 12437 raft_consensus.cc:493] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.163506 12412 raft_consensus.cc:493] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.165329 12412 raft_consensus.cc:515] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:32.166069 11702 leader_election.cc:336] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.169835 12412 leader_election.cc:290] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:32.171615 11702 leader_election.cc:336] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.173707 11702 leader_election.cc:336] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.173959 12420 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.171454 12436 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.164777 12437 raft_consensus.cc:515] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.174876 12420 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.175581 12436 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.177970 12436 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:32.178510 11702 leader_election.cc:336] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.178787 12420 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:32.182796 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:32.183648 11702 leader_election.cc:336] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.185427 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:32.186089 11735 raft_consensus.cc:2468] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:32.187069 12437 leader_election.cc:290] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.188859 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.189847 11658 raft_consensus.cc:2468] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:32.187079 11702 leader_election.cc:304] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.194087 12437 raft_consensus.cc:2804] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.194551 12437 raft_consensus.cc:493] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.194985 12437 raft_consensus.cc:3060] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.195780 11702 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.197019 12436 raft_consensus.cc:2804] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.197525 12436 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.198007 12436 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.206383 11776 leader_election.cc:336] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.207193 11776 leader_election.cc:336] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.207625 11776 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:32.211001 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:32.208824 12412 raft_consensus.cc:2749] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.211802 11735 raft_consensus.cc:2468] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:32.212464 12418 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.213047 12418 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.215095 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:32.215307 12412 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.216878 12412 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.219098 12412 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.219408 11778 leader_election.cc:304] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:32.220373 12412 raft_consensus.cc:2804] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.220777 12412 raft_consensus.cc:493] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.221134 12412 raft_consensus.cc:3060] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.221959 11630 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:32.223807 12420 raft_consensus.cc:2804] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.224319 12420 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.224941 12420 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.225365  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:32.227456  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:32.229163 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.229979 11658 raft_consensus.cc:2468] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:32.224705 12418 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.223419 12437 raft_consensus.cc:515] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.237321 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.238175 11658 raft_consensus.cc:2468] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
W20260709 13:22:32.238435 11628 leader_election.cc:336] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.238946 12404 raft_consensus.cc:515] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.239427 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.240125 11661 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:32.241532 12404 leader_election.cc:290] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.241357 11738 raft_consensus.cc:2393] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 2: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
I20260709 13:22:32.242260 12437 leader_election.cc:290] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.244316 12436 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.245723 12341 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.246322 12341 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.246799 12436 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.249213 12341 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.241428 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.251971  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:32.252283 12418 raft_consensus.cc:493] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.252935 12418 raft_consensus.cc:515] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.253806 11702 leader_election.cc:304] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:32.255344 12418 leader_election.cc:290] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:32.256597 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.256767 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.257361 11811 raft_consensus.cc:2468] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:32.257437 11812 raft_consensus.cc:2468] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:32.258530 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:32.258893 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.259306 11738 raft_consensus.cc:2468] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
I20260709 13:22:32.259655 11812 raft_consensus.cc:2468] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:32.260025 12420 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.261402 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.263190 12420 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:32.263871 11778 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:32.266572 12414 raft_consensus.cc:2804] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.267143 12414 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.267256 12436 raft_consensus.cc:2749] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.267622 12414 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.267891 12412 raft_consensus.cc:515] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.270387 11702 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:32.266592 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.272383 11812 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:32.274842 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea5a35807cf47a18b69b5d51e415e5b" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.275583 11808 raft_consensus.cc:2468] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:32.276263 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.277122 11807 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:32.278636 11702 leader_election.cc:304] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:32.279340 12436 raft_consensus.cc:2804] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.280071 12436 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.280614 12436 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.287107 11628 leader_election.cc:336] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.287973 11628 leader_election.cc:304] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:32.288980 12418 raft_consensus.cc:2749] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:22:32.289229 11628 leader_election.cc:336] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.290066 11628 leader_election.cc:336] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.290907 12437 raft_consensus.cc:2804] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.293222 12404 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.299918 12437 raft_consensus.cc:493] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.300546 12437 raft_consensus.cc:3060] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.300161 12404 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.303983 12404 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:32.293259 11702 leader_election.cc:336] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.270414 12412 leader_election.cc:290] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.308298 11630 leader_election.cc:304] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:32.308327 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90928a613c2450bb00632a65064996a" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.309243 11664 raft_consensus.cc:3060] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.310593 11778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 46816.7us
I20260709 13:22:32.312464 12412 raft_consensus.cc:493] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.312928 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:32.313103 12412 raft_consensus.cc:515] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.313690 11738 raft_consensus.cc:2468] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:32.314793 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.315471 11658 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.318089 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:32.318711 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afee18061f56422e9609aa51229df7a9" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:32.319330 11739 raft_consensus.cc:3060] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.319916 11702 leader_election.cc:336] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.318218 11628 leader_election.cc:336] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.324628 11628 leader_election.cc:336] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.325335 11628 leader_election.cc:336] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.324958 12414 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.328404 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:32.328860 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.329129 11738 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.329612 11807 raft_consensus.cc:2468] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 1.
I20260709 13:22:32.331141 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04373c0b8b6d47c5a1e07da5a04be2a4" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.331881 11661 raft_consensus.cc:3060] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.335405 11630 leader_election.cc:304] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.336907 12420 raft_consensus.cc:2804] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.337368 12420 raft_consensus.cc:493] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.337903 12420 raft_consensus.cc:3060] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.337873 11630 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.339007 12397 raft_consensus.cc:2804] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.339481 12397 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.339856 12397 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.344707 11628 leader_election.cc:336] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.346095 11630 leader_election.cc:304] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.347064 12420 raft_consensus.cc:515] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.337297 12412 leader_election.cc:290] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.351171 12417 raft_consensus.cc:2804] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.351786 12417 raft_consensus.cc:493] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.352210 12417 raft_consensus.cc:3060] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.351972 12437 raft_consensus.cc:515] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.351328 11704 leader_election.cc:304] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.357033 11704 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.359155 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.359493 11738 raft_consensus.cc:2468] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:32.355510 11630 leader_election.cc:304] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
W20260709 13:22:32.361361 11702 leader_election.cc:336] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.362517 12404 raft_consensus.cc:2804] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.368708 12404 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.369199 12404 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.367724 12436 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.371367 11735 raft_consensus.cc:2393] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 2: Already voted for candidate d59c3f822e674346af71ca9a5d899c2e in this term.
W20260709 13:22:32.368173 11702 leader_election.cc:336] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.372902 11628 leader_election.cc:336] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.373575 11628 leader_election.cc:336] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.373970 11664 raft_consensus.cc:2468] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
I20260709 13:22:32.360762 12440 raft_consensus.cc:2804] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.358924 11739 raft_consensus.cc:2468] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:32.363554 12437 leader_election.cc:290] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:32.372977 11702 leader_election.cc:336] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.374753 12418 raft_consensus.cc:2749] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.379043 11661 raft_consensus.cc:2468] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
I20260709 13:22:32.373318 11778 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:32.359169 12414 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:32.381381 11702 leader_election.cc:336] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.382921 11778 leader_election.cc:304] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:32.382388 12412 raft_consensus.cc:2804] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.389297 12412 raft_consensus.cc:697] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:32.390372 12412 consensus_queue.cc:237] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.388269 12445 raft_consensus.cc:2804] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.381705 12440 raft_consensus.cc:493] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.397821 11704 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.400698 12440 raft_consensus.cc:3060] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.402586 12411 raft_consensus.cc:2804] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.408990 12449 raft_consensus.cc:2749] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.408778 12397 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:32.409904 11702 leader_election.cc:336] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.411089 12397 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.411978 11660 raft_consensus.cc:2393] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 2: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:32.412315 12418 raft_consensus.cc:493] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.412937 12418 raft_consensus.cc:515] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:32.413691 11702 leader_election.cc:336] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.413924 12411 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.418628 12411 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.404817 12447 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:22:32.420208 11658 raft_consensus.cc:2468] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
I20260709 13:22:32.425946 12445 raft_consensus.cc:697] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:32.429702 12445 consensus_queue.cc:237] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.429739 12420 leader_election.cc:290] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.431933 12417 raft_consensus.cc:515] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.423610 12436 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.446938 11776 leader_election.cc:304] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.448470 11776 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:32.449221 12414 raft_consensus.cc:2804] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.449604 12414 raft_consensus.cc:493] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.449962 12414 raft_consensus.cc:3060] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.465039 12414 raft_consensus.cc:515] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:32.467324 11776 leader_election.cc:336] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.469708 11776 leader_election.cc:336] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.470075 11776 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:32.473304 12414 leader_election.cc:290] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:32.481087 11628 leader_election.cc:336] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.484596 12454 raft_consensus.cc:2804] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.485508 12454 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.486631 12454 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.486223 11487 catalog_manager.cc:5697] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:32.493813 11776 leader_election.cc:336] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.494832 11776 leader_election.cc:336] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.495216 11630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 139729us
W20260709 13:22:32.495906 11628 leader_election.cc:336] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.495298 11776 leader_election.cc:304] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:32.493958 12412 raft_consensus.cc:2749] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:32.497445 11628 leader_election.cc:336] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.498160 12414 raft_consensus.cc:2749] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.502283 11630 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.503333 12420 raft_consensus.cc:2804] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.503785 12420 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.504141 12420 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.485549 12418 leader_election.cc:290] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:32.508589 11628 leader_election.cc:336] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.510195 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:32.510965 11658 raft_consensus.cc:2468] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 1.
W20260709 13:22:32.512902 11776 leader_election.cc:336] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.513520 11776 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:32.515200 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34ebde4550a418cbfe562463c26adc4" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.515980 11660 raft_consensus.cc:3060] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.517407 11776 leader_election.cc:336] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.518298 11776 leader_election.cc:336] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.519137 11776 leader_election.cc:336] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.461683 12417 leader_election.cc:290] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.515403 12412 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.458029 12404 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.505103 12454 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.529356 12411 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.534214 12404 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.547637 12412 raft_consensus.cc:2749] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.542001 12411 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:32.551230 11776 leader_election.cc:336] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.553027 11776 leader_election.cc:336] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.551499 11702 leader_election.cc:304] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.554373 12454 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.555214 12404 raft_consensus.cc:2804] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.555975 12404 raft_consensus.cc:697] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:32.520001 12440 raft_consensus.cc:515] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.558071 11630 leader_election.cc:304] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.554620 11702 leader_election.cc:304] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.558902 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f452676fac6242168986700b221e358e" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:32.559165 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fcdc9e0ad5475990fbcb8439ad5485" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:32.559604 11812 raft_consensus.cc:3060] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.559754 11811 raft_consensus.cc:3060] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.560526 12405 raft_consensus.cc:2804] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.560693 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:32.561146 12405 raft_consensus.cc:697] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:32.562139 12405 consensus_queue.cc:237] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.559845 11702 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.565836 12404 consensus_queue.cc:237] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
W20260709 13:22:32.576016 11702 leader_election.cc:336] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.577706 12417 raft_consensus.cc:2804] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.578605 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:32.578835 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:32.578660 12417 raft_consensus.cc:493] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.579535 11810 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.579852 12417 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.579414 11808 raft_consensus.cc:2468] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:32.585265 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:32.586150 11813 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.585427 11487 catalog_manager.cc:5697] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.577913 12436 raft_consensus.cc:2804] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.588407 12436 raft_consensus.cc:697] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:32.589380 12436 consensus_queue.cc:237] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.579610 11776 leader_election.cc:304] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.596113 11812 raft_consensus.cc:2468] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:32.600718 12440 leader_election.cc:290] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.603600 11660 raft_consensus.cc:2468] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:32.597780 12417 raft_consensus.cc:515] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:32.605561 11628 consensus_peers.cc:597] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.606350 12417 leader_election.cc:290] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:32.547930 12420 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.616640 11811 raft_consensus.cc:2468] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:32.620700 12420 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:32.623064 11628 leader_election.cc:336] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.623523 12454 raft_consensus.cc:2804] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.624055 12454 raft_consensus.cc:493] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.624490 12454 raft_consensus.cc:3060] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.628249 11810 raft_consensus.cc:2468] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
I20260709 13:22:32.629338 11630 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
W20260709 13:22:32.631083 11630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 53548.4us
I20260709 13:22:32.633255 11807 raft_consensus.cc:2468] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
W20260709 13:22:32.629953 11702 leader_election.cc:336] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:32.635075 11702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 56829.1us
W20260709 13:22:32.635171 11628 leader_election.cc:336] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.635456 11776 leader_election.cc:304] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.634428 12417 raft_consensus.cc:2749] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.638880 12445 raft_consensus.cc:2804] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.639530 12445 raft_consensus.cc:697] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:32.643112 11704 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.672463 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.673563 11664 raft_consensus.cc:3060] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.669965 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea5a35807cf47a18b69b5d51e415e5b" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:32.677084 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.677440 11807 raft_consensus.cc:3060] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.678032 11658 raft_consensus.cc:2393] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 2: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:32.669974 12411 raft_consensus.cc:2804] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.680621 11813 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
I20260709 13:22:32.689208 12411 raft_consensus.cc:697] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:32.694713 11664 raft_consensus.cc:2468] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
I20260709 13:22:32.700495 11807 raft_consensus.cc:2468] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
I20260709 13:22:32.702617 11704 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.704795 11704 leader_election.cc:304] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:32.706192 12437 raft_consensus.cc:2804] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.640636 12445 consensus_queue.cc:237] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.707024 12437 raft_consensus.cc:697] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:32.707484 12439 raft_consensus.cc:2804] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:22:32.708559 11702 leader_election.cc:336] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.693437 12411 consensus_queue.cc:237] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.739269 12437 consensus_queue.cc:237] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:32.747879 11776 leader_election.cc:336] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.755781 11776 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:32.749832 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.757064 11658 raft_consensus.cc:2393] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d59c3f822e674346af71ca9a5d899c2e in current term 2: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:32.761651 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:32.766690 12439 raft_consensus.cc:697] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:32.770339 12454 raft_consensus.cc:515] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.770813 12439 consensus_queue.cc:237] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:32.770753 11487 catalog_manager.cc:5697] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 2 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.772783 12454 leader_election.cc:290] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:32.773099 11487 catalog_manager.cc:5697] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 2 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.758440 12412 raft_consensus.cc:2749] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.778462 11812 raft_consensus.cc:2393] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 2: Already voted for candidate 01c914cf532f4dc19c1bab3514524ac2 in this term.
I20260709 13:22:32.779587 11630 leader_election.cc:304] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.780251 11702 leader_election.cc:304] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.782672 11739 raft_consensus.cc:1275] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:32.782871 12455 raft_consensus.cc:2804] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.783455 12455 raft_consensus.cc:493] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:32.784134 12455 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.785810 11630 leader_election.cc:304] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.797475 12440 raft_consensus.cc:2804] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.801366 11630 leader_election.cc:304] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.802690 11630 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.807942 12453 raft_consensus.cc:2804] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.808686 12453 raft_consensus.cc:697] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
W20260709 13:22:32.810125 11776 leader_election.cc:336] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.809749 12453 consensus_queue.cc:237] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.798307 12440 raft_consensus.cc:697] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:32.811532 12440 consensus_queue.cc:237] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:32.798789 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486dc6cde7764b78aa07d583ef365e55" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:32.818987 11658 raft_consensus.cc:3060] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.804143 12449 raft_consensus.cc:2804] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.825574 12420 raft_consensus.cc:2804] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.849893 11735 raft_consensus.cc:1275] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:32.849524 11630 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
W20260709 13:22:32.851397 11702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 71234.9us
I20260709 13:22:32.855873 12420 raft_consensus.cc:697] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:32.857033 12455 raft_consensus.cc:515] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.857323 12420 consensus_queue.cc:237] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.859709 12455 leader_election.cc:290] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:32.860368 12449 raft_consensus.cc:697] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:32.861665 12449 consensus_queue.cc:237] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.864666 12448 raft_consensus.cc:2749] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:22:32.866115 11776 consensus_peers.cc:597] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.869752 11658 raft_consensus.cc:2468] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:32.871992 11776 leader_election.cc:304] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.874394 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:32.875123 11812 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.878530 12414 raft_consensus.cc:2804] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.871465 12454 consensus_queue.cc:1048] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:22:32.885680 11702 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:32.888952 11812 raft_consensus.cc:2468] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:32.892181 11630 leader_election.cc:304] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:32.887224 12414 raft_consensus.cc:697] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:32.897207 12414 consensus_queue.cc:237] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.898867 12448 raft_consensus.cc:2804] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.899662 12448 raft_consensus.cc:697] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:32.905196 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:32.906210 11735 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.915546 11735 raft_consensus.cc:2468] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:32.900804 12404 raft_consensus.cc:2749] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.942617 12448 consensus_queue.cc:237] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:32.945947 11484 catalog_manager.cc:5697] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 2 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.942149 11487 catalog_manager.cc:5697] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.947825 11484 catalog_manager.cc:5697] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 2 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.956912 11485 catalog_manager.cc:5697] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.958194 11484 catalog_manager.cc:5697] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 2 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:32.963194 11628 leader_election.cc:336] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:32.963927 12451 consensus_queue.cc:1048] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:32.966859 11630 leader_election.cc:304] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:32.960029 11484 catalog_manager.cc:5697] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 2 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.970711 11484 catalog_manager.cc:5697] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 2 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.974306 12417 raft_consensus.cc:2804] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.978530 12417 raft_consensus.cc:697] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:32.979620 12417 consensus_queue.cc:237] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:32.980291 11776 consensus_peers.cc:597] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.994426 11664 raft_consensus.cc:1275] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer d59c3f822e674346af71ca9a5d899c2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:32.998795 11702 consensus_peers.cc:597] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:32.999938 11735 raft_consensus.cc:1275] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.007032 12405 consensus_queue.cc:1048] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:33.008260 12414 consensus_queue.cc:1048] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:33.024183 11776 consensus_peers.cc:597] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.051081 11702 consensus_peers.cc:597] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.096177 11702 consensus_peers.cc:597] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.096799 11702 consensus_peers.cc:597] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.099608 11661 raft_consensus.cc:1275] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer d59c3f822e674346af71ca9a5d899c2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.111541 12411 consensus_queue.cc:1048] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:22:33.135351 11776 consensus_peers.cc:597] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.140305 11487 catalog_manager.cc:5697] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:33.145114 11628 consensus_peers.cc:597] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.148528 11702 consensus_peers.cc:597] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.153788 11485 catalog_manager.cc:5697] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:33.156113 11485 catalog_manager.cc:5697] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:33.162386 11485 catalog_manager.cc:5697] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:33.164423 11485 catalog_manager.cc:5697] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 1 to 2, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:33.174758 11776 consensus_peers.cc:597] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:33.177582 11658 raft_consensus.cc:1275] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer d59c3f822e674346af71ca9a5d899c2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.186139 11807 raft_consensus.cc:1275] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer d59c3f822e674346af71ca9a5d899c2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.191036 12437 consensus_queue.cc:1048] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:33.216310 12437 consensus_queue.cc:1048] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:33.244012 11702 consensus_peers.cc:597] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:33.250602 11812 raft_consensus.cc:1275] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.253715 12453 consensus_queue.cc:1048] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.255342 11812 raft_consensus.cc:1275] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer d59c3f822e674346af71ca9a5d899c2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.260293 12460 consensus_queue.cc:1048] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:33.267962 11628 consensus_peers.cc:597] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.284323 11628 consensus_peers.cc:597] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.284896 11628 consensus_peers.cc:597] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.310690 11628 consensus_peers.cc:597] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.311380 11628 consensus_peers.cc:597] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.318066 11776 consensus_peers.cc:597] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.332274 11702 consensus_peers.cc:597] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.340807 11628 consensus_peers.cc:597] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.344563 11628 consensus_peers.cc:597] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.347801 11812 raft_consensus.cc:1275] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.351310 12453 consensus_queue.cc:1048] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.353173 11807 raft_consensus.cc:1275] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:33.364596 11628 consensus_peers.cc:597] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:33.368011 12453 consensus_queue.cc:1048] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:33.375003 11702 consensus_peers.cc:597] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.375584 11702 consensus_peers.cc:597] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.376068 11702 consensus_peers.cc:597] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.394842 11810 raft_consensus.cc:1275] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.396621 12453 consensus_queue.cc:1048] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:33.383455 11628 consensus_peers.cc:597] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.404183 12447 ts_tablet_manager.cc:548] Loading tablet metadata (19/45 complete)
I20260709 13:22:33.412935 11664 raft_consensus.cc:1275] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:33.417376 11628 consensus_peers.cc:597] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.417472 11813 raft_consensus.cc:1275] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer d59c3f822e674346af71ca9a5d899c2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.423019 11664 raft_consensus.cc:1275] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer d59c3f822e674346af71ca9a5d899c2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:33.425217 11702 consensus_peers.cc:597] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.432307 11628 consensus_peers.cc:597] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.436777 11628 consensus_peers.cc:597] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:33.445463 12445 consensus_queue.cc:1048] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:33.447090 11776 consensus_peers.cc:597] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:33.450848 11661 raft_consensus.cc:1275] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.440368 12437 consensus_queue.cc:1048] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:22:33.460072 12405 consensus_queue.cc:1048] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:33.487639 12450 consensus_queue.cc:1048] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:33.507553 11739 raft_consensus.cc:1275] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:33.522368 11776 consensus_peers.cc:597] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.523479 11776 consensus_peers.cc:597] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:33.535317 12455 consensus_queue.cc:1048] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:33.544781 11776 consensus_peers.cc:597] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.556854 11702 consensus_peers.cc:597] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.572471 11702 consensus_peers.cc:597] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.588665 11776 consensus_peers.cc:597] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.658293 11628 consensus_peers.cc:597] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.690807 11776 consensus_peers.cc:597] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.705583 11628 consensus_peers.cc:597] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:33.723305  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:22:33.723795  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 1.422s	user 0.010s	sys 0.004s
I20260709 13:22:33.724184  3021 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:22:33.744249 12437 raft_consensus.cc:493] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:33.745232 12437 raft_consensus.cc:515] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:33.751291 12437 leader_election.cc:290] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:33.752375 12447 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:33.753705 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:33.754515 11661 raft_consensus.cc:2468] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
W20260709 13:22:33.754928 11702 leader_election.cc:336] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:33.756232 11702 leader_election.cc:304] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:33.758154 12405 raft_consensus.cc:2804] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:22:33.758587 12405 raft_consensus.cc:493] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:33.758962 12405 raft_consensus.cc:3060] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:33.797969 12405 raft_consensus.cc:515] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:33.805286 12405 leader_election.cc:290] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:33.810384 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4660f6f974c4c96bc3c2ef61e90405f" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:33.813117 11661 raft_consensus.cc:3060] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:33.823278 11661 raft_consensus.cc:2468] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 3.
I20260709 13:22:33.827867 12447 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:33.831562 12447 tablet_bootstrap.cc:492] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:33.832392 12447 ts_tablet_manager.cc:1403] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.080s	user 0.037s	sys 0.015s
I20260709 13:22:33.835331 12447 raft_consensus.cc:359] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:33.836164 12447 raft_consensus.cc:740] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:33.837318 12447 consensus_queue.cc:260] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:33.859252 11702 leader_election.cc:336] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:33.859549 12447 ts_tablet_manager.cc:1434] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.027s	user 0.013s	sys 0.001s
I20260709 13:22:33.860953 12447 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:33.867820 11702 leader_election.cc:304] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:33.868857 12404 raft_consensus.cc:2804] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:33.869418 12404 raft_consensus.cc:697] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 3 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:33.870500 12404 consensus_queue.cc:237] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:33.907867 12447 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:33.909191 12447 tablet_bootstrap.cc:492] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:33.910044 12447 ts_tablet_manager.cc:1403] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.007s
I20260709 13:22:33.913118 12447 raft_consensus.cc:359] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:33.913916 12447 raft_consensus.cc:740] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:33.914665 12447 consensus_queue.cc:260] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:33.916699 12447 ts_tablet_manager.cc:1434] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:22:33.932669 12447 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:33.943811 11484 catalog_manager.cc:5697] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e reported cstate change: term changed from 1 to 3, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to d59c3f822e674346af71ca9a5d899c2e (127.2.243.67). New cstate: current_term: 3 leader_uuid: "d59c3f822e674346af71ca9a5d899c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:33.986910 12447 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:33.988103 12447 tablet_bootstrap.cc:492] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:33.988922 12447 ts_tablet_manager.cc:1403] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.011s
I20260709 13:22:33.991793 12447 raft_consensus.cc:359] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.005599 12447 raft_consensus.cc:740] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.006582 12447 consensus_queue.cc:260] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.008945 12447 ts_tablet_manager.cc:1434] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:22:34.010959 12447 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
W20260709 13:22:34.017824 11628 consensus_peers.cc:597] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:34.039601 12447 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.041481 12447 tablet_bootstrap.cc:492] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.042419 12447 ts_tablet_manager.cc:1403] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 13:22:34.047453 12447 raft_consensus.cc:359] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.050227 12447 raft_consensus.cc:740] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.051383 12447 consensus_queue.cc:260] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.054827 12447 ts_tablet_manager.cc:1434] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:34.055913 12447 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.075558 12447 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.076807 12447 tablet_bootstrap.cc:492] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.078051 12447 ts_tablet_manager.cc:1403] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 13:22:34.081274 12447 raft_consensus.cc:359] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:34.082106 12447 raft_consensus.cc:740] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.083313 12447 consensus_queue.cc:260] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:34.086342 12447 ts_tablet_manager.cc:1434] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:22:34.087431 12447 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.105384 12447 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.106616 12447 tablet_bootstrap.cc:492] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.107376 12447 ts_tablet_manager.cc:1403] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:22:34.112618 12447 raft_consensus.cc:359] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.114030 12447 raft_consensus.cc:740] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.115512 12447 consensus_queue.cc:260] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.119338 12447 ts_tablet_manager.cc:1434] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:22:34.120409 12447 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.143122 12447 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.144285 12447 tablet_bootstrap.cc:492] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.145076 12447 ts_tablet_manager.cc:1403] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.000s
I20260709 13:22:34.148155 12447 raft_consensus.cc:359] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:34.149088 12447 raft_consensus.cc:740] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.149868 12447 consensus_queue.cc:260] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:34.152897 12447 ts_tablet_manager.cc:1434] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:34.155596 12447 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.178519 12447 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.179709 12447 tablet_bootstrap.cc:492] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.180524 12447 ts_tablet_manager.cc:1403] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.000s
I20260709 13:22:34.183847 12447 raft_consensus.cc:359] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.184966 12447 raft_consensus.cc:740] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.185848 12447 consensus_queue.cc:260] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.188290 12447 ts_tablet_manager.cc:1434] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:34.191526 12447 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.239341  3021 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:22:34.239888  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.516s	user 0.375s	sys 0.014s
I20260709 13:22:34.240877 12447 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.242378 12447 tablet_bootstrap.cc:492] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.244829 12447 ts_tablet_manager.cc:1403] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.003s
I20260709 13:22:34.251600 12447 raft_consensus.cc:359] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:34.252755 12447 raft_consensus.cc:740] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.253891 12447 consensus_queue.cc:260] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:34.258070 12447 ts_tablet_manager.cc:1434] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
W20260709 13:22:34.259178 11630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 59360.7us
I20260709 13:22:34.261233 12447 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.316480 12447 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.318099 12447 tablet_bootstrap.cc:492] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.319242 12447 ts_tablet_manager.cc:1403] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.012s
I20260709 13:22:34.323501 12447 raft_consensus.cc:359] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.324654 12447 raft_consensus.cc:740] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.326093 12447 consensus_queue.cc:260] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.330909 12447 ts_tablet_manager.cc:1434] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:22:34.332309 12447 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.360132 12447 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.361743 12447 tablet_bootstrap.cc:492] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.362756 12447 ts_tablet_manager.cc:1403] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.012s
I20260709 13:22:34.366886 12447 raft_consensus.cc:359] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.368685 12447 raft_consensus.cc:740] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.370090 12447 consensus_queue.cc:260] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.374125 12447 ts_tablet_manager.cc:1434] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:22:34.375411 12447 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
W20260709 13:22:34.407917 11702 consensus_peers.cc:597] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:34.421021 12447 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.422281 12447 tablet_bootstrap.cc:492] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.423056 12447 ts_tablet_manager.cc:1403] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.012s
I20260709 13:22:34.430245 12447 raft_consensus.cc:359] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.431259 12447 raft_consensus.cc:740] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.432157 12447 consensus_queue.cc:260] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.434762 12447 ts_tablet_manager.cc:1434] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:22:34.435720 12447 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.498697 11664 raft_consensus.cc:1275] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Refusing update from remote peer d59c3f822e674346af71ca9a5d899c2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:34.504866 12404 consensus_queue.cc:1048] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:34.596282 12447 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.604990 12447 tablet_bootstrap.cc:492] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.605722 12447 ts_tablet_manager.cc:1403] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.004s
I20260709 13:22:34.608599 12450 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:34.609241 12450 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.611678 12450 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:34.615650 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:34.616061 12510 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:34.619100 12449 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:34.619786 12449 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.616870 12510 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.622087 11661 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:34.622152 12449 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:34.632056 11628 leader_election.cc:336] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:34.639443 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:34.640424 11807 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:34.644116 11776 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:34.645517 12341 raft_consensus.cc:2804] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:22:34.645965 12341 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:34.646368 12341 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:34.647365 11630 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:34.648411 12449 raft_consensus.cc:2804] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:22:34.648837 12449 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:34.649205 12449 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:22:34.653097 11776 leader_election.cc:336] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:34.646250 12510 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:34.668694 11628 leader_election.cc:336] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:34.681414 12341 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:34.689422 11702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 85648.2us
I20260709 13:22:34.684758 12341 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:34.697690 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:34.608080 12447 raft_consensus.cc:359] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.703995 12447 raft_consensus.cc:740] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.704856 12447 consensus_queue.cc:260] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.707106 12447 ts_tablet_manager.cc:1434] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.000s
I20260709 13:22:34.707917 12447 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.720006 12449 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:34.723742 11661 raft_consensus.cc:2393] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01c914cf532f4dc19c1bab3514524ac2 in current term 3: Already voted for candidate 4b102b83096e4830a35a9006a2a2a0f0 in this term.
I20260709 13:22:34.723624 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:34.724852 11734 raft_consensus.cc:2468] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 2.
I20260709 13:22:34.735057 12449 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:34.721834 11776 leader_election.cc:336] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:34.742221 11630 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:34.743355 12510 raft_consensus.cc:2804] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:22:34.743827 12510 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:34.744187 12510 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:34.745359 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:34.746311 11810 raft_consensus.cc:2393] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b102b83096e4830a35a9006a2a2a0f0 in current term 3: Already voted for candidate 01c914cf532f4dc19c1bab3514524ac2 in this term.
I20260709 13:22:34.747275 11776 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:34.752283 12543 raft_consensus.cc:2749] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:22:34.755868 12510 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.758464 12510 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 election: Requested vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:34.786623 11628 leader_election.cc:336] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:34.786257 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:34.787297 11628 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:34.788139 12510 raft_consensus.cc:2749] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:22:34.787938 11734 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:22:34.815717 11628 leader_election.cc:336] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:34.830821 12447 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.832515 12447 tablet_bootstrap.cc:492] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.833434 12447 ts_tablet_manager.cc:1403] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.022s
I20260709 13:22:34.847152 12447 raft_consensus.cc:359] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.848201 12447 raft_consensus.cc:740] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.849398 12447 consensus_queue.cc:260] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.856927 12447 ts_tablet_manager.cc:1434] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:22:34.858352 12447 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.877625 11734 raft_consensus.cc:2468] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 3.
I20260709 13:22:34.894897 11630 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:34.902602 12510 raft_consensus.cc:2804] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:34.903252 12510 raft_consensus.cc:697] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:34.904537 12510 consensus_queue.cc:237] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:34.945406 12447 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:34.946803 12447 tablet_bootstrap.cc:492] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:34.948205 12447 ts_tablet_manager.cc:1403] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.005s
I20260709 13:22:34.960368 12447 raft_consensus.cc:359] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:34.961568 12447 raft_consensus.cc:740] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.973863 12447 consensus_queue.cc:260] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:34.977576 12447 ts_tablet_manager.cc:1434] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:22:34.978952 12447 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:34.985597 11484 catalog_manager.cc:5697] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 1 to 3, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.050801 12447 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.056288 12447 tablet_bootstrap.cc:492] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:35.057577 12447 ts_tablet_manager.cc:1403] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.011s
I20260709 13:22:35.080489 12447 raft_consensus.cc:359] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:35.081615 12447 raft_consensus.cc:740] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.082859 12447 consensus_queue.cc:260] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:35.088009 12447 ts_tablet_manager.cc:1434] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:22:35.090359 12447 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:35.091748 12499 raft_consensus.cc:493] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.092710 12499 raft_consensus.cc:515] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:35.097390 12499 leader_election.cc:290] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:35.201514 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fae0c5c6645438dadaa067b0d5d92cb" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:35.202729 12447 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.204666 12447 tablet_bootstrap.cc:492] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:35.206095 12447 ts_tablet_manager.cc:1403] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.116s	user 0.032s	sys 0.013s
I20260709 13:22:35.210907 12447 raft_consensus.cc:359] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:35.211876 12447 raft_consensus.cc:740] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.212846 12447 consensus_queue.cc:260] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:35.214692 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fae0c5c6645438dadaa067b0d5d92cb" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:35.215418 12447 ts_tablet_manager.cc:1434] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:22:35.216499 12447 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:35.217128 12433 leader_election.cc:304] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:35.218672 12499 raft_consensus.cc:2749] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:35.265273 12447 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.268369 12447 tablet_bootstrap.cc:492] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:35.269344 12447 ts_tablet_manager.cc:1403] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.053s	user 0.035s	sys 0.006s
I20260709 13:22:35.273231 12447 raft_consensus.cc:359] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:35.274224 12447 raft_consensus.cc:740] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.275451 12447 consensus_queue.cc:260] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:35.278512 12447 ts_tablet_manager.cc:1434] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:35.279556 12447 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
W20260709 13:22:35.281558 11776 consensus_peers.cc:597] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:35.327970 12447 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.329361 12447 tablet_bootstrap.cc:492] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:35.330235 12447 ts_tablet_manager.cc:1403] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.017s
I20260709 13:22:35.349992 12447 raft_consensus.cc:359] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:35.350943 12447 raft_consensus.cc:740] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.353461 12447 consensus_queue.cc:260] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:35.357762 12447 ts_tablet_manager.cc:1434] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:22:35.358945 12447 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:35.363451 12499 raft_consensus.cc:493] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.364447 12499 raft_consensus.cc:515] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:35.396032 12499 leader_election.cc:290] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:35.397979 11628 consensus_peers.cc:597] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:35.422071 12447 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.423453 12447 tablet_bootstrap.cc:492] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:35.424616 12447 ts_tablet_manager.cc:1403] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.008s
I20260709 13:22:35.428372 12499 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.429320 12499 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:35.431205 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:35.432546 11776 consensus_peers.cc:597] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:35.434849 11738 raft_consensus.cc:1275] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:22:35.431553 11628 consensus_peers.cc:597] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:35.445377 12447 raft_consensus.cc:359] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:35.446027 12447 raft_consensus.cc:740] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.447167 12447 consensus_queue.cc:260] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:35.453246 12499 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:35.454455 12499 raft_consensus.cc:493] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.455150 12499 raft_consensus.cc:515] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:35.460719 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:35.461789 11738 raft_consensus.cc:2368] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff for earlier term 2. Current term is 3.
I20260709 13:22:35.460898 12499 leader_election.cc:290] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:35.462244 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2b87661f184408bcc049ddd64425c5" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:35.466976 11702 consensus_peers.cc:597] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:35.468626 12433 leader_election.cc:400] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Vote denied by peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051) with higher term. Message: Invalid argument: T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff for earlier term 2. Current term is 3.
I20260709 13:22:35.469070 12433 leader_election.cc:403] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:22:35.469947 12598 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:22:35.474184 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2b87661f184408bcc049ddd64425c5" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:35.480708 11702 consensus_peers.cc:597] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:35.482259 12433 leader_election.cc:304] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:35.482071 12447 ts_tablet_manager.cc:1434] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.006s
I20260709 13:22:35.486057 12447 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:35.490394 12601 raft_consensus.cc:2749] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:35.496197 12598 raft_consensus.cc:2749] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051) with higher term. Message: Invalid argument: T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c7a0f1511c4b18ad59155bbeb0c1ff for earlier term 2. Current term is 3.
I20260709 13:22:35.497718  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:42405
I20260709 13:22:35.503072 12602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:42405 every 8 connection(s)
I20260709 13:22:35.508864 12449 consensus_queue.cc:1048] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:35.574968 12447 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.577224 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a110a6f28455596def9d91be0d7a0" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:35.581532 12447 tablet_bootstrap.cc:492] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:35.578609 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:35.582600 12447 ts_tablet_manager.cc:1403] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.097s	user 0.023s	sys 0.000s
I20260709 13:22:35.587150 12447 raft_consensus.cc:359] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:35.590726 12447 raft_consensus.cc:740] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.591570 12447 consensus_queue.cc:260] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:35.592823 12598 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.593396 12598 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:35.595336 12431 leader_election.cc:304] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:35.595871 12598 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:35.597038 12499 raft_consensus.cc:2749] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:35.604566 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:35.604568 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:35.613626 12447 ts_tablet_manager.cc:1434] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 13:22:35.615128 12433 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:35.620529 12598 raft_consensus.cc:2749] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:35.628437 12447 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:35.676270 12598 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.676985 12598 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:35.679280 12598 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:35.689329 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:35.693653 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
I20260709 13:22:35.696827 12499 raft_consensus.cc:493] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.697778 12499 raft_consensus.cc:515] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:35.701233 12556 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.701964 12499 leader_election.cc:290] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:35.709223 12553 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.715183 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f60ac2c79f045c18e7c1eed3af5f12b" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:35.721196 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f60ac2c79f045c18e7c1eed3af5f12b" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:35.748695 12554 raft_consensus.cc:3060] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.750335 12447 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.751721 12447 tablet_bootstrap.cc:492] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:35.752622 12447 ts_tablet_manager.cc:1403] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.138s	user 0.046s	sys 0.041s
I20260709 13:22:35.755805 12447 raft_consensus.cc:359] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:35.760743 12598 raft_consensus.cc:493] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.761683 12433 leader_election.cc:304] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:35.762020 12598 raft_consensus.cc:515] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:35.762679 12499 raft_consensus.cc:2749] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:35.764493 12598 leader_election.cc:290] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:35.765240 12447 raft_consensus.cc:740] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.766000 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:35.767843 12555 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.768381 12552 raft_consensus.cc:3060] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.770812 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c4a2348e44e7797324eb4b36fe5fa" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:35.785610 11776 consensus_peers.cc:597] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:35.784875 12603 heartbeater.cc:344] Connected to a master server at 127.2.243.126:42969
I20260709 13:22:35.786348 12447 consensus_queue.cc:260] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:35.808149 12603 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:35.809602 12603 heartbeater.cc:507] Master 127.2.243.126:42969 requested a full tablet report, sending...
I20260709 13:22:35.795372 12433 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
W20260709 13:22:35.781798 11628 consensus_peers.cc:597] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:35.818063 11628 consensus_peers.cc:597] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:35.772182 11702 consensus_peers.cc:597] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:35.820865 11702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 48897.8us
W20260709 13:22:35.830840 11628 consensus_peers.cc:597] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:35.836792 11702 consensus_peers.cc:597] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:35.835685 12499 raft_consensus.cc:493] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.893254 12447 ts_tablet_manager.cc:1434] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.140s	user 0.035s	sys 0.027s
I20260709 13:22:35.894948 12447 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
W20260709 13:22:35.894797 12433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 99544.2us
I20260709 13:22:35.871592 12499 raft_consensus.cc:515] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:35.946844 12550 raft_consensus.cc:3060] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:35.951220 11628 consensus_peers.cc:597] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:35.951550 12499 leader_election.cc:290] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:35.964939 12433 leader_election.cc:304] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:35.966354 12499 raft_consensus.cc:2749] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:35.986581 12616 log.cc:927] Time spent T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:22:35.989567 11813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e8930dda4e488d9427d8e6e487f4ab" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:35.998739 11776 consensus_peers.cc:597] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:36.028141 11702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 140644us
W20260709 13:22:36.034125 11628 consensus_peers.cc:597] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:36.035646 11704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 131855us
I20260709 13:22:36.034361 12601 raft_consensus.cc:2749] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:36.074359 11776 consensus_peers.cc:597] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:36.085906 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e8930dda4e488d9427d8e6e487f4ab" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
W20260709 13:22:36.105250 11628 consensus_peers.cc:597] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:36.109423 11702 consensus_peers.cc:597] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:36.112794 12499 raft_consensus.cc:493] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:36.137008 12499 raft_consensus.cc:515] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:36.142174 12499 leader_election.cc:290] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
W20260709 13:22:36.191509 11776 consensus_peers.cc:597] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:36.192656 11776 consensus_peers.cc:597] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:36.219862 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0" is_pre_election: true
I20260709 13:22:36.231280 12447 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:36.268925 12447 tablet_bootstrap.cc:492] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:36.269932 12447 ts_tablet_manager.cc:1403] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.375s	user 0.039s	sys 0.019s
I20260709 13:22:36.241892 12431 leader_election.cc:304] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0
W20260709 13:22:36.323220 11776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 128364us
I20260709 13:22:36.319883 12499 raft_consensus.cc:2749] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:36.347296 11776 consensus_peers.cc:597] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:36.350171 12447 raft_consensus.cc:359] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:36.351660 12447 raft_consensus.cc:740] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:36.355472 12556 raft_consensus.cc:3060] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:36.380452 11702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 202980us
I20260709 13:22:36.380095 12447 consensus_queue.cc:260] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:36.382170 11778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 65977us
W20260709 13:22:36.326794 12431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 90605.5us
W20260709 13:22:36.388682 11702 consensus_peers.cc:597] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:36.410810 12447 ts_tablet_manager.cc:1434] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.140s	user 0.011s	sys 0.000s
I20260709 13:22:36.417883 12447 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:36.424104 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d59c3f822e674346af71ca9a5d899c2e" is_pre_election: true
W20260709 13:22:36.474143 11628 consensus_peers.cc:597] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:36.479697 11628 consensus_peers.cc:597] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:36.508003 12657 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:36.508657 12657 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:36.510115 11628 consensus_peers.cc:597] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:36.511754 12657 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:36.521977 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:36.522964 11810 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 3.
I20260709 13:22:36.524808 11630 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:36.525817 12653 raft_consensus.cc:2804] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:22:36.526194 12653 raft_consensus.cc:493] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:36.526530 12653 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:36.539357 12653 raft_consensus.cc:515] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:36.544456 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" is_pre_election: true
I20260709 13:22:36.545400 12556 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 1.
I20260709 13:22:36.549793 12653 leader_election.cc:290] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 4 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:36.549670 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:36.554281 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e497ab473ebd4e6e9f4b651ca4382280" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
I20260709 13:22:36.556476 11810 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:36.556519 12556 raft_consensus.cc:3060] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 4
I20260709 13:22:36.570454 11810 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 4.
I20260709 13:22:36.572629 11630 leader_election.cc:304] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:36.574023 12512 raft_consensus.cc:2804] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:36.574741 12512 raft_consensus.cc:697] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:36.575862 12512 consensus_queue.cc:237] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:36.586719 12556 raft_consensus.cc:2468] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 4.
I20260709 13:22:36.599874 12433 leader_election.cc:304] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:36.601449 12601 raft_consensus.cc:2749] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:36.588383 11485 ts_manager.cc:194] Re-registered known tserver with Master: 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:36.628691 12447 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:36.630932 12447 tablet_bootstrap.cc:492] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:36.631956 12447 ts_tablet_manager.cc:1403] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.220s	user 0.059s	sys 0.012s
I20260709 13:22:36.638062 12447 raft_consensus.cc:359] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:36.638899 12447 raft_consensus.cc:740] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
W20260709 13:22:36.640195 11702 consensus_peers.cc:597] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:36.640141 12447 consensus_queue.cc:260] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:36.641777 11487 catalog_manager.cc:5697] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 1 to 4, leader changed from 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 4 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:36.649483 12447 ts_tablet_manager.cc:1434] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:22:36.650808 12447 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:36.693269 12447 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:36.694538 12447 tablet_bootstrap.cc:492] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:36.695640 12447 ts_tablet_manager.cc:1403] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.007s
I20260709 13:22:36.717017 12447 raft_consensus.cc:359] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:36.718184 12447 raft_consensus.cc:740] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:36.719170 12447 consensus_queue.cc:260] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:36.723783 12447 ts_tablet_manager.cc:1434] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.002s
I20260709 13:22:36.724843 12447 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:36.756574 12447 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:36.757745 12447 tablet_bootstrap.cc:492] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:36.760398 12447 ts_tablet_manager.cc:1403] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.011s
I20260709 13:22:36.763747 12447 raft_consensus.cc:359] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:36.764865 12447 raft_consensus.cc:740] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:36.765902 12447 consensus_queue.cc:260] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:36.768157 12447 ts_tablet_manager.cc:1434] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:36.769176 12447 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:36.800971 12447 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:36.802233 12447 tablet_bootstrap.cc:492] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:36.803073 12447 ts_tablet_manager.cc:1403] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.004s
I20260709 13:22:36.810792 12447 raft_consensus.cc:359] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:36.811862 12447 raft_consensus.cc:740] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:36.812777 12447 consensus_queue.cc:260] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:36.818012 12447 ts_tablet_manager.cc:1434] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:22:36.819169 12447 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:36.850194 12447 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:36.852639 12447 tablet_bootstrap.cc:492] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:36.853513 12447 ts_tablet_manager.cc:1403] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.013s
I20260709 13:22:36.857195 12447 raft_consensus.cc:359] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:36.858098 12447 raft_consensus.cc:740] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:36.860620 12447 consensus_queue.cc:260] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:36.865724 12447 ts_tablet_manager.cc:1434] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:22:36.867048 12447 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:36.895305 11485 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48922
I20260709 13:22:36.902683 12603 heartbeater.cc:499] Master 127.2.243.126:42969 was elected leader, sending a full tablet report...
I20260709 13:22:36.918058 12447 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:36.919615 12447 tablet_bootstrap.cc:492] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:36.920615 12447 ts_tablet_manager.cc:1403] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.022s
I20260709 13:22:36.923856 12447 raft_consensus.cc:359] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:36.925011 12447 raft_consensus.cc:740] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:36.925972 12447 consensus_queue.cc:260] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:36.929183 12447 ts_tablet_manager.cc:1434] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:22:36.930635 12447 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:36.973441 12447 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:36.976161 12447 tablet_bootstrap.cc:492] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:36.977161 12447 ts_tablet_manager.cc:1403] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.016s
I20260709 13:22:36.980677 12447 raft_consensus.cc:359] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:36.981848 12447 raft_consensus.cc:740] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:36.983014 12447 consensus_queue.cc:260] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:36.985872 12447 ts_tablet_manager.cc:1434] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:36.987197 12447 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.006165 12554 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.015547 12447 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.018443 12447 tablet_bootstrap.cc:492] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.019613 12447 ts_tablet_manager.cc:1403] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.007s
I20260709 13:22:37.030241 12447 raft_consensus.cc:359] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.031268 12447 raft_consensus.cc:740] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.032263 12447 consensus_queue.cc:260] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.035426 12447 ts_tablet_manager.cc:1434] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:22:37.036631 12447 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.043100 12556 raft_consensus.cc:1275] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:22:37.046379 12512 consensus_queue.cc:1048] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:37.091691 12447 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.115393 12447 tablet_bootstrap.cc:492] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.116379 12447 ts_tablet_manager.cc:1403] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.002s
I20260709 13:22:37.120795 12447 raft_consensus.cc:359] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.124557 12447 raft_consensus.cc:740] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.131353 12447 consensus_queue.cc:260] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.138147 12447 ts_tablet_manager.cc:1434] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:22:37.139194 12447 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.173105 11810 raft_consensus.cc:1275] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 4 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:22:37.198531 12620 consensus_queue.cc:1048] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:37.209270 12447 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.211338 12447 tablet_bootstrap.cc:492] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.212229 12447 ts_tablet_manager.cc:1403] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.073s	user 0.030s	sys 0.030s
I20260709 13:22:37.228739 12447 raft_consensus.cc:359] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.229712 12447 raft_consensus.cc:740] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.233134 12447 consensus_queue.cc:260] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.236110 12447 ts_tablet_manager.cc:1434] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:22:37.239761 12447 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.249977 12556 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.312143 12447 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.313344 12447 tablet_bootstrap.cc:492] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.314133 12447 ts_tablet_manager.cc:1403] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.038s
I20260709 13:22:37.321054 12447 raft_consensus.cc:359] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:37.321995 12447 raft_consensus.cc:740] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.322805 12447 consensus_queue.cc:260] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:37.327363 12447 ts_tablet_manager.cc:1434] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:22:37.329775 12447 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.375502 12447 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.378096 12447 tablet_bootstrap.cc:492] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.379142 12447 ts_tablet_manager.cc:1403] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.025s
I20260709 13:22:37.382607 12447 raft_consensus.cc:359] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.383494 12447 raft_consensus.cc:740] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.387318 12447 consensus_queue.cc:260] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.389575 12447 ts_tablet_manager.cc:1434] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:37.392947 12447 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.384099 12547 raft_consensus.cc:3060] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:37.420047 11702 consensus_peers.cc:597] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:37.462464 12447 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.463898 12447 tablet_bootstrap.cc:492] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.472244 12447 ts_tablet_manager.cc:1403] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.018s
I20260709 13:22:37.475595 12447 raft_consensus.cc:359] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.476667 12447 raft_consensus.cc:740] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.477548 12447 consensus_queue.cc:260] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.480183 12447 ts_tablet_manager.cc:1434] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:37.481348 12447 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.500763 12447 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.502575 12447 tablet_bootstrap.cc:492] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.503649 12447 ts_tablet_manager.cc:1403] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:22:37.509380 12447 raft_consensus.cc:359] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.510310 12447 raft_consensus.cc:740] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.511291 12447 consensus_queue.cc:260] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.513934 12447 ts_tablet_manager.cc:1434] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:37.516114 12447 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.536511 12447 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.537782 12447 tablet_bootstrap.cc:492] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.538695 12447 ts_tablet_manager.cc:1403] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:22:37.541836 12447 raft_consensus.cc:359] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:37.542810 12447 raft_consensus.cc:740] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.543574 12447 consensus_queue.cc:260] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:37.546101 12447 ts_tablet_manager.cc:1434] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:37.553630 12556 raft_consensus.cc:3060] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.554169 12447 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.624477 12447 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.625888 12447 tablet_bootstrap.cc:492] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.626804 12447 ts_tablet_manager.cc:1403] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.003s
I20260709 13:22:37.629734 12447 raft_consensus.cc:359] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.630743 12447 raft_consensus.cc:740] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.631807 12447 consensus_queue.cc:260] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.635499 12447 ts_tablet_manager.cc:1434] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:37.650010 12447 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.670177 12447 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.671569 12447 tablet_bootstrap.cc:492] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.672873 12447 ts_tablet_manager.cc:1403] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.001s
I20260709 13:22:37.676672 12447 raft_consensus.cc:359] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.677562 12447 raft_consensus.cc:740] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.678421 12447 consensus_queue.cc:260] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.680998 12447 ts_tablet_manager.cc:1434] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:37.681991 12447 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.711572 12447 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.712850 12447 tablet_bootstrap.cc:492] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.713680 12447 ts_tablet_manager.cc:1403] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.005s
I20260709 13:22:37.717517 12447 raft_consensus.cc:359] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:37.720371 12447 raft_consensus.cc:740] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.721427 12447 consensus_queue.cc:260] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:37.723438 12447 ts_tablet_manager.cc:1434] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:37.726224 12547 raft_consensus.cc:3060] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:22:37.728307 12447 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.771307 12556 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.791886 12550 raft_consensus.cc:3060] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.812593 12554 raft_consensus.cc:3060] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:37.860172 12447 log.cc:927] Time spent T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Append to log took a long time: real 0.078s	user 0.003s	sys 0.000s
I20260709 13:22:37.861091 12447 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.862310 12447 tablet_bootstrap.cc:492] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.863191 12447 ts_tablet_manager.cc:1403] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.135s	user 0.023s	sys 0.000s
I20260709 13:22:37.866429 12447 raft_consensus.cc:359] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.867347 12447 raft_consensus.cc:740] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.868391 12447 consensus_queue.cc:260] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:37.870826 12447 ts_tablet_manager.cc:1434] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:37.871881 12447 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.942768 12447 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.943893 12447 tablet_bootstrap.cc:492] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.944756 12447 ts_tablet_manager.cc:1403] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.010s
I20260709 13:22:37.947913 12447 raft_consensus.cc:359] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.948768 12447 raft_consensus.cc:740] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:37.949568 12447 consensus_queue.cc:260] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.951996 12447 ts_tablet_manager.cc:1434] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:37.962325 12447 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:37.992889 12447 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:37.994160 12447 tablet_bootstrap.cc:492] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:37.995131 12447 ts_tablet_manager.cc:1403] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.001s
I20260709 13:22:37.998823 12447 raft_consensus.cc:359] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:37.999734 12447 raft_consensus.cc:740] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:38.000670 12447 consensus_queue.cc:260] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:38.002519 12447 ts_tablet_manager.cc:1434] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:38.003564 12447 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap starting.
I20260709 13:22:38.009291 12550 raft_consensus.cc:3060] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:38.092846 12447 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:38.094673 12447 tablet_bootstrap.cc:492] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Bootstrap complete.
I20260709 13:22:38.095562 12447 ts_tablet_manager.cc:1403] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent bootstrapping tablet: real 0.092s	user 0.045s	sys 0.038s
I20260709 13:22:38.098810 12447 raft_consensus.cc:359] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:38.099715 12447 raft_consensus.cc:740] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Initialized, Role: FOLLOWER
I20260709 13:22:38.100755 12447 consensus_queue.cc:260] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:38.103160 12447 ts_tablet_manager.cc:1434] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:22:38.170113 12550 raft_consensus.cc:3060] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:38.446676 12556 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:39.959125 11776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 104667us
W20260709 13:22:40.040540 11776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 43841.9us
W20260709 13:22:40.095423 11628 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:42405, user_credentials={real_user=slave}} blocked reactor thread for 58203.8us
W20260709 13:22:40.103363 11630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 46952us
W20260709 13:22:45.115403 11704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 52481us
I20260709 13:22:45.565361  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:45.643935 11663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:45.645210 11663 raft_consensus.cc:606] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Received request to transfer leadership to TS 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:45.648236 11663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:45.648892 11663 raft_consensus.cc:606] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Received request to transfer leadership to TS 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:45.666072 11734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3"
dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
mode: GRACEFUL
new_leader_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:54368
I20260709 13:22:45.666749 11734 raft_consensus.cc:606] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Received request to transfer leadership to TS 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:45.670753 11663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:45.671422 11663 raft_consensus.cc:606] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:45.674836 11663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:45.675393 11663 raft_consensus.cc:606] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:45.678045 11663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:45.678555 11663 raft_consensus.cc:606] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:45.679831  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:22:45.681847  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:45.702836 12720 raft_consensus.cc:993] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:45.703526 12720 raft_consensus.cc:1081] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:45.706379 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:22:45.707363 12554 raft_consensus.cc:493] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.709337 12554 raft_consensus.cc:3060] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.712519 12724 raft_consensus.cc:993] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e: : Instructing follower 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:45.713160 12724 raft_consensus.cc:1081] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Signalling peer 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:45.715057 11810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:44040
I20260709 13:22:45.715631 11810 raft_consensus.cc:493] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.715966 11810 raft_consensus.cc:3060] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.720096 12554 raft_consensus.cc:515] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.723778 12554 leader_election.cc:290] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:45.723631 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:45.724701 11811 raft_consensus.cc:3060] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.725658 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a77efc3a8409b991b0bb8bb957517" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:45.726313 11658 raft_consensus.cc:3055] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.726579 11658 raft_consensus.cc:740] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:45.727571 11658 consensus_queue.cc:260] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.729943 11658 raft_consensus.cc:3060] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.734779 11811 raft_consensus.cc:2468] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:45.737308 11810 raft_consensus.cc:515] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.737572 12433 leader_election.cc:304] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:45.740370 11810 leader_election.cc:290] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:45.740993 11658 raft_consensus.cc:2468] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:45.741554 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:45.742245 12729 raft_consensus.cc:2804] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.743036 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2e77a7d8e74543bab76ac11418f6d3" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:45.742277 11663 raft_consensus.cc:3060] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.743707 11734 raft_consensus.cc:3055] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.744071 11734 raft_consensus.cc:740] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:45.744951 11734 consensus_queue.cc:260] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.746472 11734 raft_consensus.cc:3060] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.749228 12620 raft_consensus.cc:993] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:45.751928 12720 raft_consensus.cc:1081] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Signalling peer 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:45.751298 12729 raft_consensus.cc:697] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:45.753959 11810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:22:45.753620 12729 consensus_queue.cc:237] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.754603 11810 raft_consensus.cc:493] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.754977 11810 raft_consensus.cc:3060] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.757719 11734 raft_consensus.cc:2468] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:45.760146 11778 leader_election.cc:304] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:45.761233 11663 raft_consensus.cc:2468] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:45.761276 12718 raft_consensus.cc:2804] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.770993 11810 raft_consensus.cc:515] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.773658 11810 leader_election.cc:290] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:45.771175 11484 catalog_manager.cc:5697] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 1 to 2, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 2 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.776443 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:45.777166 11738 raft_consensus.cc:3060] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.776177 12718 raft_consensus.cc:697] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:45.779048 12718 consensus_queue.cc:237] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.784782 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e0b15fa5004d8ea57f63e1bebb2103" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:45.785786 11663 raft_consensus.cc:3055] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.786226 11663 raft_consensus.cc:740] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:45.787441 11663 consensus_queue.cc:260] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.790942 11663 raft_consensus.cc:3060] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.796938 11738 raft_consensus.cc:2468] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:45.798205 11778 leader_election.cc:304] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:45.799022 12718 raft_consensus.cc:2804] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.799536 12718 raft_consensus.cc:697] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:45.800491 12718 consensus_queue.cc:237] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.818364 11663 raft_consensus.cc:2468] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:45.826999 11487 catalog_manager.cc:5697] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from d59c3f822e674346af71ca9a5d899c2e (127.2.243.67) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:45.859611 11487 catalog_manager.cc:5697] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:45.877336 12720 raft_consensus.cc:993] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:45.877863 12620 raft_consensus.cc:1081] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:45.879875 12550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:22:45.880682 12550 raft_consensus.cc:493] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.881018 12550 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:45.887600 12550 raft_consensus.cc:515] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.889525 12550 leader_election.cc:290] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:45.890695 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:45.890851 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba936b69ea784d3aa5af76a721bdb29d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:45.891561 11810 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:45.891649 11663 raft_consensus.cc:3055] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:45.892117 11663 raft_consensus.cc:740] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:45.893281 11663 consensus_queue.cc:260] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.894860 11663 raft_consensus.cc:3060] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:45.900663 11810 raft_consensus.cc:2468] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:45.902170 12433 leader_election.cc:304] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:45.903187 12729 raft_consensus.cc:2804] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:45.903312 11663 raft_consensus.cc:2468] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:45.903802 12729 raft_consensus.cc:697] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:45.905000 12720 raft_consensus.cc:993] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:45.905753 12722 raft_consensus.cc:1081] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Signalling peer 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:45.905179 12729 consensus_queue.cc:237] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.909468 11810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:22:45.910043 11810 raft_consensus.cc:493] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.910370 11810 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.918865 11810 raft_consensus.cc:515] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.921583 11810 leader_election.cc:290] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:45.923141 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:45.923894 11734 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.923702 11487 catalog_manager.cc:5697] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 2 to 3, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 3 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.942191 11734 raft_consensus.cc:2468] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:45.943553 11778 leader_election.cc:304] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:45.945350 12718 raft_consensus.cc:2804] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.946202 12718 raft_consensus.cc:697] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:45.948199 12720 raft_consensus.cc:993] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:45.948768 12720 raft_consensus.cc:1081] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:45.948840 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:45.949340 11663 raft_consensus.cc:3055] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.949658 11663 raft_consensus.cc:740] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:45.950603 11663 consensus_queue.cc:260] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.951319 12550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:22:45.952000 12550 raft_consensus.cc:493] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.952021 11663 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.952464 12550 raft_consensus.cc:3060] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.947775 12718 consensus_queue.cc:237] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:45.960114 11663 raft_consensus.cc:2468] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:45.961151 12550 raft_consensus.cc:515] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.963896 12550 leader_election.cc:290] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:45.965085 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:45.965791 11663 raft_consensus.cc:3055] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.966123 11663 raft_consensus.cc:740] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:45.966784 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9d5e7bf3a47a5bfae29dc73636ec9" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:45.967274 11663 consensus_queue.cc:260] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.967801 11810 raft_consensus.cc:3060] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.968789 11663 raft_consensus.cc:3060] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.972257 11487 catalog_manager.cc:5697] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:45.976812 11663 raft_consensus.cc:2468] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:45.976831 11810 raft_consensus.cc:2468] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:45.978289 12431 leader_election.cc:304] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:45.979509 12729 raft_consensus.cc:2804] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.980062 12729 raft_consensus.cc:697] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:45.981027 12729 consensus_queue.cc:237] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:45.994243 11487 catalog_manager.cc:5697] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 1 to 2, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 2 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.163223 11734 raft_consensus.cc:1275] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.164904 12679 consensus_queue.cc:1048] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:46.220191 11663 raft_consensus.cc:1275] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.222394 12718 consensus_queue.cc:1048] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:46.323928 11658 raft_consensus.cc:1275] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.336741 12749 consensus_queue.cc:1048] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:46.348152 11664 raft_consensus.cc:1275] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.350155 12729 consensus_queue.cc:1048] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:46.357054 11812 raft_consensus.cc:1275] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:46.359095 12730 consensus_queue.cc:1048] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:46.375824 11811 raft_consensus.cc:1275] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.378072 12730 consensus_queue.cc:1048] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:46.418321 11734 raft_consensus.cc:1275] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.421577 11734 raft_consensus.cc:1275] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.424216 12679 consensus_queue.cc:1048] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:22:46.428174 12732 consensus_queue.cc:1048] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:22:46.448966 11664 raft_consensus.cc:1275] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:46.451713 12758 consensus_queue.cc:1048] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:46.470490 11664 raft_consensus.cc:1275] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.473306 11810 raft_consensus.cc:1275] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.484124 11664 raft_consensus.cc:1275] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.485755 12732 consensus_queue.cc:1048] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.500903 12757 consensus_queue.cc:1048] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:22:46.506433 12758 consensus_queue.cc:1048] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:22:46.508282 12760 log.cc:927] Time spent T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:22:46.682991  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:46.734864  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:46.772684 11664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:46.773380 11664 raft_consensus.cc:606] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:46.776857 11664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:46.777508 11664 raft_consensus.cc:606] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:46.780661 11664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:46.781404 11664 raft_consensus.cc:606] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:46.784693 11738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb"
dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
mode: GRACEFUL
new_leader_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:54368
I20260709 13:22:46.785404 11738 raft_consensus.cc:606] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Received request to transfer leadership to TS 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:46.803532 11812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:49778
I20260709 13:22:46.804478 11812 raft_consensus.cc:606] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:46.808079  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:22:46.810768  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:46.845114 12747 raft_consensus.cc:993] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:46.846750 12747 raft_consensus.cc:1081] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:46.848827 12550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:22:46.849545 12550 raft_consensus.cc:493] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.850024 12550 raft_consensus.cc:3060] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.853489 12716 raft_consensus.cc:993] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e: : Instructing follower 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:46.854279 12751 raft_consensus.cc:1081] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Signalling peer 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:46.856192 11812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:44040
I20260709 13:22:46.856943 11812 raft_consensus.cc:493] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.857398 11812 raft_consensus.cc:3060] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.859688 12550 raft_consensus.cc:515] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:46.862332 12550 leader_election.cc:290] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:46.863435 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:46.864231 11810 raft_consensus.cc:3060] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.866705 11812 raft_consensus.cc:515] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:46.867089 11664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3893d7c0374a12933e175ada5b42de" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:46.867889 11664 raft_consensus.cc:3055] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:46.868202 11664 raft_consensus.cc:740] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:46.869094 11664 consensus_queue.cc:260] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:46.870042 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:46.871328 11663 raft_consensus.cc:3060] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.871796 11664 raft_consensus.cc:3060] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.872182 11810 raft_consensus.cc:2468] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:46.873688 12433 leader_election.cc:304] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:46.874552 12757 raft_consensus.cc:2804] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.875015 12757 raft_consensus.cc:697] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:46.875970 12757 consensus_queue.cc:237] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:46.870198 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec71cc0340da4c8fac91f96fa561a0bb" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:46.869983 11812 leader_election.cc:290] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:46.879858 11664 raft_consensus.cc:2468] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:46.882093 11738 raft_consensus.cc:3055] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:46.882512 11738 raft_consensus.cc:740] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:46.880141 11663 raft_consensus.cc:2468] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:46.883531 11738 consensus_queue.cc:260] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:46.884454 11776 leader_election.cc:304] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:46.885082 11738 raft_consensus.cc:3060] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.885362 12718 raft_consensus.cc:2804] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.886019 12718 raft_consensus.cc:697] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:46.887044 12718 consensus_queue.cc:237] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:46.892104 11487 catalog_manager.cc:5697] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 1 to 2, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 2 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.894632 11738 raft_consensus.cc:2468] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:46.900692 11485 catalog_manager.cc:5697] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from d59c3f822e674346af71ca9a5d899c2e (127.2.243.67) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:46.932279 12620 raft_consensus.cc:993] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:46.932814 12620 raft_consensus.cc:1081] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:46.935114 12550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:22:46.935781 12550 raft_consensus.cc:493] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.936223 12550 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:46.945216 12550 raft_consensus.cc:515] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:46.947599 12550 leader_election.cc:290] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:46.948868 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:46.949270 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa6af0390c4e07bf2b362d5bdb078d" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:46.949709 11738 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:46.950034 11663 raft_consensus.cc:3055] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:46.950419 11663 raft_consensus.cc:740] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:46.951188 11663 consensus_queue.cc:260] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:46.952311 11663 raft_consensus.cc:3060] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:46.956053 11738 raft_consensus.cc:2468] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:46.957583 12433 leader_election.cc:304] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:46.958460 12757 raft_consensus.cc:2804] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:46.959059 12757 raft_consensus.cc:697] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:46.959020 11663 raft_consensus.cc:2468] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:46.960575 12757 consensus_queue.cc:237] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:46.973753 11485 catalog_manager.cc:5697] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 2 to 3, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 3 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:47.096863 12620 raft_consensus.cc:993] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:47.097339 12620 raft_consensus.cc:1081] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:47.100098 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:22:47.100978 12554 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:47.101617 12554 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:47.116902 12554 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:47.120306 12554 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:47.121068 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:47.121516 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397c649b857e402ca8b1d21f4f416704" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:47.121896 11810 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:47.122201 11663 raft_consensus.cc:3055] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:47.122553 11663 raft_consensus.cc:740] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:47.123939 11663 consensus_queue.cc:260] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:47.126529 11663 raft_consensus.cc:3060] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:47.131282 11810 raft_consensus.cc:2468] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:47.133277 12433 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:47.134159 12757 raft_consensus.cc:2804] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:47.134740 12757 raft_consensus.cc:697] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:47.135716 12757 consensus_queue.cc:237] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:47.136833 11663 raft_consensus.cc:2468] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:47.149501 11485 catalog_manager.cc:5697] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 2 to 3, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 3 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:47.194495 12732 raft_consensus.cc:993] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:47.195109 12777 raft_consensus.cc:1081] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:47.201481 12556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39278
I20260709 13:22:47.202409 12556 raft_consensus.cc:493] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:47.202833 12556 raft_consensus.cc:3060] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:47.279197 12556 raft_consensus.cc:515] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:47.281497 12556 leader_election.cc:290] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:47.282634 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:47.285154 11738 raft_consensus.cc:3060] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:47.291548 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:47.292354 11812 raft_consensus.cc:3055] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:47.292649 11812 raft_consensus.cc:740] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:47.293418 11812 consensus_queue.cc:260] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:47.294644 11812 raft_consensus.cc:3060] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:47.306272 11738 raft_consensus.cc:2468] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:47.308816 12433 leader_election.cc:304] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:47.314368 11812 raft_consensus.cc:2468] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:47.320264 12755 raft_consensus.cc:2804] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:47.320994 12755 raft_consensus.cc:697] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:47.322053 12755 consensus_queue.cc:237] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:47.334146 11810 raft_consensus.cc:1275] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.337968 12757 consensus_queue.cc:1048] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:47.357328 11485 catalog_manager.cc:5697] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 1 to 2, leader changed from 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 2 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:47.388384 11665 raft_consensus.cc:1275] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.397357 11665 raft_consensus.cc:1275] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:47.400894 12777 consensus_queue.cc:1048] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:47.399444 12730 consensus_queue.cc:1048] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:22:47.427685 11658 raft_consensus.cc:1275] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.434355 12757 consensus_queue.cc:1048] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:47.482061 11738 raft_consensus.cc:1275] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.483750 12749 consensus_queue.cc:1048] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.497020 11734 raft_consensus.cc:1275] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:47.498694 12757 consensus_queue.cc:1048] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:47.607671 11663 raft_consensus.cc:1275] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:47.609675 12757 consensus_queue.cc:1048] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:47.614432 11812 raft_consensus.cc:1275] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:47.616439 12730 consensus_queue.cc:1048] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:47.775440 11734 raft_consensus.cc:1275] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.776872 12757 consensus_queue.cc:1048] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.791975 11812 raft_consensus.cc:1275] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.794163 12797 consensus_queue.cc:1048] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:47.812032  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:47.869184  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:47.917248 11812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
mode: GRACEFUL
new_leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
 from {username='slave'} at 127.0.0.1:49778
I20260709 13:22:47.918111 11812 raft_consensus.cc:606] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Received request to transfer leadership to TS 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:47.922017 11734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245"
dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
mode: GRACEFUL
new_leader_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:54368
I20260709 13:22:47.922740 11734 raft_consensus.cc:606] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Received request to transfer leadership to TS 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:47.926050 11734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0"
dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
mode: GRACEFUL
new_leader_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:54368
I20260709 13:22:47.926662 11734 raft_consensus.cc:606] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Received request to transfer leadership to TS 01c914cf532f4dc19c1bab3514524ac2
I20260709 13:22:47.929414 11734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c"
dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:54368
I20260709 13:22:47.930020 11734 raft_consensus.cc:606] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:47.932776 11734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df"
dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:54368
I20260709 13:22:47.935214 11734 raft_consensus.cc:606] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:47.937032  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:22:47.939677  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:48.063445 12779 raft_consensus.cc:993] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e: : Instructing follower 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:48.064317 12779 raft_consensus.cc:1081] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Signalling peer 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:48.072250 11812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:44040
I20260709 13:22:48.073258 11812 raft_consensus.cc:493] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:48.073642 11812 raft_consensus.cc:3060] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.079990 11812 raft_consensus.cc:515] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.082333 11812 leader_election.cc:290] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:48.083632 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:48.083557 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48797993d22f487c9076c8f7d2c70245" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:48.084604 11738 raft_consensus.cc:3055] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:48.084715 11663 raft_consensus.cc:3060] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.085085 11738 raft_consensus.cc:740] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:48.086012 11738 consensus_queue.cc:260] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.087527 11738 raft_consensus.cc:3060] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.093428 11663 raft_consensus.cc:2468] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:48.095090 11776 leader_election.cc:304] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:48.095983 12777 raft_consensus.cc:2804] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:48.096486 12777 raft_consensus.cc:697] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:48.097514 11738 raft_consensus.cc:2468] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:48.097486 12777 consensus_queue.cc:237] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.108448 11487 catalog_manager.cc:5697] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from d59c3f822e674346af71ca9a5d899c2e (127.2.243.67) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:48.114480 12749 raft_consensus.cc:993] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2: : Instructing follower 4b102b83096e4830a35a9006a2a2a0f0 to start an election
I20260709 13:22:48.115159 12749 raft_consensus.cc:1081] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Signalling peer 4b102b83096e4830a35a9006a2a2a0f0 to start an election
I20260709 13:22:48.117019 11663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
 from {username='slave'} at 127.0.0.1:46086
I20260709 13:22:48.117657 11663 raft_consensus.cc:493] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:48.118044 11663 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:48.126446 11663 raft_consensus.cc:515] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.128877 12779 raft_consensus.cc:993] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:48.129537 12779 raft_consensus.cc:1081] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:48.129576 11663 leader_election.cc:290] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:48.131680 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:48.132294 11738 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:48.133488 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9e763e4e8f45e0a5d8a830dd1f93b5" candidate_uuid: "4b102b83096e4830a35a9006a2a2a0f0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:48.134174 11812 raft_consensus.cc:3055] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:48.134496 11812 raft_consensus.cc:740] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:48.135324 11812 consensus_queue.cc:260] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.136400 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39274
I20260709 13:22:48.136610 11812 raft_consensus.cc:3060] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:48.137032 12554 raft_consensus.cc:493] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:48.137415 12554 raft_consensus.cc:3060] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.143220 11738 raft_consensus.cc:2468] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 3.
I20260709 13:22:48.145665 11630 leader_election.cc:304] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b102b83096e4830a35a9006a2a2a0f0, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:48.146574 12781 raft_consensus.cc:2804] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:48.147641 12781 raft_consensus.cc:697] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:48.148635 12781 consensus_queue.cc:237] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.151019 11812 raft_consensus.cc:2468] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b102b83096e4830a35a9006a2a2a0f0 in term 3.
I20260709 13:22:48.159925 12554 raft_consensus.cc:515] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:48.162770 12554 leader_election.cc:290] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:48.163527 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:48.164295 11663 raft_consensus.cc:3060] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.164250 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b038f2a3164f739083461a162ce7df" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:48.165112 11738 raft_consensus.cc:3055] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:48.165422 11738 raft_consensus.cc:740] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:48.166302 11738 consensus_queue.cc:260] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:48.168409 11738 raft_consensus.cc:3060] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.168273 11487 catalog_manager.cc:5697] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 reported cstate change: term changed from 2 to 3, leader changed from 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68) to 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "4b102b83096e4830a35a9006a2a2a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:48.173413 11663 raft_consensus.cc:2468] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:48.174734 12431 leader_election.cc:304] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:48.175542 12757 raft_consensus.cc:2804] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:48.176044 12757 raft_consensus.cc:697] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:48.176962 12757 consensus_queue.cc:237] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:48.178737 11738 raft_consensus.cc:2468] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:48.190541 11487 catalog_manager.cc:5697] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 1 to 2, leader changed from d59c3f822e674346af71ca9a5d899c2e (127.2.243.67) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 2 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:48.193387 12779 raft_consensus.cc:993] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:48.194159 12800 raft_consensus.cc:1081] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:48.196635 12556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39274
I20260709 13:22:48.197808 12556 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:48.198242 12556 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:48.207140 12556 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:48.209553 12556 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:48.210724 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:48.211870 11812 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:48.210575 11738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:48.213002 11738 raft_consensus.cc:3055] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:48.213395 11738 raft_consensus.cc:740] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:48.214864 11738 consensus_queue.cc:260] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:48.216311 11738 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:48.220098 11812 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:48.221895 12433 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:48.222854 12757 raft_consensus.cc:2804] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:48.223748 12757 raft_consensus.cc:697] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:48.224716 12757 consensus_queue.cc:237] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:48.227378 11738 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:48.235827 11487 catalog_manager.cc:5697] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 2 to 3, leader changed from d59c3f822e674346af71ca9a5d899c2e (127.2.243.67) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 3 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:48.360309 12800 raft_consensus.cc:993] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e: : Instructing follower 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:48.360983 12779 raft_consensus.cc:1081] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Signalling peer 01c914cf532f4dc19c1bab3514524ac2 to start an election
I20260709 13:22:48.363718 11812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
 from {username='slave'} at 127.0.0.1:44040
I20260709 13:22:48.364853 11812 raft_consensus.cc:493] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:48.365293 11812 raft_consensus.cc:3060] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.373466 11812 raft_consensus.cc:515] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.375470 11812 leader_election.cc:290] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:48.376291 11663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:48.376806 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d0026358c345e890910be3c24e3da0" candidate_uuid: "01c914cf532f4dc19c1bab3514524ac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:48.377156 11663 raft_consensus.cc:3060] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.377399 11739 raft_consensus.cc:3055] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:48.377698 11739 raft_consensus.cc:740] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:48.378553 11739 consensus_queue.cc:260] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.380136 11739 raft_consensus.cc:3060] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:48.386065 11663 raft_consensus.cc:2468] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:48.388506 11776 leader_election.cc:304] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:48.389240 11739 raft_consensus.cc:2468] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01c914cf532f4dc19c1bab3514524ac2 in term 2.
I20260709 13:22:48.389396 12749 raft_consensus.cc:2804] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:48.390177 12749 raft_consensus.cc:697] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Leader. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:48.391279 12749 consensus_queue.cc:237] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } }
I20260709 13:22:48.404243 11487 catalog_manager.cc:5697] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 reported cstate change: term changed from 1 to 2, leader changed from d59c3f822e674346af71ca9a5d899c2e (127.2.243.67) to 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68). New cstate: current_term: 2 leader_uuid: "01c914cf532f4dc19c1bab3514524ac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:48.605109 11738 raft_consensus.cc:1275] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:48.606748 12808 consensus_queue.cc:1048] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:48.635924 11738 raft_consensus.cc:1275] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:48.637861 12749 consensus_queue.cc:1048] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:48.676455 11739 raft_consensus.cc:1275] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:48.678828 11812 raft_consensus.cc:1275] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Refusing update from remote peer 4b102b83096e4830a35a9006a2a2a0f0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:48.681556 12808 consensus_queue.cc:1048] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:48.687754 12755 consensus_queue.cc:1048] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:48.689206 11739 raft_consensus.cc:1275] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:48.690323 11663 raft_consensus.cc:1275] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:48.691349 12797 consensus_queue.cc:1048] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:48.692749 12815 consensus_queue.cc:1048] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:48.707489 11811 raft_consensus.cc:1275] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:48.730159 12797 consensus_queue.cc:1048] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:48.761406 11658 raft_consensus.cc:1275] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:48.764559 12797 consensus_queue.cc:1048] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:22:48.788676 11734 raft_consensus.cc:1275] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:48.791503 12777 consensus_queue.cc:1048] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:48.821434 11658 raft_consensus.cc:1275] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Refusing update from remote peer 01c914cf532f4dc19c1bab3514524ac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:48.829931 12777 consensus_queue.cc:1048] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:48.900192 12431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 52742.1us
I20260709 13:22:48.940850  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:48.986809 12433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 77106.3us
I20260709 13:22:49.149977  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:49.200809 11810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:49778
I20260709 13:22:49.201467 11810 raft_consensus.cc:606] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:49.208509 11810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64"
dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:49778
I20260709 13:22:49.209197 11810 raft_consensus.cc:606] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:49.212491 11663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce"
dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:55610
I20260709 13:22:49.213176 11663 raft_consensus.cc:606] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:49.218134 11739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81"
dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:54368
I20260709 13:22:49.218706 11739 raft_consensus.cc:606] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:49.222226 11739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16"
dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
mode: GRACEFUL
new_leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:54368
I20260709 13:22:49.222906 11739 raft_consensus.cc:606] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Received request to transfer leadership to TS 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:49.224368  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:22:49.226387  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:49.241777 12833 raft_consensus.cc:993] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.242635 12829 raft_consensus.cc:1081] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.245323 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:22:49.246387 12554 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:49.246812 12554 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:49.254480 12554 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:49.257140 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:49.257507 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac998e80f41198894f93a70c4e9ce" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:49.257861 11658 raft_consensus.cc:3055] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:49.258224 11739 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:49.258240 11658 raft_consensus.cc:740] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b102b83096e4830a35a9006a2a2a0f0, State: Running, Role: LEADER
I20260709 13:22:49.258335 12554 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 4 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:49.259604 11658 consensus_queue.cc:260] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:49.261009 11658 raft_consensus.cc:3060] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:49.269486 11739 raft_consensus.cc:2468] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 4.
I20260709 13:22:49.271329 12433 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:49.271818 11658 raft_consensus.cc:2468] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 4.
I20260709 13:22:49.272470 12840 raft_consensus.cc:2804] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:49.273077 12840 raft_consensus.cc:697] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:49.274113 12840 consensus_queue.cc:237] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:49.286933 11487 catalog_manager.cc:5697] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 3 to 4, leader changed from 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 4 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:49.332209 12830 raft_consensus.cc:993] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.332837 12800 raft_consensus.cc:1081] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.334756 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39274
I20260709 13:22:49.335371 12554 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:49.335773 12554 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.344594 12554 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:49.348245 12554 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Requested vote from peers 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717), d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051)
I20260709 13:22:49.348209 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b102b83096e4830a35a9006a2a2a0f0"
I20260709 13:22:49.349159 11665 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.349980 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5305a21fc0049f69c387e0811febd16" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:49.352589 11739 raft_consensus.cc:3055] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:49.352933 11739 raft_consensus.cc:740] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:49.354120 11739 consensus_queue.cc:260] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:49.355258 11739 raft_consensus.cc:3060] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.358193 11665 raft_consensus.cc:2468] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:49.359606 12431 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0; no voters: 
I20260709 13:22:49.360507 12840 raft_consensus.cc:2804] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:49.361047 12840 raft_consensus.cc:697] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:49.361949 11739 raft_consensus.cc:2468] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:49.362035 12840 consensus_queue.cc:237] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:49.376443 11485 catalog_manager.cc:5697] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 2 to 3, leader changed from d59c3f822e674346af71ca9a5d899c2e (127.2.243.67) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 3 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:49.398228 12830 raft_consensus.cc:993] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.398800 12800 raft_consensus.cc:1081] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.400732 12556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39274
I20260709 13:22:49.401407 12556 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:49.401793 12556 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.411737 12556 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.413938 12556 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:49.415092 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:49.415331 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:49.415884 11739 raft_consensus.cc:3055] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:49.415912 11810 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.416213 11739 raft_consensus.cc:740] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:49.417230 11739 consensus_queue.cc:260] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.418450 11739 raft_consensus.cc:3060] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.423105 11810 raft_consensus.cc:2468] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:49.424633 12433 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff; no voters: 
I20260709 13:22:49.425464 12840 raft_consensus.cc:2804] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:49.426028 12840 raft_consensus.cc:697] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:49.426134 11739 raft_consensus.cc:2468] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:49.428516 12840 consensus_queue.cc:237] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.431443 12777 raft_consensus.cc:993] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.432173 12777 raft_consensus.cc:1081] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.434520 12556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39278
I20260709 13:22:49.435256 12556 raft_consensus.cc:493] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:49.435674 12556 raft_consensus.cc:3060] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.443499 11485 catalog_manager.cc:5697] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 2 to 3, leader changed from d59c3f822e674346af71ca9a5d899c2e (127.2.243.67) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 3 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:49.445101 12556 raft_consensus.cc:515] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.447314 12556 leader_election.cc:290] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:49.448175 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:49.449281 11739 raft_consensus.cc:3060] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.451460 11810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:49.452219 11810 raft_consensus.cc:3055] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:49.457868 11810 raft_consensus.cc:740] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:49.458698 11810 consensus_queue.cc:260] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.460950 11739 raft_consensus.cc:2468] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:49.460218 11810 raft_consensus.cc:3060] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.472760 11810 raft_consensus.cc:2468] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 2.
I20260709 13:22:49.474462 12433 leader_election.cc:304] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:49.475555 12841 raft_consensus.cc:2804] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:49.476114 12841 raft_consensus.cc:697] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:49.477128 12841 consensus_queue.cc:237] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.507545 11485 catalog_manager.cc:5697] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 1 to 2, leader changed from 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 2 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:49.622501 12777 raft_consensus.cc:993] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2: : Instructing follower 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.623124 12816 raft_consensus.cc:1081] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Signalling peer 36c7a0f1511c4b18ad59155bbeb0c1ff to start an election
I20260709 13:22:49.625304 12556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7"
dest_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff"
 from {username='slave'} at 127.0.0.1:39278
I20260709 13:22:49.625989 12556 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:49.626515 12556 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.635753 12556 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.637809 12556 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Requested vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869)
I20260709 13:22:49.638844 11739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d59c3f822e674346af71ca9a5d899c2e"
I20260709 13:22:49.639109 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:49.639528 11739 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.639688 11812 raft_consensus.cc:3055] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:49.640071 11812 raft_consensus.cc:740] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01c914cf532f4dc19c1bab3514524ac2, State: Running, Role: LEADER
I20260709 13:22:49.640913 11812 consensus_queue.cc:260] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.642362 11812 raft_consensus.cc:3060] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:49.648463 11739 raft_consensus.cc:2468] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:49.650414 12433 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e; no voters: 
I20260709 13:22:49.651731 12836 raft_consensus.cc:2804] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:49.652251 11812 raft_consensus.cc:2468] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c7a0f1511c4b18ad59155bbeb0c1ff in term 3.
I20260709 13:22:49.652581 12836 raft_consensus.cc:697] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Becoming Leader. State: Replica: 36c7a0f1511c4b18ad59155bbeb0c1ff, State: Running, Role: LEADER
I20260709 13:22:49.654692 12836 consensus_queue.cc:237] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:49.672060 11485 catalog_manager.cc:5697] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff reported cstate change: term changed from 2 to 3, leader changed from 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68) to 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65). New cstate: current_term: 3 leader_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:49.676954 11658 raft_consensus.cc:1275] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:22:49.678932 12836 consensus_queue.cc:1048] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:49.707545 11739 raft_consensus.cc:1275] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:22:49.709555 12836 consensus_queue.cc:1048] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:49.870111 11739 raft_consensus.cc:1275] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:49.871831 12836 consensus_queue.cc:1048] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:49.908499 11812 raft_consensus.cc:1275] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:49.910348 12841 consensus_queue.cc:1048] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.051016 11665 raft_consensus.cc:1275] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:50.063980 11812 raft_consensus.cc:1275] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:22:50.077312 11778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:42051, user_credentials={real_user=slave}} blocked reactor thread for 69586.9us
I20260709 13:22:50.090463 11812 raft_consensus.cc:1275] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:50.089751 12840 consensus_queue.cc:1048] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:50.096204 11734 raft_consensus.cc:1275] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:50.099189 11739 raft_consensus.cc:1275] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:50.166982 12863 consensus_queue.cc:1048] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:50.173776 12863 consensus_queue.cc:1048] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:50.195022 12863 consensus_queue.cc:1048] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:50.207012 12868 consensus_queue.cc:1048] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:22:50.228034  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:50.276444 11702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.66:40717, user_credentials={real_user=slave}} blocked reactor thread for 81962.9us
W20260709 13:22:50.274636 11630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.68:39869, user_credentials={real_user=slave}} blocked reactor thread for 44538.6us
I20260709 13:22:50.345508 11739 raft_consensus.cc:1275] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Refusing update from remote peer 36c7a0f1511c4b18ad59155bbeb0c1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:50.358420 12841 consensus_queue.cc:1048] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:50.502144  3021 tablet_server.cc:179] TabletServer@127.2.243.65:42405 shutting down...
W20260709 13:22:50.511081 11628 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 398 similar messages]
W20260709 13:22:50.538373 11628 consensus_peers.cc:597] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.545341 11776 consensus_peers.cc:597] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.556648 11776 consensus_peers.cc:597] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.560909 11776 consensus_peers.cc:597] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.566376 11628 consensus_peers.cc:597] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.573608 11702 consensus_peers.cc:597] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.587677 11628 consensus_peers.cc:597] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.593278 11702 consensus_peers.cc:597] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.593465 11776 consensus_peers.cc:597] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.598788 11628 consensus_peers.cc:597] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.603812 11628 consensus_peers.cc:597] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.616842 11628 consensus_peers.cc:597] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.626818  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:50.628254  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.632089  3021 raft_consensus.cc:2243] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.633599  3021 raft_consensus.cc:2272] T 42d882e262e64f0fb7fc4614a9475b64 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.636098 11702 consensus_peers.cc:597] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.640657  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.642488  3021 raft_consensus.cc:2243] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.643814  3021 raft_consensus.cc:2272] T fe570064606c49e8ae9eeeacac9a6920 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.647377  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.648221  3021 raft_consensus.cc:2243] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.649024  3021 raft_consensus.cc:2272] T f34ebde4550a418cbfe562463c26adc4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.653309  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.654525  3021 raft_consensus.cc:2243] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.655256  3021 raft_consensus.cc:2272] T 3ce85d6ba19f471b90132d5118bc8478 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.660562  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.662011  3021 raft_consensus.cc:2243] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.663053  3021 raft_consensus.cc:2272] T 78a9c38790c24ddebcc9556c8e2356ea P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.670017  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.671564  3021 raft_consensus.cc:2243] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.672267  3021 raft_consensus.cc:2272] T 95b8cc1b52ce4b45866ae912c00828e5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.676671  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.678130  3021 raft_consensus.cc:2243] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:50.678172 11628 consensus_peers.cc:597] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.678860  3021 raft_consensus.cc:2272] T 4aaa30e70122417dbf41d98488d2528e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.682677  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.683699  3021 raft_consensus.cc:2243] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.684424  3021 raft_consensus.cc:2272] T f15a85cd24ff436eaa26a81455d6c7fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.690954  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.692185  3021 raft_consensus.cc:2243] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.693405  3021 raft_consensus.cc:2272] T 49ff1167f81242bd839fd9e4fc0b7196 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.697542  3021 tablet_replica.cc:333] stopping tablet replica
W20260709 13:22:50.697598 11702 consensus_peers.cc:597] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.698756  3021 raft_consensus.cc:2243] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.699326  3021 raft_consensus.cc:2272] T d1bbd404c86c44709ebe400b6a9026d6 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.702346  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.703255  3021 raft_consensus.cc:2243] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.703802  3021 raft_consensus.cc:2272] T 290688edb81143ac8abfb02f7060a88a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.706540  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.707275  3021 raft_consensus.cc:2243] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.707890  3021 raft_consensus.cc:2272] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.711700  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.712594  3021 raft_consensus.cc:2243] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.713660  3021 raft_consensus.cc:2272] T e5305a21fc0049f69c387e0811febd16 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.717300  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.718338  3021 raft_consensus.cc:2243] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.720011  3021 raft_consensus.cc:2272] T f06a77efc3a8409b991b0bb8bb957517 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.723107  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.724224  3021 raft_consensus.cc:2243] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.724988  3021 raft_consensus.cc:2272] T a80057d517d74e239a32fbe7ad0fe8c3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.729694  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.730646  3021 raft_consensus.cc:2243] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.731406  3021 raft_consensus.cc:2272] T eea5a35807cf47a18b69b5d51e415e5b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.735411  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.737157  3021 raft_consensus.cc:2243] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:50.737721 11702 consensus_peers.cc:597] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.737746  3021 raft_consensus.cc:2272] T 8881af9c27854058bd198d8a5bd2b1e3 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.740322 11776 consensus_peers.cc:597] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.742717  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.743675  3021 raft_consensus.cc:2243] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.744329  3021 raft_consensus.cc:2272] T 458610efe1f94a709b0a77f938cc539b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.748071  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.749032  3021 raft_consensus.cc:2243] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.750384  3021 raft_consensus.cc:2272] T cd44a633335a4f7f94505d7f37d1dc5c P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.753654  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.754554  3021 raft_consensus.cc:2243] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.755172  3021 raft_consensus.cc:2272] T 486dc6cde7764b78aa07d583ef365e55 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.757918 11776 consensus_peers.cc:597] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.758702  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.759668  3021 raft_consensus.cc:2243] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.760191  3021 raft_consensus.cc:2272] T 1ba6f809721a4ee98530e65fe13e1cae P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.764550  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.765693  3021 raft_consensus.cc:2243] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.766362  3021 raft_consensus.cc:2272] T 181ec31526954dedb65074b8c24fd570 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.770144  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.771759  3021 raft_consensus.cc:2243] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.772819  3021 raft_consensus.cc:2272] T d90928a613c2450bb00632a65064996a P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.775810  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.776589  3021 raft_consensus.cc:2243] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.777104  3021 raft_consensus.cc:2272] T e51f715c50984a62b3ff88c9fe9c4a91 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.779834  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.780646  3021 raft_consensus.cc:2243] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.781873  3021 raft_consensus.cc:2272] T 397c649b857e402ca8b1d21f4f416704 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.786128  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.787268  3021 raft_consensus.cc:2243] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.788084  3021 raft_consensus.cc:2272] T e497ab473ebd4e6e9f4b651ca4382280 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.793540  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.794593  3021 raft_consensus.cc:2243] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.795240  3021 raft_consensus.cc:2272] T 36fcdc9e0ad5475990fbcb8439ad5485 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.798691  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.799523  3021 raft_consensus.cc:2243] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.800078  3021 raft_consensus.cc:2272] T b8e8930dda4e488d9427d8e6e487f4ab P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.802179 11628 consensus_peers.cc:597] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.803083 11702 consensus_peers.cc:597] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.804029  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.805007  3021 raft_consensus.cc:2243] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.805796  3021 raft_consensus.cc:2272] T f452676fac6242168986700b221e358e P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.805832 11628 consensus_peers.cc:597] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.809281  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.810230  3021 raft_consensus.cc:2243] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.810714  3021 raft_consensus.cc:2272] T 226c4a2348e44e7797324eb4b36fe5fa P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.814399  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.815117  3021 raft_consensus.cc:2243] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.815758  3021 raft_consensus.cc:2272] T ce5a110a6f28455596def9d91be0d7a0 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.819198  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.820077  3021 raft_consensus.cc:2243] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.821276  3021 raft_consensus.cc:2272] T 11aa6af0390c4e07bf2b362d5bdb078d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.825313  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.826299  3021 raft_consensus.cc:2243] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.827068  3021 raft_consensus.cc:2272] T afee18061f56422e9609aa51229df7a9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.828719 11702 consensus_peers.cc:597] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.830029 11702 consensus_peers.cc:597] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.831374  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.832378  3021 raft_consensus.cc:2243] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.833601  3021 raft_consensus.cc:2272] T 2157764af6d24b3b8f6f36257e76c5c7 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.834084 11702 consensus_peers.cc:597] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.838323  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.839489  3021 raft_consensus.cc:2243] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.841094  3021 raft_consensus.cc:2272] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.843926 11702 consensus_peers.cc:597] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.845510  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.846848  3021 raft_consensus.cc:2243] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.848277  3021 raft_consensus.cc:2272] T ba936b69ea784d3aa5af76a721bdb29d P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.852277  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.853612  3021 raft_consensus.cc:2243] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.854426  3021 raft_consensus.cc:2272] T 3f60ac2c79f045c18e7c1eed3af5f12b P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.858428  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.859315  3021 raft_consensus.cc:2243] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.859879  3021 raft_consensus.cc:2272] T bb2b87661f184408bcc049ddd64425c5 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.862178 11628 consensus_peers.cc:597] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.863035  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.863790  3021 raft_consensus.cc:2243] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.864312  3021 raft_consensus.cc:2272] T 4407206cd8ba4bd19c922dd8b3accb96 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.867635  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.868754  3021 raft_consensus.cc:2243] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.869946  3021 raft_consensus.cc:2272] T 57cac998e80f41198894f93a70c4e9ce P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.874429  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.875124  3021 raft_consensus.cc:2243] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.876075  3021 raft_consensus.cc:2272] T 4b3893d7c0374a12933e175ada5b42de P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.878520  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.879132  3021 raft_consensus.cc:2243] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.880085  3021 raft_consensus.cc:2272] T b9f32f35d73c4f83a13beccdbaac3a81 P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.883329  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.884152  3021 raft_consensus.cc:2243] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.884882  3021 raft_consensus.cc:2272] T d4660f6f974c4c96bc3c2ef61e90405f P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:50.889081  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.889966  3021 raft_consensus.cc:2243] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:50.891384  3021 raft_consensus.cc:2272] T e4b038f2a3164f739083461a162ce7df P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.891350 11628 consensus_peers.cc:597] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.892639 11776 consensus_peers.cc:597] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:50.894832  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:50.895545  3021 raft_consensus.cc:2243] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:50.895972  3021 raft_consensus.cc:2272] T 0fae0c5c6645438dadaa067b0d5d92cb P 36c7a0f1511c4b18ad59155bbeb0c1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:50.909663 11776 consensus_peers.cc:597] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:50.973385 11628 consensus_peers.cc:597] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.016465  3021 tablet_server.cc:196] TabletServer@127.2.243.65:42405 shutdown complete.
W20260709 13:22:51.042085 11776 consensus_peers.cc:597] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Couldn't send request to peer 36c7a0f1511c4b18ad59155bbeb0c1ff. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.180604  3021 tablet_server.cc:179] TabletServer@127.2.243.66:0 shutting down...
W20260709 13:22:51.207866 11702 consensus_peers.cc:597] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:51.212709 11702 consensus_peers.cc:597] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:51.236872 11702 consensus_peers.cc:597] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:51.268184 11776 consensus_peers.cc:597] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:51.277477 11776 consensus_peers.cc:597] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:51.307483 11702 consensus_peers.cc:597] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.314038  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:51.315117  3021 tablet_replica.cc:333] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.316625  3021 raft_consensus.cc:2243] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.317528  3021 raft_consensus.cc:2272] T 4b3893d7c0374a12933e175ada5b42de P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.324636 11776 consensus_peers.cc:597] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.328364  3021 tablet_replica.cc:333] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.329802  3021 raft_consensus.cc:2243] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.330574  3021 raft_consensus.cc:2272] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.334415  3021 tablet_replica.cc:333] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.335187  3021 raft_consensus.cc:2243] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.335772  3021 raft_consensus.cc:2272] T b066170aeea34d52be3000a5f02c1804 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.338980  3021 tablet_replica.cc:333] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.339987  3021 raft_consensus.cc:2243] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.340770  3021 raft_consensus.cc:2272] T 48797993d22f487c9076c8f7d2c70245 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.344096  3021 tablet_replica.cc:333] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.344877  3021 raft_consensus.cc:2243] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.345382  3021 raft_consensus.cc:2272] T 30e0b15fa5004d8ea57f63e1bebb2103 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.348690  3021 tablet_replica.cc:333] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.350121  3021 raft_consensus.cc:2243] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:51.350230 11776 consensus_peers.cc:597] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.351143  3021 raft_consensus.cc:2272] T 181ec31526954dedb65074b8c24fd570 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.354976  3021 tablet_replica.cc:333] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.356040  3021 raft_consensus.cc:2243] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.356735  3021 raft_consensus.cc:2272] T d7f3321b4876472e8e02c6bda6b80ad9 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.361160  3021 tablet_replica.cc:333] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.362106  3021 raft_consensus.cc:2243] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.363318  3021 raft_consensus.cc:2272] T 3ce85d6ba19f471b90132d5118bc8478 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.369207 11702 consensus_peers.cc:597] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.369554  3021 tablet_replica.cc:333] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.370755  3021 raft_consensus.cc:2243] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.371501  3021 raft_consensus.cc:2272] T f34ebde4550a418cbfe562463c26adc4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.375383  3021 tablet_replica.cc:333] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.376170  3021 raft_consensus.cc:2243] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.376845  3021 raft_consensus.cc:2272] T aa6f3a61bd92477db40d5dcb52285b38 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.379127 11702 consensus_peers.cc:597] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.381937  3021 tablet_replica.cc:333] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.383103  3021 raft_consensus.cc:2243] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.383890  3021 raft_consensus.cc:2272] T d4660f6f974c4c96bc3c2ef61e90405f P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.387966  3021 tablet_replica.cc:333] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
W20260709 13:22:51.388186 11776 consensus_peers.cc:597] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.389191  3021 raft_consensus.cc:2243] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.390189  3021 raft_consensus.cc:2272] T e4b038f2a3164f739083461a162ce7df P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.393142  3021 tablet_replica.cc:333] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.393929  3021 raft_consensus.cc:2243] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.394469  3021 raft_consensus.cc:2272] T ce5a110a6f28455596def9d91be0d7a0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.397265  3021 tablet_replica.cc:333] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.397936  3021 raft_consensus.cc:2243] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.398442  3021 raft_consensus.cc:2272] T b046224b89c645faacf4c9feb1def01b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.401623  3021 tablet_replica.cc:333] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.403155  3021 raft_consensus.cc:2243] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.404141  3021 raft_consensus.cc:2272] T a3d0026358c345e890910be3c24e3da0 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.407505  3021 tablet_replica.cc:333] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.408156  3021 raft_consensus.cc:2243] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.409188  3021 raft_consensus.cc:2272] T e497ab473ebd4e6e9f4b651ca4382280 P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.411646  3021 tablet_replica.cc:333] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.412263  3021 raft_consensus.cc:2243] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.412871  3021 raft_consensus.cc:2272] T d90928a613c2450bb00632a65064996a P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.415900  3021 tablet_replica.cc:333] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.416641  3021 raft_consensus.cc:2243] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.417276  3021 raft_consensus.cc:2272] T 397c649b857e402ca8b1d21f4f416704 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.420742  3021 tablet_replica.cc:333] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.421562  3021 raft_consensus.cc:2243] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.422506  3021 raft_consensus.cc:2272] T 49ff1167f81242bd839fd9e4fc0b7196 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.425323  3021 tablet_replica.cc:333] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.425973  3021 raft_consensus.cc:2243] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.426977  3021 raft_consensus.cc:2272] T 290688edb81143ac8abfb02f7060a88a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.429984  3021 tablet_replica.cc:333] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.430990  3021 raft_consensus.cc:2243] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.432277  3021 raft_consensus.cc:2272] T 11338158fbbd4a72bb1c7f9375a25d6a P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.433248 11702 consensus_peers.cc:597] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.435410  3021 tablet_replica.cc:333] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.436642  3021 raft_consensus.cc:2243] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.437302  3021 raft_consensus.cc:2272] T 57cac998e80f41198894f93a70c4e9ce P 4b102b83096e4830a35a9006a2a2a0f0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.440701  3021 tablet_replica.cc:333] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.441561  3021 raft_consensus.cc:2243] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.442783  3021 raft_consensus.cc:2272] T 36fcdc9e0ad5475990fbcb8439ad5485 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.446220  3021 tablet_replica.cc:333] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.447185  3021 raft_consensus.cc:2243] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.448745  3021 raft_consensus.cc:2272] T f452676fac6242168986700b221e358e P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.452785  3021 tablet_replica.cc:333] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.453826  3021 raft_consensus.cc:2243] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.455044  3021 raft_consensus.cc:2272] T b8e8930dda4e488d9427d8e6e487f4ab P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.458624  3021 tablet_replica.cc:333] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.459525  3021 raft_consensus.cc:2243] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.460122  3021 raft_consensus.cc:2272] T e5305a21fc0049f69c387e0811febd16 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.463502  3021 tablet_replica.cc:333] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.464473  3021 raft_consensus.cc:2243] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.465127  3021 raft_consensus.cc:2272] T 04373c0b8b6d47c5a1e07da5a04be2a4 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.470131  3021 tablet_replica.cc:333] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.471189  3021 raft_consensus.cc:2243] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:22:51.471405 11702 consensus_peers.cc:597] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.472259  3021 raft_consensus.cc:2272] T f15a85cd24ff436eaa26a81455d6c7fa P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.476052  3021 tablet_replica.cc:333] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.477022  3021 raft_consensus.cc:2243] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.477648  3021 raft_consensus.cc:2272] T 95b8cc1b52ce4b45866ae912c00828e5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.481251  3021 tablet_replica.cc:333] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.481992  3021 raft_consensus.cc:2243] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.482599  3021 raft_consensus.cc:2272] T 8d2e77a7d8e74543bab76ac11418f6d3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.486482  3021 tablet_replica.cc:333] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.487452  3021 raft_consensus.cc:2243] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.488273  3021 raft_consensus.cc:2272] T 96d8d45c6521413ab41e0897d088fe75 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.492121  3021 tablet_replica.cc:333] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.493469  3021 raft_consensus.cc:2243] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.495092  3021 raft_consensus.cc:2272] T f748295a5651478fad54cf62835b6d71 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.497295 11702 consensus_peers.cc:597] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.499055  3021 tablet_replica.cc:333] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.500089  3021 raft_consensus.cc:2243] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.500797  3021 raft_consensus.cc:2272] T 8c066f250eb042dcb608879783345178 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.503341 11776 consensus_peers.cc:597] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.504086  3021 tablet_replica.cc:333] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.505260  3021 raft_consensus.cc:2243] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.506138  3021 raft_consensus.cc:2272] T ec71cc0340da4c8fac91f96fa561a0bb P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.509537  3021 tablet_replica.cc:333] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.510519  3021 raft_consensus.cc:2243] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.511332  3021 raft_consensus.cc:2272] T ba936b69ea784d3aa5af76a721bdb29d P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.514853  3021 tablet_replica.cc:333] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.515508  3021 raft_consensus.cc:2243] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.516566  3021 raft_consensus.cc:2272] T 3f60ac2c79f045c18e7c1eed3af5f12b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.519481  3021 tablet_replica.cc:333] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.520390  3021 raft_consensus.cc:2243] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.521494  3021 raft_consensus.cc:2272] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.523208 11702 consensus_peers.cc:597] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.523998  3021 tablet_replica.cc:333] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.524788  3021 raft_consensus.cc:2243] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.526039  3021 raft_consensus.cc:2272] T a80057d517d74e239a32fbe7ad0fe8c3 P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.528546  3021 tablet_replica.cc:333] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.529338  3021 raft_consensus.cc:2243] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.529953  3021 raft_consensus.cc:2272] T f06a77efc3a8409b991b0bb8bb957517 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.532421  3021 tablet_replica.cc:333] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.533041  3021 raft_consensus.cc:2243] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.533967  3021 raft_consensus.cc:2272] T 78a9c38790c24ddebcc9556c8e2356ea P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.536490  3021 tablet_replica.cc:333] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.537153  3021 raft_consensus.cc:2243] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.537664  3021 raft_consensus.cc:2272] T 458610efe1f94a709b0a77f938cc539b P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.540457  3021 tablet_replica.cc:333] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.541126  3021 raft_consensus.cc:2243] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.542234  3021 raft_consensus.cc:2272] T 1ba6f809721a4ee98530e65fe13e1cae P 4b102b83096e4830a35a9006a2a2a0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.545331  3021 tablet_replica.cc:333] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.546263  3021 raft_consensus.cc:2243] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.547061  3021 raft_consensus.cc:2272] T 486dc6cde7764b78aa07d583ef365e55 P 4b102b83096e4830a35a9006a2a2a0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.547488 11776 consensus_peers.cc:597] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.549772  3021 tablet_replica.cc:333] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0: stopping tablet replica
I20260709 13:22:51.550457  3021 raft_consensus.cc:2243] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.551033  3021 raft_consensus.cc:2272] T 11aa6af0390c4e07bf2b362d5bdb078d P 4b102b83096e4830a35a9006a2a2a0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.565688 11776 consensus_peers.cc:597] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:51.651829 11776 consensus_peers.cc:597] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.691687  3021 tablet_server.cc:196] TabletServer@127.2.243.66:0 shutdown complete.
W20260709 13:22:51.759085 11702 consensus_peers.cc:597] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e -> Peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Couldn't send request to peer 4b102b83096e4830a35a9006a2a2a0f0. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.806612 12842 raft_consensus.cc:493] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:51.807451 12842 raft_consensus.cc:515] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:51.810441 12842 leader_election.cc:290] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:51.817740 11702 leader_election.cc:336] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:51.819047 11702 leader_election.cc:336] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:51.819584 11702 leader_election.cc:304] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:51.820559 12842 raft_consensus.cc:2749] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:51.821614  3021 tablet_server.cc:179] TabletServer@127.2.243.67:0 shutting down...
W20260709 13:22:51.829954 11778 consensus_peers.cc:597] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.846210 12842 raft_consensus.cc:493] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:51.847107 12842 raft_consensus.cc:515] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:51.851739 12842 leader_election.cc:290] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:51.852983 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe570064606c49e8ae9eeeacac9a6920" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
W20260709 13:22:51.864912 11702 leader_election.cc:336] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:51.865521 11702 leader_election.cc:304] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:51.866451 12888 raft_consensus.cc:2749] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:22:51.884044 11778 consensus_peers.cc:597] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.887290 12749 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:51.887902 12749 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:51.891029 12749 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:51.899003 11778 leader_election.cc:336] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:22:51.902837 11776 leader_election.cc:336] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:51.903389 11776 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:51.904170 12749 raft_consensus.cc:2749] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:51.908103  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:51.909644  3021 tablet_replica.cc:333] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.910526  3021 raft_consensus.cc:2243] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.911526  3021 raft_consensus.cc:2272] T bb2b87661f184408bcc049ddd64425c5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.914624  3021 tablet_replica.cc:333] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.915664  3021 raft_consensus.cc:2243] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.916441  3021 raft_consensus.cc:2272] T 3ce85d6ba19f471b90132d5118bc8478 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.920068  3021 tablet_replica.cc:333] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.920861  3021 raft_consensus.cc:2243] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.921403  3021 raft_consensus.cc:2272] T 48797993d22f487c9076c8f7d2c70245 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.923875  3021 tablet_replica.cc:333] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.924620  3021 raft_consensus.cc:2243] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.925169  3021 raft_consensus.cc:2272] T 30e0b15fa5004d8ea57f63e1bebb2103 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.928380  3021 tablet_replica.cc:333] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.929433  3021 raft_consensus.cc:2243] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.930572  3021 raft_consensus.cc:2272] T 181ec31526954dedb65074b8c24fd570 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.931558 11778 consensus_peers.cc:597] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:51.933830  3021 tablet_replica.cc:333] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.935032  3021 raft_consensus.cc:2243] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.936218  3021 raft_consensus.cc:2272] T d7f3321b4876472e8e02c6bda6b80ad9 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.938585  3021 tablet_replica.cc:333] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.939320  3021 raft_consensus.cc:2243] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.940279  3021 raft_consensus.cc:2272] T eea5a35807cf47a18b69b5d51e415e5b P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.942674  3021 tablet_replica.cc:333] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.943400  3021 raft_consensus.cc:2243] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.943928  3021 raft_consensus.cc:2272] T a80057d517d74e239a32fbe7ad0fe8c3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.946847  3021 tablet_replica.cc:333] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.948026  3021 raft_consensus.cc:2243] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.949301  3021 raft_consensus.cc:2272] T ce5a110a6f28455596def9d91be0d7a0 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.952783  3021 tablet_replica.cc:333] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.954151  3021 raft_consensus.cc:2243] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.955412  3021 raft_consensus.cc:2272] T d4660f6f974c4c96bc3c2ef61e90405f P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.958765  3021 tablet_replica.cc:333] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.959774  3021 raft_consensus.cc:2243] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.960300  3021 raft_consensus.cc:2272] T e4b038f2a3164f739083461a162ce7df P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.962949  3021 tablet_replica.cc:333] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.963567  3021 raft_consensus.cc:2243] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:51.964569  3021 raft_consensus.cc:2272] T b046224b89c645faacf4c9feb1def01b P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.966341 12888 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:51.966929 12888 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:51.967692  3021 tablet_replica.cc:333] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.968915  3021 raft_consensus.cc:2243] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.969122 12888 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:51.969545  3021 raft_consensus.cc:2272] T 0fae0c5c6645438dadaa067b0d5d92cb P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.971626 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f32f35d73c4f83a13beccdbaac3a81" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:51.973047  3021 tablet_replica.cc:333] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.973868  3021 raft_consensus.cc:2243] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.974490  3021 raft_consensus.cc:2272] T 4407206cd8ba4bd19c922dd8b3accb96 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:51.974745 11702 leader_election.cc:336] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:51.975281 11702 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 01c914cf532f4dc19c1bab3514524ac2, 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:51.976190 12888 raft_consensus.cc:2749] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:51.977540  3021 tablet_replica.cc:333] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.978312  3021 raft_consensus.cc:2243] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.978780  3021 raft_consensus.cc:2272] T a3d0026358c345e890910be3c24e3da0 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.979599 12888 raft_consensus.cc:493] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:51.980180 12888 raft_consensus.cc:515] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:51.981781  3021 tablet_replica.cc:333] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.982565 12888 leader_election.cc:290] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:51.982867  3021 raft_consensus.cc:2243] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.983677  3021 raft_consensus.cc:2272] T d1bbd404c86c44709ebe400b6a9026d6 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.984468 12749 raft_consensus.cc:493] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:51.985087 12749 raft_consensus.cc:515] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:51.986829 12883 raft_consensus.cc:493] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:51.987596  3021 tablet_replica.cc:333] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.987536 12883 raft_consensus.cc:515] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:51.988907  3021 raft_consensus.cc:2243] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:51.989423 11702 leader_election.cc:336] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:51.989656  3021 raft_consensus.cc:2272] T 290688edb81143ac8abfb02f7060a88a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.989749 12883 leader_election.cc:290] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:51.990255 11702 leader_election.cc:336] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:51.990756 11702 leader_election.cc:304] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:51.991225 12749 leader_election.cc:290] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:51.992256 12871 raft_consensus.cc:493] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:51.993680  3021 tablet_replica.cc:333] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.992954 12871 raft_consensus.cc:515] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:51.994711  3021 raft_consensus.cc:2243] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:51.995383  3021 raft_consensus.cc:2272] T e5305a21fc0049f69c387e0811febd16 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:51.997447 12871 leader_election.cc:290] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:51.991595 12888 raft_consensus.cc:2749] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:51.998905  3021 tablet_replica.cc:333] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:51.999934  3021 raft_consensus.cc:2243] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.001087  3021 raft_consensus.cc:2272] T 04373c0b8b6d47c5a1e07da5a04be2a4 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.004987  3021 tablet_replica.cc:333] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.005955  3021 raft_consensus.cc:2243] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.007097  3021 raft_consensus.cc:2272] T 226c4a2348e44e7797324eb4b36fe5fa P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.010509  3021 tablet_replica.cc:333] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.011487  3021 raft_consensus.cc:2243] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.012143  3021 raft_consensus.cc:2272] T 11338158fbbd4a72bb1c7f9375a25d6a P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.012818 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2157764af6d24b3b8f6f36257e76c5c7" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:52.013633 11811 raft_consensus.cc:2468] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 3.
I20260709 13:22:52.015300  3021 tablet_replica.cc:333] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.015512 12749 raft_consensus.cc:493] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.016407  3021 raft_consensus.cc:2243] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.017186  3021 raft_consensus.cc:2272] T afee18061f56422e9609aa51229df7a9 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.016939 12749 raft_consensus.cc:515] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:52.017449 11778 consensus_peers.cc:597] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:52.019235 12867 raft_consensus.cc:493] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.019853 12867 raft_consensus.cc:515] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:52.020646 12749 leader_election.cc:290] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:52.020766  3021 tablet_replica.cc:333] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
W20260709 13:22:52.021256 11776 leader_election.cc:336] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.022446 12867 leader_election.cc:290] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:52.023036 11776 leader_election.cc:336] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.023245  3021 raft_consensus.cc:2243] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.023991  3021 raft_consensus.cc:2272] T 11aa6af0390c4e07bf2b362d5bdb078d P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.023990 11704 leader_election.cc:304] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 
W20260709 13:22:52.025790 11776 leader_election.cc:336] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:52.026382 11776 leader_election.cc:304] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
W20260709 13:22:52.027410 11776 leader_election.cc:336] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:52.027858 12883 raft_consensus.cc:2749] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:52.028007  3021 tablet_replica.cc:333] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.027880 11776 leader_election.cc:304] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
W20260709 13:22:52.028261 11778 leader_election.cc:336] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:22:52.027976 12888 raft_consensus.cc:2804] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:22:52.029711  3021 raft_consensus.cc:2243] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.030435 12871 raft_consensus.cc:493] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.030701  3021 raft_consensus.cc:2272] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.031038 12867 raft_consensus.cc:2749] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:52.031222 12871 raft_consensus.cc:515] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:52.033217 12867 raft_consensus.cc:493] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.033735 12867 raft_consensus.cc:515] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
W20260709 13:22:52.035597 12888 raft_consensus.cc:2810] Couldn't start leader election after successful pre-election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:22:52.035945 12867 leader_election.cc:290] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:52.036722 12871 leader_election.cc:290] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:52.038555 12749 raft_consensus.cc:493] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.039500  3021 tablet_replica.cc:333] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
W20260709 13:22:52.040148 11776 leader_election.cc:336] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:52.040601  3021 raft_consensus.cc:2243] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.039181 12749 raft_consensus.cc:515] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:52.042013  3021 raft_consensus.cc:2272] T 8c066f250eb042dcb608879783345178 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.045552  3021 tablet_replica.cc:333] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.046656  3021 raft_consensus.cc:2243] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.047448  3021 raft_consensus.cc:2272] T f748295a5651478fad54cf62835b6d71 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:52.040915 11778 leader_election.cc:336] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:22:52.051918  3021 tablet_replica.cc:333] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.052429 12749 leader_election.cc:290] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:52.053135  3021 raft_consensus.cc:2243] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.053539 12749 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.054172  3021 raft_consensus.cc:2272] T 4aaa30e70122417dbf41d98488d2528e P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:52.054692 11702 leader_election.cc:336] T 2157764af6d24b3b8f6f36257e76c5c7 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.054533 12749 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:52.058202  3021 tablet_replica.cc:333] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
W20260709 13:22:52.058593 11702 leader_election.cc:336] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.059471  3021 raft_consensus.cc:2243] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.060324  3021 raft_consensus.cc:2272] T ec71cc0340da4c8fac91f96fa561a0bb P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.063619  3021 tablet_replica.cc:333] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.064723  3021 raft_consensus.cc:2243] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.065510  3021 raft_consensus.cc:2272] T 96d8d45c6521413ab41e0897d088fe75 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.069164  3021 tablet_replica.cc:333] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.070215  3021 raft_consensus.cc:2243] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.071600  3021 raft_consensus.cc:2272] T b066170aeea34d52be3000a5f02c1804 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.071954 12871 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.072724 12871 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:52.075485  3021 tablet_replica.cc:333] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.076171 12871 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:52.076689  3021 raft_consensus.cc:2243] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.077503  3021 raft_consensus.cc:2272] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.080822  3021 tablet_replica.cc:333] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.080883 12749 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:52.081905  3021 raft_consensus.cc:2243] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.082628  3021 raft_consensus.cc:2272] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:52.083433 11778 leader_election.cc:336] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:22:52.085996  3021 tablet_replica.cc:333] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.087033  3021 raft_consensus.cc:2243] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.087769  3021 raft_consensus.cc:2272] T e51f715c50984a62b3ff88c9fe9c4a91 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:52.087102 11702 leader_election.cc:336] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.088979 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d882e262e64f0fb7fc4614a9475b64" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:52.089319 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2" is_pre_election: true
I20260709 13:22:52.089732 11811 raft_consensus.cc:2468] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 2.
I20260709 13:22:52.090086 11812 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 3.
I20260709 13:22:52.091210  3021 tablet_replica.cc:333] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.092005  3021 raft_consensus.cc:2243] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.093237  3021 raft_consensus.cc:2272] T d90928a613c2450bb00632a65064996a P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.094868 11704 leader_election.cc:304] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
W20260709 13:22:52.095721 11704 raft_consensus.cc:2686] T 42d882e262e64f0fb7fc4614a9475b64 P d59c3f822e674346af71ca9a5d899c2e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:22:52.097131  3021 tablet_replica.cc:333] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.097224 11704 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:52.098271 12871 raft_consensus.cc:2804] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:22:52.098400  3021 raft_consensus.cc:2243] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.099229  3021 raft_consensus.cc:2272] T 8d2e77a7d8e74543bab76ac11418f6d3 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.098750 12871 raft_consensus.cc:493] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.100137 12871 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:22:52.101876 11776 leader_election.cc:336] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.102389 11776 leader_election.cc:304] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:52.102643  3021 tablet_replica.cc:333] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.103358 12893 raft_consensus.cc:2749] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:52.103595  3021 raft_consensus.cc:2243] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:52.104426 11776 leader_election.cc:336] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.104832 11776 leader_election.cc:304] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:52.105830 12893 raft_consensus.cc:2749] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:22:52.106925 11776 leader_election.cc:336] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.107303 11776 leader_election.cc:304] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:52.107903 12893 raft_consensus.cc:2749] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:22:52.108121 11776 leader_election.cc:336] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:52.111092 11776 leader_election.cc:336] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:52.111460 11776 leader_election.cc:304] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:52.112083 12749 raft_consensus.cc:2749] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:22:52.112576 11776 leader_election.cc:336] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.113050 11776 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:52.113659 12893 raft_consensus.cc:2749] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:22:52.113670 11778 consensus_peers.cc:597] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:52.117086 11778 consensus_peers.cc:597] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:52.117307 12871 raft_consensus.cc:515] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:52.119562 12871 leader_election.cc:290] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 election: Requested vote from peers 01c914cf532f4dc19c1bab3514524ac2 (127.2.243.68:39869), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
I20260709 13:22:52.121703 11812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd44a633335a4f7f94505d7f37d1dc5c" candidate_uuid: "d59c3f822e674346af71ca9a5d899c2e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01c914cf532f4dc19c1bab3514524ac2"
I20260709 13:22:52.122406 11812 raft_consensus.cc:3060] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:22:52.125450 11702 leader_election.cc:336] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.130237 11812 raft_consensus.cc:2468] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d59c3f822e674346af71ca9a5d899c2e in term 4.
I20260709 13:22:52.134171 11704 leader_election.cc:304] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2, d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff
I20260709 13:22:52.135757 12842 raft_consensus.cc:2804] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:52.136401 12842 raft_consensus.cc:697] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 4 LEADER]: Becoming Leader. State: Replica: d59c3f822e674346af71ca9a5d899c2e, State: Running, Role: LEADER
I20260709 13:22:52.137038  3021 raft_consensus.cc:2272] T 95b8cc1b52ce4b45866ae912c00828e5 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.137552 12842 consensus_queue.cc:237] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:52.140858  3021 tablet_replica.cc:333] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.142107  3021 raft_consensus.cc:2243] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.142967  3021 raft_consensus.cc:2272] T f15a85cd24ff436eaa26a81455d6c7fa P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.148289  3021 tablet_replica.cc:333] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.149329  3021 raft_consensus.cc:2243] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.150530  3021 raft_consensus.cc:2272] T aa6f3a61bd92477db40d5dcb52285b38 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.153218  3021 tablet_replica.cc:333] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.153853  3021 raft_consensus.cc:2243] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.154346  3021 raft_consensus.cc:2272] T fe570064606c49e8ae9eeeacac9a6920 P d59c3f822e674346af71ca9a5d899c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.156850  3021 tablet_replica.cc:333] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.157419  3021 raft_consensus.cc:2243] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.158111  3021 pending_rounds.cc:70] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: Trying to abort 1 pending ops.
I20260709 13:22:52.158293  3021 pending_rounds.cc:77] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305639412286763008 op_type: NO_OP noop_request { }
I20260709 13:22:52.158562  3021 raft_consensus.cc:2889] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:52.158810  3021 raft_consensus.cc:2272] T cd44a633335a4f7f94505d7f37d1dc5c P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.161795  3021 tablet_replica.cc:333] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.162371  3021 raft_consensus.cc:2243] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.162834  3021 raft_consensus.cc:2272] T 1ba6f809721a4ee98530e65fe13e1cae P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.165360  3021 tablet_replica.cc:333] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.165875  3021 raft_consensus.cc:2243] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.167070  3021 raft_consensus.cc:2272] T 8881af9c27854058bd198d8a5bd2b1e3 P d59c3f822e674346af71ca9a5d899c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.170089  3021 tablet_replica.cc:333] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.170732 12842 raft_consensus.cc:493] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.171448 12842 raft_consensus.cc:515] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } } peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } }
I20260709 13:22:52.172319  3021 raft_consensus.cc:2243] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.175154  3021 raft_consensus.cc:2272] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.175402 12842 leader_election.cc:290] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:52.179013 11778 consensus_peers.cc:597] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:52.179522  3021 tablet_replica.cc:333] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e: stopping tablet replica
I20260709 13:22:52.179425 12749 raft_consensus.cc:493] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
W20260709 13:22:52.179993 11702 leader_election.cc:336] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.180680  3021 raft_consensus.cc:2243] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.180423 12749 raft_consensus.cc:515] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
W20260709 13:22:52.180943 11778 consensus_peers.cc:597] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:52.181392  3021 raft_consensus.cc:2272] T b9f32f35d73c4f83a13beccdbaac3a81 P d59c3f822e674346af71ca9a5d899c2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.182998 12749 leader_election.cc:290] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:52.183444 11702 leader_election.cc:336] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
W20260709 13:22:52.183907 11778 consensus_peers.cc:597] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:52.183971 11702 leader_election.cc:304] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d59c3f822e674346af71ca9a5d899c2e; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
W20260709 13:22:52.184901 11702 raft_consensus.cc:2686] T 57cac998e80f41198894f93a70c4e9ce P d59c3f822e674346af71ca9a5d899c2e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:22:52.191021 11776 leader_election.cc:336] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:52.192425 11776 leader_election.cc:336] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:52.192947 11776 leader_election.cc:304] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:52.194649 12749 raft_consensus.cc:2749] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:52.194986 12883 raft_consensus.cc:493] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36c7a0f1511c4b18ad59155bbeb0c1ff)
I20260709 13:22:52.195693 12883 raft_consensus.cc:515] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d59c3f822e674346af71ca9a5d899c2e" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 42051 } } peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } }
I20260709 13:22:52.198194 12883 leader_election.cc:290] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051), 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405)
W20260709 13:22:52.207271 11778 leader_election.cc:336] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:22:52.208963 11776 leader_election.cc:336] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
I20260709 13:22:52.210080 11776 leader_election.cc:304] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, d59c3f822e674346af71ca9a5d899c2e
I20260709 13:22:52.211520 12893 raft_consensus.cc:2749] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:22:52.258244 11778 connection.cc:573] client connection to 127.2.243.67:42051 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:22:52.264809 11778 consensus_peers.cc:597] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:42051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:52.269968 11778 consensus_peers.cc:597] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:42051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:52.279877  3021 tablet_server.cc:196] TabletServer@127.2.243.67:0 shutdown complete.
W20260709 13:22:52.323482 11778 consensus_peers.cc:597] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 -> Peer d59c3f822e674346af71ca9a5d899c2e (127.2.243.67:42051): Couldn't send request to peer d59c3f822e674346af71ca9a5d899c2e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.67:42051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:52.374049  3021 tablet_server.cc:179] TabletServer@127.2.243.68:0 shutting down...
I20260709 13:22:52.433451 12893 raft_consensus.cc:493] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b102b83096e4830a35a9006a2a2a0f0)
I20260709 13:22:52.434230 12893 raft_consensus.cc:515] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:52.437242 12893 leader_election.cc:290] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
W20260709 13:22:52.442728 11776 leader_election.cc:336] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:52.444171 11776 leader_election.cc:336] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:52.444453  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:52.444788 11776 leader_election.cc:304] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:52.445953  3021 tablet_replica.cc:333] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.445986 12883 raft_consensus.cc:2749] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:52.447546  3021 raft_consensus.cc:2243] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.448308  3021 raft_consensus.cc:2272] T cbb9d5e7bf3a47a5bfae29dc73636ec9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.451509  3021 tablet_replica.cc:333] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.452574  3021 raft_consensus.cc:2243] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.453668  3021 raft_consensus.cc:2272] T 48797993d22f487c9076c8f7d2c70245 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.456138  3021 tablet_replica.cc:333] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.456904  3021 raft_consensus.cc:2243] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.457791  3021 raft_consensus.cc:2272] T 30e0b15fa5004d8ea57f63e1bebb2103 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.460088  3021 tablet_replica.cc:333] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.460989  3021 raft_consensus.cc:2243] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.461685  3021 raft_consensus.cc:2272] T d7f3321b4876472e8e02c6bda6b80ad9 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.464767  3021 tablet_replica.cc:333] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.465819  3021 raft_consensus.cc:2243] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.466991  3021 raft_consensus.cc:2272] T f34ebde4550a418cbfe562463c26adc4 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.470139  3021 tablet_replica.cc:333] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.470917  3021 raft_consensus.cc:2243] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.471525  3021 raft_consensus.cc:2272] T b046224b89c645faacf4c9feb1def01b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.474599  3021 tablet_replica.cc:333] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.475728  3021 raft_consensus.cc:2243] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.476963  3021 raft_consensus.cc:2272] T 0fae0c5c6645438dadaa067b0d5d92cb P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.479884  3021 tablet_replica.cc:333] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.480650  3021 raft_consensus.cc:2243] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.481760  3021 raft_consensus.cc:2272] T a3d0026358c345e890910be3c24e3da0 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.484701  3021 tablet_replica.cc:333] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.485386  3021 raft_consensus.cc:2243] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.486323  3021 raft_consensus.cc:2272] T 4407206cd8ba4bd19c922dd8b3accb96 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.488878  3021 tablet_replica.cc:333] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.489879  3021 raft_consensus.cc:2243] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.490345  3021 raft_consensus.cc:2272] T 226c4a2348e44e7797324eb4b36fe5fa P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.493016  3021 tablet_replica.cc:333] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.493583  3021 raft_consensus.cc:2243] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.494035  3021 raft_consensus.cc:2272] T 11338158fbbd4a72bb1c7f9375a25d6a P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.496176  3021 tablet_replica.cc:333] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.496893  3021 raft_consensus.cc:2243] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.497754  3021 raft_consensus.cc:2272] T d1bbd404c86c44709ebe400b6a9026d6 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.500849  3021 tablet_replica.cc:333] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.501662  3021 raft_consensus.cc:2243] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.502358  3021 raft_consensus.cc:2272] T 49ff1167f81242bd839fd9e4fc0b7196 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.505290  3021 tablet_replica.cc:333] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.506047  3021 raft_consensus.cc:2243] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.506676  3021 raft_consensus.cc:2272] T 36fcdc9e0ad5475990fbcb8439ad5485 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.509241  3021 tablet_replica.cc:333] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.510004  3021 raft_consensus.cc:2243] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.510552  3021 raft_consensus.cc:2272] T b8e8930dda4e488d9427d8e6e487f4ab P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.513003  3021 tablet_replica.cc:333] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.513725  3021 raft_consensus.cc:2243] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.514227  3021 raft_consensus.cc:2272] T f452676fac6242168986700b221e358e P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.517408  3021 tablet_replica.cc:333] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.518453  3021 raft_consensus.cc:2243] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.529081  3021 raft_consensus.cc:2272] T ec71cc0340da4c8fac91f96fa561a0bb P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.531555  3021 tablet_replica.cc:333] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.532202  3021 raft_consensus.cc:2243] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.533635  3021 raft_consensus.cc:2272] T afee18061f56422e9609aa51229df7a9 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.536168  3021 tablet_replica.cc:333] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.536918  3021 raft_consensus.cc:2243] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.537480  3021 raft_consensus.cc:2272] T 2157764af6d24b3b8f6f36257e76c5c7 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.539682  3021 tablet_replica.cc:333] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.540285  3021 raft_consensus.cc:2243] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.540803  3021 raft_consensus.cc:2272] T e497ab473ebd4e6e9f4b651ca4382280 P 01c914cf532f4dc19c1bab3514524ac2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.543332  3021 tablet_replica.cc:333] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.544318  3021 raft_consensus.cc:2243] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.545729  3021 raft_consensus.cc:2272] T e51f715c50984a62b3ff88c9fe9c4a91 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.548178  3021 tablet_replica.cc:333] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.548895  3021 raft_consensus.cc:2243] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.549424  3021 raft_consensus.cc:2272] T 397c649b857e402ca8b1d21f4f416704 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.551633  3021 tablet_replica.cc:333] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.552261  3021 raft_consensus.cc:2243] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.552819  3021 raft_consensus.cc:2272] T 8c066f250eb042dcb608879783345178 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.555354  3021 tablet_replica.cc:333] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.556102  3021 raft_consensus.cc:2243] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.556753  3021 raft_consensus.cc:2272] T f748295a5651478fad54cf62835b6d71 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.559839  3021 tablet_replica.cc:333] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.560668  3021 raft_consensus.cc:2243] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.561822  3021 raft_consensus.cc:2272] T 4aaa30e70122417dbf41d98488d2528e P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.564195  3021 tablet_replica.cc:333] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.564910  3021 raft_consensus.cc:2243] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.565881  3021 raft_consensus.cc:2272] T 96d8d45c6521413ab41e0897d088fe75 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.568928  3021 tablet_replica.cc:333] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.569754  3021 raft_consensus.cc:2243] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.570401  3021 raft_consensus.cc:2272] T 4b3893d7c0374a12933e175ada5b42de P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.573418  3021 tablet_replica.cc:333] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.574290  3021 raft_consensus.cc:2243] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.574875  3021 raft_consensus.cc:2272] T b9f32f35d73c4f83a13beccdbaac3a81 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.577329  3021 tablet_replica.cc:333] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.577939  3021 raft_consensus.cc:2243] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.578457  3021 raft_consensus.cc:2272] T aa6f3a61bd92477db40d5dcb52285b38 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.580775  3021 tablet_replica.cc:333] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.581398  3021 raft_consensus.cc:2243] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.581931  3021 raft_consensus.cc:2272] T fe570064606c49e8ae9eeeacac9a6920 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.584101  3021 tablet_replica.cc:333] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.584793  3021 raft_consensus.cc:2243] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.585150 12883 raft_consensus.cc:493] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b102b83096e4830a35a9006a2a2a0f0)
I20260709 13:22:52.585479  3021 raft_consensus.cc:2272] T cd44a633335a4f7f94505d7f37d1dc5c P 01c914cf532f4dc19c1bab3514524ac2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.585968 12883 raft_consensus.cc:515] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01c914cf532f4dc19c1bab3514524ac2" member_type: VOTER last_known_addr { host: "127.2.243.68" port: 39869 } } peers { permanent_uuid: "36c7a0f1511c4b18ad59155bbeb0c1ff" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 42405 } } peers { permanent_uuid: "4b102b83096e4830a35a9006a2a2a0f0" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 40717 } }
I20260709 13:22:52.588486 12883 leader_election.cc:290] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405), 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717)
I20260709 13:22:52.588615  3021 tablet_replica.cc:333] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.589668  3021 raft_consensus.cc:2243] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.590775  3021 raft_consensus.cc:2272] T 486dc6cde7764b78aa07d583ef365e55 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:52.593034 11776 leader_election.cc:336] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36c7a0f1511c4b18ad59155bbeb0c1ff (127.2.243.65:42405): Network error: Client connection negotiation failed: client connection to 127.2.243.65:42405: connect: Connection refused (error 111)
W20260709 13:22:52.594008 11776 leader_election.cc:336] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b102b83096e4830a35a9006a2a2a0f0 (127.2.243.66:40717): Network error: Client connection negotiation failed: client connection to 127.2.243.66:40717: connect: Connection refused (error 111)
I20260709 13:22:52.594460  3021 tablet_replica.cc:333] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.594503 11776 leader_election.cc:304] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01c914cf532f4dc19c1bab3514524ac2; no voters: 36c7a0f1511c4b18ad59155bbeb0c1ff, 4b102b83096e4830a35a9006a2a2a0f0
I20260709 13:22:52.595553  3021 raft_consensus.cc:2243] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.595669 12883 raft_consensus.cc:2749] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:52.596228  3021 raft_consensus.cc:2272] T 8881af9c27854058bd198d8a5bd2b1e3 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.599107  3021 tablet_replica.cc:333] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.599803  3021 raft_consensus.cc:2243] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.600852  3021 raft_consensus.cc:2272] T 458610efe1f94a709b0a77f938cc539b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.603180  3021 tablet_replica.cc:333] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.603884  3021 raft_consensus.cc:2243] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.604889  3021 raft_consensus.cc:2272] T 8d2e77a7d8e74543bab76ac11418f6d3 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.607343  3021 tablet_replica.cc:333] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.607985  3021 raft_consensus.cc:2243] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.608539  3021 raft_consensus.cc:2272] T eea5a35807cf47a18b69b5d51e415e5b P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.610826  3021 tablet_replica.cc:333] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.611440  3021 raft_consensus.cc:2243] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.611955  3021 raft_consensus.cc:2272] T f06a77efc3a8409b991b0bb8bb957517 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.614214  3021 tablet_replica.cc:333] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.614853  3021 raft_consensus.cc:2243] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.615343  3021 raft_consensus.cc:2272] T 2d9e763e4e8f45e0a5d8a830dd1f93b5 P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.617687  3021 tablet_replica.cc:333] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.618364  3021 raft_consensus.cc:2243] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.619004  3021 raft_consensus.cc:2272] T 78a9c38790c24ddebcc9556c8e2356ea P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.622020  3021 tablet_replica.cc:333] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.622699  3021 raft_consensus.cc:2243] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.623229  3021 raft_consensus.cc:2272] T bb2b87661f184408bcc049ddd64425c5 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.625833  3021 tablet_replica.cc:333] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.626458  3021 raft_consensus.cc:2243] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.627012  3021 raft_consensus.cc:2272] T ba936b69ea784d3aa5af76a721bdb29d P 01c914cf532f4dc19c1bab3514524ac2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.629361  3021 tablet_replica.cc:333] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.629942  3021 raft_consensus.cc:2243] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.630425  3021 raft_consensus.cc:2272] T 3f60ac2c79f045c18e7c1eed3af5f12b P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.632825  3021 tablet_replica.cc:333] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.633389  3021 raft_consensus.cc:2243] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.633863  3021 raft_consensus.cc:2272] T b066170aeea34d52be3000a5f02c1804 P 01c914cf532f4dc19c1bab3514524ac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.636125  3021 tablet_replica.cc:333] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2: stopping tablet replica
I20260709 13:22:52.636802  3021 raft_consensus.cc:2243] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:52.637342  3021 raft_consensus.cc:2272] T 42d882e262e64f0fb7fc4614a9475b64 P 01c914cf532f4dc19c1bab3514524ac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.716326  3021 tablet_server.cc:196] TabletServer@127.2.243.68:0 shutdown complete.
I20260709 13:22:52.805467  3021 master.cc:562] Master@127.2.243.126:42969 shutting down...
I20260709 13:22:52.835783  3021 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:52.836656  3021 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:52.836977  3021 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8651d67893c54c26985e84a11f067948: stopping tablet replica
I20260709 13:22:52.862884  3021 master.cc:584] Master@127.2.243.126:42969 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (38616 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:22:52.973403  3021 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.243.126:37913
I20260709 13:22:52.974917  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:52.982275 12896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:52.983018 12897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:52.983846 12899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:52.984848  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:52.986946  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:52.987211  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:52.987440  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603372987420 us; error 0 us; skew 500 ppm
I20260709 13:22:52.988097  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:52.991575  3021 webserver.cc:533] Webserver started at http://127.2.243.126:43011/ using document root <none> and password file <none>
I20260709 13:22:52.992198  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:52.992712  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:52.993057  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:52.994660  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/master-0-root/instance:
uuid: "489a8fffc860400caecb8ca23f74abb3"
format_stamp: "Formatted at 2026-07-09 13:22:52 on dist-test-slave-ftjc"
I20260709 13:22:53.000269  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:22:53.005139 12904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.006068  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:53.006412  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/master-0-root
uuid: "489a8fffc860400caecb8ca23f74abb3"
format_stamp: "Formatted at 2026-07-09 13:22:52 on dist-test-slave-ftjc"
I20260709 13:22:53.006788  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:53.029448  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:53.031090  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:53.083670  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.126:37913
I20260709 13:22:53.083751 12955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.126:37913 every 8 connection(s)
I20260709 13:22:53.090607 12956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.105931 12956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3: Bootstrap starting.
I20260709 13:22:53.112710 12956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.118599 12956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3: No bootstrap required, opened a new log
I20260709 13:22:53.121413 12956 raft_consensus.cc:359] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489a8fffc860400caecb8ca23f74abb3" member_type: VOTER }
I20260709 13:22:53.121883 12956 raft_consensus.cc:385] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.122071 12956 raft_consensus.cc:740] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 489a8fffc860400caecb8ca23f74abb3, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.122642 12956 consensus_queue.cc:260] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489a8fffc860400caecb8ca23f74abb3" member_type: VOTER }
I20260709 13:22:53.123112 12956 raft_consensus.cc:399] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:53.123319 12956 raft_consensus.cc:493] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:53.123546 12956 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.129807 12956 raft_consensus.cc:515] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489a8fffc860400caecb8ca23f74abb3" member_type: VOTER }
I20260709 13:22:53.130355 12956 leader_election.cc:304] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 489a8fffc860400caecb8ca23f74abb3; no voters: 
I20260709 13:22:53.132326 12956 leader_election.cc:290] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:53.132903 12959 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.134872 12959 raft_consensus.cc:697] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 1 LEADER]: Becoming Leader. State: Replica: 489a8fffc860400caecb8ca23f74abb3, State: Running, Role: LEADER
I20260709 13:22:53.135867 12959 consensus_queue.cc:237] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489a8fffc860400caecb8ca23f74abb3" member_type: VOTER }
I20260709 13:22:53.136698 12956 sys_catalog.cc:565] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:53.141367 12960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "489a8fffc860400caecb8ca23f74abb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489a8fffc860400caecb8ca23f74abb3" member_type: VOTER } }
I20260709 13:22:53.142231 12960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:53.143311 12961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 489a8fffc860400caecb8ca23f74abb3. Latest consensus state: current_term: 1 leader_uuid: "489a8fffc860400caecb8ca23f74abb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489a8fffc860400caecb8ca23f74abb3" member_type: VOTER } }
I20260709 13:22:53.144059 12961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:53.151427 12967 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:53.159152 12967 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:53.160454  3021 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:53.171615 12967 catalog_manager.cc:1383] Generated new cluster ID: ff458f140f7e45b0a6ecf5f0aa6144fa
I20260709 13:22:53.172024 12967 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:53.200724 12967 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:53.202312 12967 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:53.221673 12967 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3: Generated new TSK 0
I20260709 13:22:53.222445 12967 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:53.229172  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:53.237982 12977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:53.238790 12978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:53.243820 12980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:53.247525  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:53.249246  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:53.249492  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:53.249732  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603373249712 us; error 0 us; skew 500 ppm
I20260709 13:22:53.250425  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:53.254153  3021 webserver.cc:533] Webserver started at http://127.2.243.65:34583/ using document root <none> and password file <none>
I20260709 13:22:53.254801  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:53.255059  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:53.255388  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:53.256978  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root/instance:
uuid: "44962c0585994ead93c55cac04f60f1b"
format_stamp: "Formatted at 2026-07-09 13:22:53 on dist-test-slave-ftjc"
I20260709 13:22:53.263094  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:53.267864 12985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.269061  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:53.269431  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "44962c0585994ead93c55cac04f60f1b"
format_stamp: "Formatted at 2026-07-09 13:22:53 on dist-test-slave-ftjc"
I20260709 13:22:53.269747  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:53.281219  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:53.282732  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:53.284650  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:53.287853  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:53.288077  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.288462  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:53.288890  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.345336  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:44413
I20260709 13:22:53.345461 13047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:44413 every 8 connection(s)
I20260709 13:22:53.351624  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:53.361249 13052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:53.362488 13053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:53.366351 13055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:53.366823  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:53.368551  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:53.368878  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:53.369020  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603373369008 us; error 0 us; skew 500 ppm
I20260709 13:22:53.369714  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:53.373263  3021 webserver.cc:533] Webserver started at http://127.2.243.66:45345/ using document root <none> and password file <none>
I20260709 13:22:53.373958  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:53.374256 13048 heartbeater.cc:344] Connected to a master server at 127.2.243.126:37913
I20260709 13:22:53.374262  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:53.374879 13048 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:53.375033  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:53.375854 13048 heartbeater.cc:507] Master 127.2.243.126:37913 requested a full tablet report, sending...
I20260709 13:22:53.376669  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-1-root/instance:
uuid: "3d1be445e2734b49975a715ceae40ca8"
format_stamp: "Formatted at 2026-07-09 13:22:53 on dist-test-slave-ftjc"
I20260709 13:22:53.378575 12921 ts_manager.cc:194] Registered new tserver with Master: 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413)
I20260709 13:22:53.380808 12921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39796
I20260709 13:22:53.383145  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:53.388622 13060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.389694  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:53.390096  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-1-root
uuid: "3d1be445e2734b49975a715ceae40ca8"
format_stamp: "Formatted at 2026-07-09 13:22:53 on dist-test-slave-ftjc"
I20260709 13:22:53.390512  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:53.419873  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:53.421387  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:53.423314  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:53.426113  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:53.426409  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.426698  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:53.426889  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.478888  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.66:46477
I20260709 13:22:53.479010 13122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.66:46477 every 8 connection(s)
I20260709 13:22:53.484561  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:53.493163 13126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:53.495987 13127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:53.498404 13129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:53.499583  3021 server_base.cc:1061] running on GCE node
I20260709 13:22:53.501026 13123 heartbeater.cc:344] Connected to a master server at 127.2.243.126:37913
I20260709 13:22:53.501022  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:53.501598  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:53.501608 13123 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:53.501883  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603373501860 us; error 0 us; skew 500 ppm
I20260709 13:22:53.502727  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:53.502776 13123 heartbeater.cc:507] Master 127.2.243.126:37913 requested a full tablet report, sending...
I20260709 13:22:53.506170 12921 ts_manager.cc:194] Registered new tserver with Master: 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:53.506433  3021 webserver.cc:533] Webserver started at http://127.2.243.67:40339/ using document root <none> and password file <none>
I20260709 13:22:53.507208  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:53.507601  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:53.508157  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:53.508855 12921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39798
I20260709 13:22:53.510093  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-2-root/instance:
uuid: "7784733ded584427a5e68711de77c761"
format_stamp: "Formatted at 2026-07-09 13:22:53 on dist-test-slave-ftjc"
I20260709 13:22:53.516762  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:22:53.521328 13134 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.522387  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:53.522851  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-2-root
uuid: "7784733ded584427a5e68711de77c761"
format_stamp: "Formatted at 2026-07-09 13:22:53 on dist-test-slave-ftjc"
I20260709 13:22:53.523211  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:53.534425  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:53.535928  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:53.537894  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:53.541003  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:53.541234  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.541590  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:53.541759  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:53.597816  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.67:43801
I20260709 13:22:53.598006 13196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.67:43801 every 8 connection(s)
I20260709 13:22:53.616206 13197 heartbeater.cc:344] Connected to a master server at 127.2.243.126:37913
I20260709 13:22:53.616850 13197 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:53.617813 13197 heartbeater.cc:507] Master 127.2.243.126:37913 requested a full tablet report, sending...
I20260709 13:22:53.620558 12921 ts_manager.cc:194] Registered new tserver with Master: 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:53.621121  3021 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019418027s
I20260709 13:22:53.622323 12921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39810
I20260709 13:22:53.658071 12921 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39818:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:53.662501 12921 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:53.750684 13162 tablet_service.cc:1511] Processing CreateTablet for tablet 15b4d0a9466a40ad9b60ca42abc1885b (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:53.752499 13162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b4d0a9466a40ad9b60ca42abc1885b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.771106 13013 tablet_service.cc:1511] Processing CreateTablet for tablet 15b4d0a9466a40ad9b60ca42abc1885b (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:53.772929 13013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b4d0a9466a40ad9b60ca42abc1885b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.773274 13161 tablet_service.cc:1511] Processing CreateTablet for tablet eea748194cb645219143f4cc1ffdecc3 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:53.774314 13012 tablet_service.cc:1511] Processing CreateTablet for tablet eea748194cb645219143f4cc1ffdecc3 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:53.775064 13161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea748194cb645219143f4cc1ffdecc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.775843 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea748194cb645219143f4cc1ffdecc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.772444 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 74c2388838954694947aaa08e4635327 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:53.778312 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c2388838954694947aaa08e4635327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.791195 13160 tablet_service.cc:1511] Processing CreateTablet for tablet 74c2388838954694947aaa08e4635327 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:53.793016 13010 tablet_service.cc:1511] Processing CreateTablet for tablet b259b4adcaec4a43aa1fe387952a26d4 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:53.794775 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b259b4adcaec4a43aa1fe387952a26d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.796646 13088 tablet_service.cc:1511] Processing CreateTablet for tablet 15b4d0a9466a40ad9b60ca42abc1885b (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:53.798667 13088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b4d0a9466a40ad9b60ca42abc1885b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.802206 13087 tablet_service.cc:1511] Processing CreateTablet for tablet eea748194cb645219143f4cc1ffdecc3 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:53.806305 13086 tablet_service.cc:1511] Processing CreateTablet for tablet 74c2388838954694947aaa08e4635327 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:53.813052 13213 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:53.793100 13160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c2388838954694947aaa08e4635327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.820904 13087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea748194cb645219143f4cc1ffdecc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.825038 13086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c2388838954694947aaa08e4635327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.825067 13213 tablet_bootstrap.cc:654] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.834890 13213 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:53.835551 13213 ts_tablet_manager.cc:1403] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.006s
I20260709 13:22:53.839684 13213 raft_consensus.cc:359] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:53.840636 13213 raft_consensus.cc:385] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.840994 13213 raft_consensus.cc:740] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.841908 13213 consensus_queue.cc:260] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:53.854069 13197 heartbeater.cc:499] Master 127.2.243.126:37913 was elected leader, sending a full tablet report...
I20260709 13:22:53.854732 13213 ts_tablet_manager.cc:1434] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.006s
I20260709 13:22:53.856168 13213 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:53.858747 13085 tablet_service.cc:1511] Processing CreateTablet for tablet b259b4adcaec4a43aa1fe387952a26d4 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:53.861052 13161 tablet_service.cc:1511] Processing CreateTablet for tablet b259b4adcaec4a43aa1fe387952a26d4 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:53.862838 13161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b259b4adcaec4a43aa1fe387952a26d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.861523 13085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b259b4adcaec4a43aa1fe387952a26d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.875046 13213 tablet_bootstrap.cc:654] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.900792 13215 raft_consensus.cc:493] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.901811 13215 raft_consensus.cc:515] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:53.933532 13009 tablet_service.cc:1511] Processing CreateTablet for tablet f257f2b097f34fdf93b4182b1e537290 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:53.935922 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f257f2b097f34fdf93b4182b1e537290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.945222 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
W20260709 13:22:53.948328 13136 leader_election.cc:343] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.955519 13084 tablet_service.cc:1511] Processing CreateTablet for tablet f257f2b097f34fdf93b4182b1e537290 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:53.958639 13084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f257f2b097f34fdf93b4182b1e537290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.963367 13213 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:53.964643 13213 ts_tablet_manager.cc:1403] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.109s	user 0.020s	sys 0.026s
I20260709 13:22:53.965342 13212 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:53.968719 13162 tablet_service.cc:1511] Processing CreateTablet for tablet f257f2b097f34fdf93b4182b1e537290 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:53.970548 13162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f257f2b097f34fdf93b4182b1e537290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.941906 13215 leader_election.cc:290] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
W20260709 13:22:53.975062 13137 leader_election.cc:343] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477): Not found: Tablet not found: eea748194cb645219143f4cc1ffdecc3
I20260709 13:22:53.975708 13137 leader_election.cc:304] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7784733ded584427a5e68711de77c761; no voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:53.992295 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 682312dcb3d2421181b1cf49f05b67ad (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:53.992974 13215 raft_consensus.cc:2749] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.994028 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682312dcb3d2421181b1cf49f05b67ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:53.998961 13083 tablet_service.cc:1511] Processing CreateTablet for tablet 682312dcb3d2421181b1cf49f05b67ad (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:54.002135 13083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682312dcb3d2421181b1cf49f05b67ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.007416 13161 tablet_service.cc:1511] Processing CreateTablet for tablet 682312dcb3d2421181b1cf49f05b67ad (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:53.985249 13213 raft_consensus.cc:359] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.009423 13161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682312dcb3d2421181b1cf49f05b67ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.016072 13212 tablet_bootstrap.cc:654] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.023296 13010 tablet_service.cc:1511] Processing CreateTablet for tablet ee840f3cb2eb4b4d81aab41314fa9879 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:54.024992 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee840f3cb2eb4b4d81aab41314fa9879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.030606 13217 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.033162 13088 tablet_service.cc:1511] Processing CreateTablet for tablet ee840f3cb2eb4b4d81aab41314fa9879 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:54.034981 13088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee840f3cb2eb4b4d81aab41314fa9879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.009438 13213 raft_consensus.cc:385] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.038919 13213 raft_consensus.cc:740] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.039251 13217 tablet_bootstrap.cc:654] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.048715 13213 consensus_queue.cc:260] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.055074 13162 tablet_service.cc:1511] Processing CreateTablet for tablet ee840f3cb2eb4b4d81aab41314fa9879 (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:54.055965 13212 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.056717 13212 ts_tablet_manager.cc:1403] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.004s
I20260709 13:22:54.056725 13162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee840f3cb2eb4b4d81aab41314fa9879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.059229 13010 tablet_service.cc:1511] Processing CreateTablet for tablet dbb24f1e43d24411982f6264e685610a (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:54.060837 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb24f1e43d24411982f6264e685610a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.060307 13212 raft_consensus.cc:359] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.061369 13212 raft_consensus.cc:385] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.061743 13212 raft_consensus.cc:740] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.062619 13212 consensus_queue.cc:260] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.069218 13085 tablet_service.cc:1511] Processing CreateTablet for tablet dbb24f1e43d24411982f6264e685610a (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:54.071040 13085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb24f1e43d24411982f6264e685610a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.074651 13213 ts_tablet_manager.cc:1434] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.002s
I20260709 13:22:54.074812 13048 heartbeater.cc:499] Master 127.2.243.126:37913 was elected leader, sending a full tablet report...
I20260709 13:22:54.085330 13212 ts_tablet_manager.cc:1434] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.005s
I20260709 13:22:54.086675 13212 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:54.089422 13160 tablet_service.cc:1511] Processing CreateTablet for tablet dbb24f1e43d24411982f6264e685610a (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:54.092806 13160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb24f1e43d24411982f6264e685610a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.093250 13213 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:54.097420 13217 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.098207 13217 ts_tablet_manager.cc:1403] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.011s
W20260709 13:22:54.100831 13049 tablet.cc:2406] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:54.114645 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab0530cb9a547779aa677cf0851c6df (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:54.122328 13083 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab0530cb9a547779aa677cf0851c6df (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:54.128518 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab0530cb9a547779aa677cf0851c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.128528 13083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab0530cb9a547779aa677cf0851c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.130710 13212 tablet_bootstrap.cc:654] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.132925 13213 tablet_bootstrap.cc:654] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.104442 13217 raft_consensus.cc:359] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.133455 13217 raft_consensus.cc:385] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.133814 13217 raft_consensus.cc:740] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.134737 13217 consensus_queue.cc:260] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.137850 13159 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab0530cb9a547779aa677cf0851c6df (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:54.139626 13159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab0530cb9a547779aa677cf0851c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.150664 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 876af370ba314059b0c028f1fa4ad08a (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:54.152674 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876af370ba314059b0c028f1fa4ad08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.152186 13085 tablet_service.cc:1511] Processing CreateTablet for tablet 876af370ba314059b0c028f1fa4ad08a (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
W20260709 13:22:54.154923 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:54.155117 13085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876af370ba314059b0c028f1fa4ad08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.154711 13161 tablet_service.cc:1511] Processing CreateTablet for tablet 876af370ba314059b0c028f1fa4ad08a (DEFAULT_TABLE table=test-workload [id=ecf5b740c43144e2bc3a4c073c84e43e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:54.156574 13161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876af370ba314059b0c028f1fa4ad08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:54.178067 13123 heartbeater.cc:499] Master 127.2.243.126:37913 was elected leader, sending a full tablet report...
I20260709 13:22:54.183672 13213 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:54.184494 13213 ts_tablet_manager.cc:1403] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.000s
I20260709 13:22:54.189769 13217 ts_tablet_manager.cc:1434] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.091s	user 0.012s	sys 0.010s
I20260709 13:22:54.191203 13217 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.196756 13213 raft_consensus.cc:359] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.197708 13213 raft_consensus.cc:385] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.198025 13213 raft_consensus.cc:740] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.198776 13213 consensus_queue.cc:260] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.201140 13213 ts_tablet_manager.cc:1434] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:22:54.202332 13213 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:54.210848 13212 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.211833 13212 ts_tablet_manager.cc:1403] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.125s	user 0.023s	sys 0.004s
I20260709 13:22:54.212065 13217 tablet_bootstrap.cc:654] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.214550 13213 tablet_bootstrap.cc:654] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.215895 13212 raft_consensus.cc:359] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.216935 13212 raft_consensus.cc:385] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.217303 13212 raft_consensus.cc:740] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.218497 13212 consensus_queue.cc:260] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.228225 13217 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.229180 13217 ts_tablet_manager.cc:1403] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 13:22:54.232999 13217 raft_consensus.cc:359] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.233510 13212 ts_tablet_manager.cc:1434] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.005s
I20260709 13:22:54.234714 13217 raft_consensus.cc:385] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.235113 13217 raft_consensus.cc:740] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.236027 13217 consensus_queue.cc:260] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.237228 13213 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:54.237883 13212 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:54.238853 13217 ts_tablet_manager.cc:1434] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:54.240377 13217 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.246635 13212 tablet_bootstrap.cc:654] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.247639 13217 tablet_bootstrap.cc:654] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.237905 13213 ts_tablet_manager.cc:1403] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.010s
I20260709 13:22:54.252439 13213 raft_consensus.cc:359] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.253288 13213 raft_consensus.cc:385] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.253626 13213 raft_consensus.cc:740] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.253676 13217 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.254388 13217 ts_tablet_manager.cc:1403] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:22:54.254551 13213 consensus_queue.cc:260] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.257361 13213 ts_tablet_manager.cc:1434] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:54.258152 13217 raft_consensus.cc:359] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.259063 13217 raft_consensus.cc:385] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.259405 13217 raft_consensus.cc:740] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.259742 13213 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:54.260406 13217 consensus_queue.cc:260] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.263410 13212 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.263567 13217 ts_tablet_manager.cc:1434] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:54.264216 13212 ts_tablet_manager.cc:1403] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.001s
I20260709 13:22:54.265045 13217 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.268028 13212 raft_consensus.cc:359] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.269039 13212 raft_consensus.cc:385] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.269425 13212 raft_consensus.cc:740] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.269631 13213 tablet_bootstrap.cc:654] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.270645 13212 consensus_queue.cc:260] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.275151 13217 tablet_bootstrap.cc:654] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.286876 13212 ts_tablet_manager.cc:1434] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:22:54.288475 13212 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:54.289036 13217 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.289666 13217 ts_tablet_manager.cc:1403] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.010s
I20260709 13:22:54.290361 13213 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:54.290980 13213 ts_tablet_manager.cc:1403] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.017s
I20260709 13:22:54.293720 13217 raft_consensus.cc:359] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.294798 13217 raft_consensus.cc:385] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.294518 13213 raft_consensus.cc:359] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.295189 13217 raft_consensus.cc:740] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.295382 13213 raft_consensus.cc:385] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.295773 13213 raft_consensus.cc:740] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.296381 13217 consensus_queue.cc:260] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.296677 13213 consensus_queue.cc:260] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.298178 13212 tablet_bootstrap.cc:654] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.299186 13217 ts_tablet_manager.cc:1434] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:54.300565 13217 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.301964 13213 ts_tablet_manager.cc:1434] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:54.303282 13213 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:54.308238 13215 raft_consensus.cc:493] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.309034 13215 raft_consensus.cc:515] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.311033 13213 tablet_bootstrap.cc:654] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.311049 13217 tablet_bootstrap.cc:654] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.312829 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c2388838954694947aaa08e4635327" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
W20260709 13:22:54.314966 13136 leader_election.cc:343] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.317860 13098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c2388838954694947aaa08e4635327" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:54.318815 13098 raft_consensus.cc:2468] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 0.
I20260709 13:22:54.320856 13137 leader_election.cc:304] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:54.324498 13215 leader_election.cc:290] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:54.325498 13215 raft_consensus.cc:2804] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.328791 13215 raft_consensus.cc:493] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.329315 13215 raft_consensus.cc:3060] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.336632 13222 raft_consensus.cc:493] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.337522 13222 raft_consensus.cc:515] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.340200 13217 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.341007 13213 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:54.341149 13217 ts_tablet_manager.cc:1403] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.017s
I20260709 13:22:54.342042 13213 ts_tablet_manager.cc:1403] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.005s
I20260709 13:22:54.347373 13213 raft_consensus.cc:359] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.349159 13222 leader_election.cc:290] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:54.349251 13213 raft_consensus.cc:385] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.350611 13213 raft_consensus.cc:740] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.351711 13213 consensus_queue.cc:260] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.353120 13212 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.353730 13212 ts_tablet_manager.cc:1403] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.037s
I20260709 13:22:54.351919 13217 raft_consensus.cc:359] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.357286 13212 raft_consensus.cc:359] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.358680 13212 raft_consensus.cc:385] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.359205 13212 raft_consensus.cc:740] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.359758 13213 ts_tablet_manager.cc:1434] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:22:54.361222 13213 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:54.360528 13212 consensus_queue.cc:260] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.363713 13212 ts_tablet_manager.cc:1434] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:54.364271 13217 raft_consensus.cc:385] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.366294 13217 raft_consensus.cc:740] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.367409 13212 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:54.368682 13233 raft_consensus.cc:493] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.369326 13233 raft_consensus.cc:515] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.372210 13233 leader_election.cc:290] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413)
I20260709 13:22:54.367504 13217 consensus_queue.cc:260] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.375578 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15b4d0a9466a40ad9b60ca42abc1885b" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
I20260709 13:22:54.366971 13215 raft_consensus.cc:515] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.389534 13023 raft_consensus.cc:2468] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 0.
I20260709 13:22:54.390362 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b259b4adcaec4a43aa1fe387952a26d4" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:54.391064 13220 raft_consensus.cc:493] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.391363 13217 ts_tablet_manager.cc:1434] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 13:22:54.391677 13172 raft_consensus.cc:2468] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 0.
I20260709 13:22:54.393034 13217 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.377537 13212 tablet_bootstrap.cc:654] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.396000 13215 leader_election.cc:290] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:54.380466 13213 tablet_bootstrap.cc:654] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.392681 13136 leader_election.cc:304] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:54.396649 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c2388838954694947aaa08e4635327" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:54.397521 13097 raft_consensus.cc:3060] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.398559 13215 raft_consensus.cc:2804] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.399084 13215 raft_consensus.cc:493] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.399514 13215 raft_consensus.cc:3060] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.401371 13022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c2388838954694947aaa08e4635327" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:22:54.402191 13022 raft_consensus.cc:3060] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.377993 13098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15b4d0a9466a40ad9b60ca42abc1885b" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:54.404729 13098 raft_consensus.cc:2468] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 0.
I20260709 13:22:54.405429 13233 raft_consensus.cc:493] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.406035 13233 raft_consensus.cc:515] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.409922 13233 leader_election.cc:290] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:54.412660 13215 raft_consensus.cc:515] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.413594 13021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
W20260709 13:22:54.414969 13136 leader_election.cc:343] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.415382 13063 leader_election.cc:304] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:54.416429 13222 raft_consensus.cc:2804] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.416842 13222 raft_consensus.cc:493] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.417232 13222 raft_consensus.cc:3060] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.417128 13021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15b4d0a9466a40ad9b60ca42abc1885b" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:22:54.417596 13215 leader_election.cc:290] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413)
I20260709 13:22:54.418006 13021 raft_consensus.cc:3060] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.419667 13217 tablet_bootstrap.cc:654] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.391748 13220 raft_consensus.cc:515] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.428269 13212 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.429180 13212 ts_tablet_manager.cc:1403] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.009s
I20260709 13:22:54.432900 13212 raft_consensus.cc:359] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.433840 13212 raft_consensus.cc:385] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.434453 13212 raft_consensus.cc:740] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.435454 13212 consensus_queue.cc:260] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.436905 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b259b4adcaec4a43aa1fe387952a26d4" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
I20260709 13:22:54.437947 13023 raft_consensus.cc:2468] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 0.
I20260709 13:22:54.441218 13098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:54.445355 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15b4d0a9466a40ad9b60ca42abc1885b" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:54.446904 13096 raft_consensus.cc:3060] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:54.463701 13137 leader_election.cc:343] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.464747 13137 leader_election.cc:304] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7784733ded584427a5e68711de77c761; no voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:54.466218 13215 raft_consensus.cc:2749] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.443768 13220 leader_election.cc:290] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:54.474413 13215 raft_consensus.cc:493] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.475306 13215 raft_consensus.cc:515] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.480577 13215 leader_election.cc:290] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:54.483517 13098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:54.489547 13098 raft_consensus.cc:2468] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 0.
I20260709 13:22:54.491607 13137 leader_election.cc:304] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:54.493163 13215 raft_consensus.cc:2804] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.493693 13215 raft_consensus.cc:493] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.494150 13215 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.484551 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
W20260709 13:22:54.507056 13136 leader_election.cc:343] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.511466 13022 raft_consensus.cc:2468] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 1.
I20260709 13:22:54.548501 13242 raft_consensus.cc:493] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.549571 13242 raft_consensus.cc:515] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.567004 13136 leader_election.cc:304] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:54.537873 13222 raft_consensus.cc:515] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.555747 13215 raft_consensus.cc:515] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.572440 13233 raft_consensus.cc:2804] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.578331 13212 ts_tablet_manager.cc:1434] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.149s	user 0.056s	sys 0.072s
I20260709 13:22:54.579761 13212 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:54.581223 13022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b259b4adcaec4a43aa1fe387952a26d4" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:22:54.582038 13022 raft_consensus.cc:3060] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.587828 13212 tablet_bootstrap.cc:654] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.588455 13021 raft_consensus.cc:2468] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 1.
I20260709 13:22:54.588893 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:54.589680 13172 raft_consensus.cc:2468] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 0.
I20260709 13:22:54.590008 13136 leader_election.cc:304] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:54.595273 13213 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:54.595966 13213 ts_tablet_manager.cc:1403] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.235s	user 0.038s	sys 0.109s
I20260709 13:22:54.571861 13097 raft_consensus.cc:2468] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 1.
I20260709 13:22:54.602880 13217 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.604137 13217 ts_tablet_manager.cc:1403] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.211s	user 0.077s	sys 0.088s
I20260709 13:22:54.603142 12988 leader_election.cc:304] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:54.607666 13241 raft_consensus.cc:2804] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.608314 13241 raft_consensus.cc:493] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.592453 13096 raft_consensus.cc:2468] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 1.
I20260709 13:22:54.609975 13241 raft_consensus.cc:3060] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.617223 13217 raft_consensus.cc:359] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.618467 13217 raft_consensus.cc:385] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.618844 13217 raft_consensus.cc:740] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.620085 13217 consensus_queue.cc:260] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.626323 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:54.629768 13096 raft_consensus.cc:2468] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 0.
I20260709 13:22:54.630445 13021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
I20260709 13:22:54.631142 13242 leader_election.cc:290] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:54.628818 13222 leader_election.cc:290] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:54.635833 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b259b4adcaec4a43aa1fe387952a26d4" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:54.602869 13213 raft_consensus.cc:359] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.635511 13233 raft_consensus.cc:697] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:22:54.638224 13172 raft_consensus.cc:3060] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.641155 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:54.641031 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:54.641937 13096 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.642076 13171 raft_consensus.cc:2468] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 0.
W20260709 13:22:54.637697 13136 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.65:44413, user_credentials={real_user=slave}} blocked reactor thread for 47803.2us
I20260709 13:22:54.645900 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b"
W20260709 13:22:54.648109 13136 leader_election.cc:343] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.634900 13022 raft_consensus.cc:2468] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
I20260709 13:22:54.639580 13213 raft_consensus.cc:385] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.651031 13213 raft_consensus.cc:740] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.651628 13096 raft_consensus.cc:2468] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 1.
I20260709 13:22:54.649066 13063 leader_election.cc:304] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:54.652297 13241 raft_consensus.cc:515] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.650498 13062 leader_election.cc:304] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:22:54.652925 13233 consensus_queue.cc:237] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.653709 13021 raft_consensus.cc:2393] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d1be445e2734b49975a715ceae40ca8 in current term 1: Already voted for candidate 44962c0585994ead93c55cac04f60f1b in this term.
I20260709 13:22:54.654044 13222 raft_consensus.cc:2804] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.653250 13213 consensus_queue.cc:260] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.654534 13222 raft_consensus.cc:493] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.655328 13242 raft_consensus.cc:2804] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.657881 13172 raft_consensus.cc:2468] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
I20260709 13:22:54.637822 13215 leader_election.cc:290] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:54.656215 13222 raft_consensus.cc:3060] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.650388 13217 ts_tablet_manager.cc:1434] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 13:22:54.658540 13137 leader_election.cc:304] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:54.659245 13213 ts_tablet_manager.cc:1434] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 13:22:54.659260 13212 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.650134 13245 raft_consensus.cc:2804] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.661971 13215 raft_consensus.cc:2804] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.664613 13245 raft_consensus.cc:697] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:22:54.672571 13217 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.670782 13212 ts_tablet_manager.cc:1403] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.018s
I20260709 13:22:54.665874 13245 consensus_queue.cc:237] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:22:54.673116 13241 leader_election.cc:290] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 election: Requested vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:54.710757 13242 raft_consensus.cc:697] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:22:54.712419 13242 consensus_queue.cc:237] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.711786 12921 catalog_manager.cc:5697] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:54.709520 13213 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:54.717041 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:54.716925 13215 raft_consensus.cc:697] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:22:54.722546 13172 raft_consensus.cc:3060] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.725590 13222 raft_consensus.cc:515] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.727958 13249 raft_consensus.cc:493] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.722824 13212 raft_consensus.cc:359] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.728874 13212 raft_consensus.cc:385] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.728807 13249 raft_consensus.cc:515] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.729235 13021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:22:54.730373 13021 raft_consensus.cc:2393] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d1be445e2734b49975a715ceae40ca8 in current term 1: Already voted for candidate 44962c0585994ead93c55cac04f60f1b in this term.
I20260709 13:22:54.729398 13212 raft_consensus.cc:740] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.731554 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:54.732642 13096 raft_consensus.cc:2393] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44962c0585994ead93c55cac04f60f1b in current term 1: Already voted for candidate 3d1be445e2734b49975a715ceae40ca8 in this term.
I20260709 13:22:54.732564 13212 consensus_queue.cc:260] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.732707 13249 leader_election.cc:290] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:54.733898 13021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee840f3cb2eb4b4d81aab41314fa9879" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
I20260709 13:22:54.739972 13215 consensus_queue.cc:237] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.740785 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee840f3cb2eb4b4d81aab41314fa9879" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:54.741568 13171 raft_consensus.cc:2468] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 0.
I20260709 13:22:54.738234 13021 raft_consensus.cc:2468] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 0.
I20260709 13:22:54.744809 13212 ts_tablet_manager.cc:1434] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.056s	user 0.012s	sys 0.000s
I20260709 13:22:54.746371 13212 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:54.748911 13062 leader_election.cc:304] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:22:54.750661 13249 raft_consensus.cc:2804] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.751214 13249 raft_consensus.cc:493] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.751714 13249 raft_consensus.cc:3060] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.759543 13217 tablet_bootstrap.cc:654] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.762645 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:54.763682 13213 tablet_bootstrap.cc:654] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.768851 12920 catalog_manager.cc:5697] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:54.783420 13212 tablet_bootstrap.cc:654] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.785024 13249 raft_consensus.cc:515] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.753306 13222 leader_election.cc:290] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:54.795104 13249 leader_election.cc:290] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:54.795825 13063 leader_election.cc:304] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8; no voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761
I20260709 13:22:54.797247 13021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee840f3cb2eb4b4d81aab41314fa9879" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:22:54.797919 13249 raft_consensus.cc:2749] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.798024 13021 raft_consensus.cc:3060] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.798851 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee840f3cb2eb4b4d81aab41314fa9879" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:54.799861 13171 raft_consensus.cc:3060] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.809425 13021 raft_consensus.cc:2468] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
I20260709 13:22:54.811764 13062 leader_election.cc:304] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:22:54.813110 13249 raft_consensus.cc:2804] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.813824 13249 raft_consensus.cc:697] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:22:54.815745 13212 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.815526 13249 consensus_queue.cc:237] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.816641 13212 ts_tablet_manager.cc:1403] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.014s
I20260709 13:22:54.816982 13172 raft_consensus.cc:2468] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 1.
I20260709 13:22:54.818718 12988 leader_election.cc:304] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 3d1be445e2734b49975a715ceae40ca8
I20260709 13:22:54.820618 13241 raft_consensus.cc:2804] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.821153 13213 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:54.821379 13241 raft_consensus.cc:697] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: Becoming Leader. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Running, Role: LEADER
I20260709 13:22:54.821844 13213 ts_tablet_manager.cc:1403] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.147s	user 0.030s	sys 0.013s
I20260709 13:22:54.822566 13241 consensus_queue.cc:237] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.825080 13171 raft_consensus.cc:2468] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
I20260709 13:22:54.827143 13217 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.827826 13217 ts_tablet_manager.cc:1403] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.165s	user 0.015s	sys 0.010s
I20260709 13:22:54.828320 13213 raft_consensus.cc:359] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.829609 13213 raft_consensus.cc:385] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.829952 13213 raft_consensus.cc:740] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.830976 13213 consensus_queue.cc:260] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.832095 13217 raft_consensus.cc:359] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.833461 13217 raft_consensus.cc:385] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.833844 13217 raft_consensus.cc:740] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.831480 13212 raft_consensus.cc:359] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.835620 13212 raft_consensus.cc:385] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.835057 13217 consensus_queue.cc:260] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.834528 13213 ts_tablet_manager.cc:1434] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:22:54.840225 13213 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:54.842785 13217 ts_tablet_manager.cc:1434] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 13:22:54.844127 13217 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.838800 13212 raft_consensus.cc:740] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.845867 13212 consensus_queue.cc:260] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.848793 13212 ts_tablet_manager.cc:1434] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 13:22:54.850378 13212 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:54.854074 13213 tablet_bootstrap.cc:654] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.854646 12918 catalog_manager.cc:5697] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 44962c0585994ead93c55cac04f60f1b (127.2.243.65). New cstate: current_term: 1 leader_uuid: "44962c0585994ead93c55cac04f60f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:54.861616 13217 tablet_bootstrap.cc:654] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.867120 12920 catalog_manager.cc:5697] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:54.902796 13212 tablet_bootstrap.cc:654] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.908607 13217 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.909266 13217 ts_tablet_manager.cc:1403] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.065s	user 0.031s	sys 0.022s
I20260709 13:22:54.910213 13213 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:54.911018 13213 ts_tablet_manager.cc:1403] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.036s
I20260709 13:22:54.913271 13217 raft_consensus.cc:359] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.914143 13217 raft_consensus.cc:385] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.914419 13217 raft_consensus.cc:740] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.915023 13213 raft_consensus.cc:359] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.915490 13217 consensus_queue.cc:260] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.916105 13213 raft_consensus.cc:385] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.916671 13213 raft_consensus.cc:740] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.916396 12921 catalog_manager.cc:5697] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:54.918365 13217 ts_tablet_manager.cc:1434] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:22:54.917933 13213 consensus_queue.cc:260] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.918473 12921 catalog_manager.cc:5697] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:54.919648 13217 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.921013 13213 ts_tablet_manager.cc:1434] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:22:54.922683 13213 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761: Bootstrap starting.
I20260709 13:22:54.927098 13217 tablet_bootstrap.cc:654] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.930327 13215 raft_consensus.cc:493] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.930963 13215 raft_consensus.cc:515] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.931618 13213 tablet_bootstrap.cc:654] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.936496 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:54.938776 13021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
W20260709 13:22:54.941430 13136 leader_election.cc:343] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.943485 13217 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.943709 13215 leader_election.cc:290] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:54.944152 13217 ts_tablet_manager.cc:1403] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.007s
W20260709 13:22:54.943552 13137 leader_election.cc:343] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.945245 13137 leader_election.cc:304] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7784733ded584427a5e68711de77c761; no voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:54.947265 13215 raft_consensus.cc:2749] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.947819 13217 raft_consensus.cc:359] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.949375 13217 raft_consensus.cc:385] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.949724 13217 raft_consensus.cc:740] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.950839 13217 consensus_queue.cc:260] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.954157 13217 ts_tablet_manager.cc:1434] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:22:54.955346 13217 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8: Bootstrap starting.
I20260709 13:22:54.958709 13213 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761: No bootstrap required, opened a new log
I20260709 13:22:54.960021 13213 ts_tablet_manager.cc:1403] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.021s
I20260709 13:22:54.965251 13217 tablet_bootstrap.cc:654] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.964546 13213 raft_consensus.cc:359] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.968407 13213 raft_consensus.cc:385] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.968801 13213 raft_consensus.cc:740] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.969657 13213 consensus_queue.cc:260] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.971793 13212 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.972383 13213 ts_tablet_manager.cc:1434] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:54.972510 13212 ts_tablet_manager.cc:1403] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.122s	user 0.036s	sys 0.021s
I20260709 13:22:54.976055 13212 raft_consensus.cc:359] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.977029 13212 raft_consensus.cc:385] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.977404 13212 raft_consensus.cc:740] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.978209 13212 consensus_queue.cc:260] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.980129 13217 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8: No bootstrap required, opened a new log
I20260709 13:22:54.980868 13217 ts_tablet_manager.cc:1403] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 13:22:54.981201 13212 ts_tablet_manager.cc:1434] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:54.982865 13212 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:54.984287 13217 raft_consensus.cc:359] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.985283 13217 raft_consensus.cc:385] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.985648 13217 raft_consensus.cc:740] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.986599 13217 consensus_queue.cc:260] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:54.990404 13212 tablet_bootstrap.cc:654] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.991294 13217 ts_tablet_manager.cc:1434] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:54.999188 13212 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:54.999778 13212 ts_tablet_manager.cc:1403] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:22:55.003119 13212 raft_consensus.cc:359] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.003935 13212 raft_consensus.cc:385] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.004245 13212 raft_consensus.cc:740] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.005020 13212 consensus_queue.cc:260] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.006801 13212 ts_tablet_manager.cc:1434] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:55.007732 13212 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:22:55.011087 13241 raft_consensus.cc:493] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.011765 13241 raft_consensus.cc:515] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.014504 13212 tablet_bootstrap.cc:654] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.015694 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:55.016688 13171 raft_consensus.cc:2468] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 0.
I20260709 13:22:55.015759 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:55.017546 13096 raft_consensus.cc:2468] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 0.
I20260709 13:22:55.014443 13241 leader_election.cc:290] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:55.018311 12988 leader_election.cc:304] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:55.019276 13241 raft_consensus.cc:2804] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.019693 13241 raft_consensus.cc:493] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.020051 13241 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.020925 13212 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: No bootstrap required, opened a new log
I20260709 13:22:55.021499 13212 ts_tablet_manager.cc:1403] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:22:55.024786 13212 raft_consensus.cc:359] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.025542 13212 raft_consensus.cc:385] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.025815 13212 raft_consensus.cc:740] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.026592 13212 consensus_queue.cc:260] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.029139 13212 ts_tablet_manager.cc:1434] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:22:55.029207 13241 raft_consensus.cc:515] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.031719 13241 leader_election.cc:290] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 election: Requested vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:55.033046 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:55.033057 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:55.034065 13171 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.034137 13096 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.043201 13171 raft_consensus.cc:2468] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 1.
I20260709 13:22:55.043205 13096 raft_consensus.cc:2468] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 1.
I20260709 13:22:55.045331 12988 leader_election.cc:304] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:55.046236 13241 raft_consensus.cc:2804] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.046764 13241 raft_consensus.cc:697] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: Becoming Leader. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Running, Role: LEADER
I20260709 13:22:55.047734 13241 consensus_queue.cc:237] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.056824 12918 catalog_manager.cc:5697] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 44962c0585994ead93c55cac04f60f1b (127.2.243.65). New cstate: current_term: 1 leader_uuid: "44962c0585994ead93c55cac04f60f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.083575 13215 consensus_queue.cc:1048] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.099838 13215 consensus_queue.cc:1048] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.107388 13241 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.108242 13241 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.112483 13241 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:55.112422 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:55.114095 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:55.114835 13171 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 0.
I20260709 13:22:55.114796 13096 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 0.
I20260709 13:22:55.116427 12988 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:55.117260 13241 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.117657 13241 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.118019 13241 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.128831 13241 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.130712 13241 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 election: Requested vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:55.131826 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:55.132550 13096 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.132213 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:55.133111 13171 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.139377 13171 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 1.
I20260709 13:22:55.139459 13096 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 1.
I20260709 13:22:55.140803 12988 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:55.141731 13241 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.142351 13241 raft_consensus.cc:697] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: Becoming Leader. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Running, Role: LEADER
I20260709 13:22:55.143222 13241 consensus_queue.cc:237] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.152055 12921 catalog_manager.cc:5697] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 44962c0585994ead93c55cac04f60f1b (127.2.243.65). New cstate: current_term: 1 leader_uuid: "44962c0585994ead93c55cac04f60f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.158250 13021 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:55.165911 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:55.168835 13215 consensus_queue.cc:1048] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.181777 13245 consensus_queue.cc:1048] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.186692 13241 raft_consensus.cc:493] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.187577 13249 consensus_queue.cc:1048] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.187559 13241 raft_consensus.cc:515] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.193331 13241 leader_election.cc:290] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:55.194895 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:55.195858 13097 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 0.
I20260709 13:22:55.194895 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:55.197201 13171 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 0.
I20260709 13:22:55.197563 12988 leader_election.cc:304] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:22:55.198575 13220 raft_consensus.cc:2804] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.199084 13220 raft_consensus.cc:493] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.199479 13220 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.207038 13233 consensus_queue.cc:1048] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.209797 13242 raft_consensus.cc:493] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.210491 13242 raft_consensus.cc:515] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.213002 13242 leader_election.cc:290] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:55.214380 13171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:55.215273 13171 raft_consensus.cc:2468] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 0.
I20260709 13:22:55.215444 13248 consensus_queue.cc:1048] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.217311 13063 leader_election.cc:304] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:55.223372 13220 raft_consensus.cc:515] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.224814 13022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b" is_pre_election: true
I20260709 13:22:55.225654 13022 raft_consensus.cc:2468] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 0.
I20260709 13:22:55.227443 13220 leader_election.cc:290] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 election: Requested vote from peers 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:55.229463 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:55.230409 13172 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.232111 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "44962c0585994ead93c55cac04f60f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:55.232820 13096 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.230402 13242 raft_consensus.cc:2804] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.236280 13242 raft_consensus.cc:493] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.236987 13242 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.240782 13172 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 1.
I20260709 13:22:55.245414 13233 consensus_queue.cc:1048] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.247628 13242 raft_consensus.cc:515] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.250273 13242 leader_election.cc:290] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:55.251027 13242 consensus_queue.cc:1048] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:55.251945 13096 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44962c0585994ead93c55cac04f60f1b in term 1.
I20260709 13:22:55.253043 12988 leader_election.cc:304] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:55.254135 13220 raft_consensus.cc:2804] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.254932 13220 raft_consensus.cc:697] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: Becoming Leader. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Running, Role: LEADER
I20260709 13:22:55.255900 13220 consensus_queue.cc:237] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.256471 13021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:22:55.257217 13021 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.269174 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:55.270196 13172 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.279066 13021 raft_consensus.cc:2468] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
I20260709 13:22:55.279383 13220 consensus_queue.cc:1048] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.281678 13062 leader_election.cc:304] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:22:55.282682 13248 raft_consensus.cc:2804] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.282251 12918 catalog_manager.cc:5697] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 44962c0585994ead93c55cac04f60f1b (127.2.243.65). New cstate: current_term: 1 leader_uuid: "44962c0585994ead93c55cac04f60f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.283296 13248 raft_consensus.cc:697] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:22:55.284406 13248 consensus_queue.cc:237] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:55.290360 13172 raft_consensus.cc:2468] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
I20260709 13:22:55.310922 12918 catalog_manager.cc:5697] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 1 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.314235 13249 consensus_queue.cc:1048] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.328161 13241 consensus_queue.cc:1048] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.452131 13241 consensus_queue.cc:1048] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:55.467242 13293 consensus_queue.cc:1048] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.526062 13293 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:55.539455 13241 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.554960  3021 ts_manager.cc:295] Set tserver state for 44962c0585994ead93c55cac04f60f1b to MAINTENANCE_MODE
I20260709 13:22:55.556049  3021 tablet_server.cc:179] TabletServer@127.2.243.65:0 shutting down...
W20260709 13:22:55.580725 13136 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 188 similar messages]
W20260709 13:22:55.586055 13136 consensus_peers.cc:597] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.594105  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:55.595220  3021 tablet_replica.cc:333] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.595970  3021 raft_consensus.cc:2243] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.597105  3021 raft_consensus.cc:2272] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.599898  3021 tablet_replica.cc:333] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.600672  3021 raft_consensus.cc:2243] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.601181  3021 raft_consensus.cc:2272] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.604058  3021 tablet_replica.cc:333] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.604830  3021 raft_consensus.cc:2243] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.605289  3021 raft_consensus.cc:2272] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.607499  3021 tablet_replica.cc:333] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.608191  3021 raft_consensus.cc:2243] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.608865  3021 raft_consensus.cc:2272] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.611796  3021 tablet_replica.cc:333] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.612600  3021 raft_consensus.cc:2243] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.613147  3021 raft_consensus.cc:2272] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.615890  3021 tablet_replica.cc:333] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.616672  3021 raft_consensus.cc:2243] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.617652  3021 raft_consensus.cc:2272] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.620316  3021 tablet_replica.cc:333] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.621061  3021 raft_consensus.cc:2243] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.622231  3021 raft_consensus.cc:2272] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.625528  3021 tablet_replica.cc:333] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.626323  3021 raft_consensus.cc:2243] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.627031  3021 raft_consensus.cc:2272] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:55.629892 13062 consensus_peers.cc:597] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.630635  3021 tablet_replica.cc:333] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.631264  3021 raft_consensus.cc:2243] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.632124  3021 pending_rounds.cc:70] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Trying to abort 1 pending ops.
I20260709 13:22:55.632386  3021 pending_rounds.cc:77] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639425065340928 op_type: NO_OP noop_request { }
I20260709 13:22:55.632769  3021 raft_consensus.cc:2889] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:55.633014  3021 raft_consensus.cc:2272] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.635375  3021 tablet_replica.cc:333] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: stopping tablet replica
I20260709 13:22:55.636027  3021 raft_consensus.cc:2243] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.636593  3021 raft_consensus.cc:2272] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.672820  3021 tablet_server.cc:196] TabletServer@127.2.243.65:0 shutdown complete.
W20260709 13:22:55.711441 13136 consensus_peers.cc:597] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:55.714181 13136 consensus_peers.cc:597] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.773221 13248 consensus_queue.cc:1048] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:55.774101 13062 consensus_peers.cc:597] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:55.791420 13062 consensus_peers.cc:597] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:56.167343 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:56.823720 13245 raft_consensus.cc:493] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:56.824530 13245 raft_consensus.cc:515] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:56.826769 13245 leader_election.cc:290] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:56.828147 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
W20260709 13:22:56.831482 13136 leader_election.cc:336] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:56.831984 13136 leader_election.cc:304] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7784733ded584427a5e68711de77c761; no voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:56.832810 13245 raft_consensus.cc:2749] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:56.833058 13222 raft_consensus.cc:493] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:56.833799 13222 raft_consensus.cc:515] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:56.835842 13222 leader_election.cc:290] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:56.837404 13170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:56.838191 13170 raft_consensus.cc:2468] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
I20260709 13:22:56.840010 13063 leader_election.cc:304] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
W20260709 13:22:56.840782 13062 leader_election.cc:336] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:56.840976 13222 raft_consensus.cc:2804] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:56.841624 13222 raft_consensus.cc:493] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:56.842060 13222 raft_consensus.cc:3060] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:56.850503 13222 raft_consensus.cc:515] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:56.852991 13222 leader_election.cc:290] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:56.854946 13170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea748194cb645219143f4cc1ffdecc3" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:56.855930 13170 raft_consensus.cc:3060] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:56.857817 13062 leader_election.cc:336] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:56.865466 13170 raft_consensus.cc:2468] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 2.
I20260709 13:22:56.867100 13063 leader_election.cc:304] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:56.868022 13222 raft_consensus.cc:2804] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:56.869261 13222 raft_consensus.cc:697] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:22:56.870255 13222 consensus_queue.cc:237] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:56.879230 12918 catalog_manager.cc:5697] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 1 to 2, leader changed from 44962c0585994ead93c55cac04f60f1b (127.2.243.65) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:56.964056 13245 raft_consensus.cc:493] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:56.964799 13245 raft_consensus.cc:515] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:56.966768 13245 leader_election.cc:290] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:56.968187 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
W20260709 13:22:56.971207 13136 leader_election.cc:336] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:56.971692 13136 leader_election.cc:304] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7784733ded584427a5e68711de77c761; no voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:56.972450 13222 raft_consensus.cc:493] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:56.972491 13245 raft_consensus.cc:2749] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:56.973371 13222 raft_consensus.cc:515] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:56.975389 13222 leader_election.cc:290] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:56.976739 13170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:56.977769 13170 raft_consensus.cc:2468] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
I20260709 13:22:56.979151 13063 leader_election.cc:304] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:56.980085 13222 raft_consensus.cc:2804] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:22:56.980401 13062 leader_election.cc:336] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:56.980628 13222 raft_consensus.cc:493] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:56.981119 13222 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:56.988322 13222 raft_consensus.cc:515] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:56.990746 13222 leader_election.cc:290] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:56.992305 13170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:56.993124 13170 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:56.995224 13062 leader_election.cc:336] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:57.002087 13170 raft_consensus.cc:2468] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 2.
I20260709 13:22:57.003481 13063 leader_election.cc:304] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:57.004297 13222 raft_consensus.cc:2804] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:57.005368 13222 raft_consensus.cc:697] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:22:57.006384 13222 consensus_queue.cc:237] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:57.009135 13245 raft_consensus.cc:493] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.009936 13245 raft_consensus.cc:515] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:57.012557 13245 leader_election.cc:290] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:57.015571 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:57.016397 13096 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 1.
I20260709 13:22:57.017622 13137 leader_election.cc:304] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:57.017156 12918 catalog_manager.cc:5697] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 1 to 2, leader changed from 44962c0585994ead93c55cac04f60f1b (127.2.243.65) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:57.018289 13136 leader_election.cc:336] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:57.018571 13245 raft_consensus.cc:2804] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:57.019049 13245 raft_consensus.cc:493] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.019436 13245 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:57.029804 13245 raft_consensus.cc:515] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:57.032402 13245 leader_election.cc:290] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:57.033661 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:57.034565 13096 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:57.037452 13136 leader_election.cc:336] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:57.038865 13222 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:57.039757 13222 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:57.042207 13222 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:57.042961 13096 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 2.
I20260709 13:22:57.043865 13245 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:57.044633 13245 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:57.044894 13137 leader_election.cc:304] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:57.045372 13170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761" is_pre_election: true
I20260709 13:22:57.046155 13170 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 1.
W20260709 13:22:57.047864 13062 leader_election.cc:336] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:57.047577 13245 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:57.048942 13063 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:57.049106 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:57.049978 13096 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 1.
I20260709 13:22:57.050912 13222 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:57.047644 13309 raft_consensus.cc:2804] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:57.051496 13137 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:22:57.052098 13309 raft_consensus.cc:697] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:22:57.051815 13222 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:57.053236 13222 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:57.054786 13309 consensus_queue.cc:237] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
W20260709 13:22:57.057086 13136 leader_election.cc:336] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:57.053762 13245 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:57.060724 13245 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44962c0585994ead93c55cac04f60f1b)
I20260709 13:22:57.061254 13245 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:57.064909 13222 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:57.067639 13222 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:22:57.070129 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:22:57.070354 13245 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:57.072000 13172 raft_consensus.cc:2393] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d1be445e2734b49975a715ceae40ca8 in current term 2: Already voted for candidate 7784733ded584427a5e68711de77c761 in this term.
I20260709 13:22:57.067159 12918 catalog_manager.cc:5697] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 1 to 2, leader changed from 44962c0585994ead93c55cac04f60f1b (127.2.243.65) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:57.074497 13062 leader_election.cc:336] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:57.075356 13063 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8; no voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761
I20260709 13:22:57.077519 13222 raft_consensus.cc:2749] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:22:57.078825 13245 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:57.080566 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:57.081569 13096 raft_consensus.cc:2393] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7784733ded584427a5e68711de77c761 in current term 2: Already voted for candidate 3d1be445e2734b49975a715ceae40ca8 in this term.
W20260709 13:22:57.086351 13136 leader_election.cc:336] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:57.086923 13136 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7784733ded584427a5e68711de77c761; no voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:57.087992 13245 raft_consensus.cc:2749] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:22:57.168756 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:57.387720 13172 raft_consensus.cc:1275] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:57.389797 13222 consensus_queue.cc:1048] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:57.411552 13062 consensus_peers.cc:597] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.474964 13096 raft_consensus.cc:1275] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:57.476794 13309 consensus_queue.cc:1048] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:57.492200 13136 consensus_peers.cc:597] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.598461 13172 raft_consensus.cc:1275] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:57.600299 13302 consensus_queue.cc:1048] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:57.607144 13062 consensus_peers.cc:597] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:57.961745 13136 consensus_peers.cc:597] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:58.043556 13062 consensus_peers.cc:597] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:58.129235 13136 consensus_peers.cc:597] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:58.170214 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:58.210620 13062 consensus_peers.cc:597] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:58.292136 13062 consensus_peers.cc:597] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:58.316958 13136 consensus_peers.cc:597] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:58.745957 13245 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.746579 13245 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:58.748679 13245 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:58.750392 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8" is_pre_election: true
I20260709 13:22:58.751227 13096 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 2.
I20260709 13:22:58.752564 13137 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 
W20260709 13:22:58.753281 13136 leader_election.cc:336] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:58.753577 13245 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:22:58.754060 13245 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.754539 13245 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:58.761173 13245 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:58.763269 13245 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:22:58.764653 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:22:58.765453 13097 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:22:58.767706 13136 leader_election.cc:336] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111)
I20260709 13:22:58.773070 13097 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 3.
I20260709 13:22:58.774268 13137 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 7784733ded584427a5e68711de77c761; no voters: 44962c0585994ead93c55cac04f60f1b
I20260709 13:22:58.775038 13245 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:58.775532 13245 raft_consensus.cc:697] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:22:58.776386 13245 consensus_queue.cc:237] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:22:58.784977 12918 catalog_manager.cc:5697] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 1 to 3, leader changed from 44962c0585994ead93c55cac04f60f1b (127.2.243.65) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:59.172008 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:59.195086 13097 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:59.197392 13245 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:59.216528 13136 consensus_peers.cc:597] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:59.823382 13062 consensus_peers.cc:597] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:59.914039 13136 consensus_peers.cc:597] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:00.070786 13063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.67:43801, user_credentials={real_user=slave}} blocked reactor thread for 51182.4us
W20260709 13:23:00.173849 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:00.339633 13136 consensus_peers.cc:597] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:00.374089 13062 consensus_peers.cc:597] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:00.434540 13136 consensus_peers.cc:597] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:00.602228 13062 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111) [suppressed 97 similar messages]
W20260709 13:23:00.605187 13062 consensus_peers.cc:597] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:00.637538 13062 consensus_peers.cc:597] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:00.671459 13062 consensus_peers.cc:597] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:00.697947  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:00.709035 13333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:00.709604 13334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:00.710047 13336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:00.713974  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:00.715662  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:00.716049  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:00.716572  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603380716512 us; error 0 us; skew 500 ppm
I20260709 13:23:00.717321  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:00.721045  3021 webserver.cc:533] Webserver started at http://127.2.243.65:34583/ using document root <none> and password file <none>
I20260709 13:23:00.721752  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:00.722008  3021 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:23:00.727439  3021 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:23:00.733568 13341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:00.734594  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:23:00.735086  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "44962c0585994ead93c55cac04f60f1b"
format_stamp: "Formatted at 2026-07-09 13:22:53 on dist-test-slave-ftjc"
I20260709 13:23:00.735648  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:00.750710  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:00.752533  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:00.754719  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:00.760143 13348 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:23:00.854595  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:23:00.855170  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.096s	user 0.004s	sys 0.000s
I20260709 13:23:00.855522  3021 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:23:00.864543 13348 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:00.886400 13348 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:00.887687 13348 tablet_bootstrap.cc:492] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:00.888592 13348 ts_tablet_manager.cc:1403] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.012s
I20260709 13:23:00.893534 13348 raft_consensus.cc:359] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:00.894917 13348 raft_consensus.cc:740] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.895831 13348 consensus_queue.cc:260] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:00.900040 13348 ts_tablet_manager.cc:1434] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:23:00.901307 13348 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:00.924387 13348 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:00.926033 13348 tablet_bootstrap.cc:492] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:00.926818 13348 ts_tablet_manager.cc:1403] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 13:23:00.929222 13348 raft_consensus.cc:359] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:00.929759 13348 raft_consensus.cc:740] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.930454 13348 consensus_queue.cc:260] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:00.932040 13348 ts_tablet_manager.cc:1434] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:00.932868 13348 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:00.934954  3021 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:23:00.935789  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.080s	user 0.067s	sys 0.009s
I20260709 13:23:00.949847 13348 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:00.951014 13348 tablet_bootstrap.cc:492] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:00.951792 13348 ts_tablet_manager.cc:1403] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:23:00.955984 13348 raft_consensus.cc:359] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:00.957026 13348 raft_consensus.cc:740] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.959013 13348 consensus_queue.cc:260] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:00.961730 13348 ts_tablet_manager.cc:1434] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.004s
I20260709 13:23:00.963099 13348 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:00.983763 13348 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:00.985097 13348 tablet_bootstrap.cc:492] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:00.986377 13348 ts_tablet_manager.cc:1403] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 13:23:00.989959 13348 raft_consensus.cc:359] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:00.990638 13348 raft_consensus.cc:740] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.991631 13348 consensus_queue.cc:260] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:00.993878 13348 ts_tablet_manager.cc:1434] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:00.994915 13348 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:01.022835 13348 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:01.024633 13348 tablet_bootstrap.cc:492] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:01.025624 13348 ts_tablet_manager.cc:1403] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.012s
I20260709 13:23:01.028278 13348 raft_consensus.cc:359] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.029023 13348 raft_consensus.cc:740] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.029776 13348 consensus_queue.cc:260] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.031926 13348 ts_tablet_manager.cc:1434] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:01.032888 13348 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:01.035799  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:44413
I20260709 13:23:01.036223 13411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:44413 every 8 connection(s)
I20260709 13:23:01.045334  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:01.061257 13348 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:23:01.063184 13348 tablet_bootstrap.cc:492] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:01.064236 13348 ts_tablet_manager.cc:1403] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.012s
I20260709 13:23:01.068311 13348 raft_consensus.cc:359] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.069074 13412 heartbeater.cc:344] Connected to a master server at 127.2.243.126:37913
I20260709 13:23:01.069779 13412 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:01.071084 13412 heartbeater.cc:507] Master 127.2.243.126:37913 requested a full tablet report, sending...
I20260709 13:23:01.071314 13348 raft_consensus.cc:740] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.073071 13348 consensus_queue.cc:260] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.084631 13348 ts_tablet_manager.cc:1434] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:23:01.086885 13348 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:01.098119 12918 ts_manager.cc:194] Re-registered known tserver with Master: 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413)
I20260709 13:23:01.117934 13172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15b4d0a9466a40ad9b60ca42abc1885b"
dest_uuid: "7784733ded584427a5e68711de77c761"
mode: GRACEFUL
new_leader_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:48064
I20260709 13:23:01.118990 13172 raft_consensus.cc:606] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Received request to transfer leadership to TS 3d1be445e2734b49975a715ceae40ca8
I20260709 13:23:01.121905 12918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39824
I20260709 13:23:01.122893 13348 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:01.124238 13348 tablet_bootstrap.cc:492] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:01.125106 13348 ts_tablet_manager.cc:1403] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.008s
I20260709 13:23:01.127954 13412 heartbeater.cc:499] Master 127.2.243.126:37913 was elected leader, sending a full tablet report...
I20260709 13:23:01.128999 13348 raft_consensus.cc:359] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.129792 13348 raft_consensus.cc:740] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.130694 13348 consensus_queue.cc:260] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.132962 13348 ts_tablet_manager.cc:1434] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:01.134054 13348 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:01.139490 13096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
mode: GRACEFUL
new_leader_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:42986
I20260709 13:23:01.140340 13096 raft_consensus.cc:606] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Received request to transfer leadership to TS 7784733ded584427a5e68711de77c761
I20260709 13:23:01.144263 13172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a"
dest_uuid: "7784733ded584427a5e68711de77c761"
mode: GRACEFUL
new_leader_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:48064
I20260709 13:23:01.145421 13172 raft_consensus.cc:606] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Received request to transfer leadership to TS 3d1be445e2734b49975a715ceae40ca8
I20260709 13:23:01.147584  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:01.148847  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:01.150319  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:01.160795 13348 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:01.162945 13348 tablet_bootstrap.cc:492] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:01.163661 13348 ts_tablet_manager.cc:1403] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.007s
I20260709 13:23:01.167009 13348 raft_consensus.cc:359] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.167857 13348 raft_consensus.cc:740] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.168655 13348 consensus_queue.cc:260] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.171454 13348 ts_tablet_manager.cc:1434] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:23:01.172607 13348 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
W20260709 13:23:01.175114 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:01.191303 13348 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:01.193187 13348 tablet_bootstrap.cc:492] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:01.194164 13348 ts_tablet_manager.cc:1403] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.014s
I20260709 13:23:01.196195 13348 raft_consensus.cc:359] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.196815 13348 raft_consensus.cc:740] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.197840 13348 consensus_queue.cc:260] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.200331 13348 ts_tablet_manager.cc:1434] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:01.201696 13348 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Bootstrap starting.
I20260709 13:23:01.203984 13386 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.225461 13348 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:01.226336 13348 tablet_bootstrap.cc:492] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Bootstrap complete.
I20260709 13:23:01.227078 13348 ts_tablet_manager.cc:1403] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.000s
I20260709 13:23:01.229481 13348 raft_consensus.cc:359] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:23:01.230196 13348 raft_consensus.cc:740] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44962c0585994ead93c55cac04f60f1b, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.231014 13348 consensus_queue.cc:260] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:23:01.235661 13348 ts_tablet_manager.cc:1434] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:01.317473 13317 raft_consensus.cc:993] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8: : Instructing follower 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:01.318240 13349 raft_consensus.cc:1081] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Signalling peer 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:01.320705 13172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df"
dest_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:48044
I20260709 13:23:01.321476 13172 raft_consensus.cc:493] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:01.321959 13172 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.334302 13172 raft_consensus.cc:515] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.336431 13172 leader_election.cc:290] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:23:01.337844 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:01.338027 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:23:01.338824 13386 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.338827 13096 raft_consensus.cc:3055] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:01.339403 13096 raft_consensus.cc:740] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:01.340590 13096 consensus_queue.cc:260] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.342273 13096 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.350795 13386 raft_consensus.cc:2468] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 2.
I20260709 13:23:01.352523 13385 raft_consensus.cc:3060] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.352911 13136 leader_election.cc:304] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:23:01.354548 13332 raft_consensus.cc:2804] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:01.355012 13096 raft_consensus.cc:2468] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 2.
I20260709 13:23:01.356019 13332 raft_consensus.cc:697] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:01.357566 13332 consensus_queue.cc:237] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.371778 12920 catalog_manager.cc:5697] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 1 to 2, leader changed from 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:01.380776 13385 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.391861 13385 pending_rounds.cc:85] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Aborting all ops after (but not including) 0
I20260709 13:23:01.392264 13385 pending_rounds.cc:107] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:23:01.393290 13385 raft_consensus.cc:2889] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:23:01.488451 13385 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:23:01.543198 13332 raft_consensus.cc:993] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761: : Instructing follower 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:01.544126 13427 raft_consensus.cc:1081] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Signalling peer 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:01.546597 13096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:42964
I20260709 13:23:01.547363 13096 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:01.547747 13096 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:01.557272 13096 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.559868 13096 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 4 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:23:01.561262 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:01.561262 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:23:01.562538 13172 raft_consensus.cc:3055] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:23:01.562538 13385 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:01.563117 13172 raft_consensus.cc:740] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:01.564322 13172 consensus_queue.cc:260] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.566037 13172 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:01.572695 13385 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 4.
I20260709 13:23:01.574553 13062 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:23:01.575131 13172 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 4.
I20260709 13:23:01.575851 13349 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:23:01.576731 13349 raft_consensus.cc:697] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:01.578369 13349 consensus_queue.cc:237] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:01.593266 12920 catalog_manager.cc:5697] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 3 to 4, leader changed from 7784733ded584427a5e68711de77c761 (127.2.243.67) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 4 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.702647 13332 raft_consensus.cc:993] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761: : Instructing follower 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:01.703200 13332 raft_consensus.cc:1081] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Signalling peer 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:01.705384 13096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15b4d0a9466a40ad9b60ca42abc1885b"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:42964
I20260709 13:23:01.706176 13096 raft_consensus.cc:493] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:01.706744 13096 raft_consensus.cc:3060] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.713626 13096 raft_consensus.cc:515] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:23:01.715726 13096 leader_election.cc:290] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Requested vote from peers 7784733ded584427a5e68711de77c761 (127.2.243.67:43801), 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413)
I20260709 13:23:01.716918 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15b4d0a9466a40ad9b60ca42abc1885b" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:01.716976 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15b4d0a9466a40ad9b60ca42abc1885b" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:23:01.717819 13385 raft_consensus.cc:3060] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.718116 13172 raft_consensus.cc:3055] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:01.718531 13172 raft_consensus.cc:740] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:01.719673 13172 consensus_queue.cc:260] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:23:01.721136 13172 raft_consensus.cc:3060] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.726016 13385 raft_consensus.cc:2468] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 2.
I20260709 13:23:01.727933 13062 leader_election.cc:304] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:23:01.729207 13437 raft_consensus.cc:2804] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:01.729702 13437 raft_consensus.cc:697] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:01.730147 13172 raft_consensus.cc:2468] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 2.
I20260709 13:23:01.732604 13437 consensus_queue.cc:237] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } }
I20260709 13:23:01.750141 12920 catalog_manager.cc:5697] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 1 to 2, leader changed from 7784733ded584427a5e68711de77c761 (127.2.243.67) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.877493 13385 raft_consensus.cc:1275] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:01.879098 13438 consensus_queue.cc:1048] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:01.894598 13096 raft_consensus.cc:1275] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:01.896392 13438 consensus_queue.cc:1048] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:02.032536 13172 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 4 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:23:02.034318 13349 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:02.050417 13385 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 4 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:23:02.052201 13349 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:02.164042  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:02.172950 13172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad"
dest_uuid: "7784733ded584427a5e68711de77c761"
mode: GRACEFUL
new_leader_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:48064
I20260709 13:23:02.173689 13172 raft_consensus.cc:606] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Received request to transfer leadership to TS 3d1be445e2734b49975a715ceae40ca8
W20260709 13:23:02.176591 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:02.177217 13096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
mode: GRACEFUL
new_leader_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:42986
I20260709 13:23:02.177835 13096 raft_consensus.cc:606] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 4 LEADER]: Received request to transfer leadership to TS 7784733ded584427a5e68711de77c761
I20260709 13:23:02.181250 13096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
mode: GRACEFUL
new_leader_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:42986
I20260709 13:23:02.181885 13096 raft_consensus.cc:606] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Received request to transfer leadership to TS 7784733ded584427a5e68711de77c761
I20260709 13:23:02.183354  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:02.184011  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:02.184791  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:02.270328 13172 raft_consensus.cc:1275] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:02.272764 13445 consensus_queue.cc:1048] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:02.286147 13386 raft_consensus.cc:1275] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:02.288549 13445 consensus_queue.cc:1048] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:02.542827 13332 raft_consensus.cc:993] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761: : Instructing follower 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:02.543412 13438 raft_consensus.cc:1081] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Signalling peer 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:02.545554 13096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:42964
I20260709 13:23:02.546232 13096 raft_consensus.cc:493] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:02.546550 13096 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.553339 13096 raft_consensus.cc:515] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.555351 13096 leader_election.cc:290] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:23:02.556650 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:23:02.556497 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:02.557425 13172 raft_consensus.cc:3055] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:02.557466 13386 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.557941 13172 raft_consensus.cc:740] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:02.559347 13172 consensus_queue.cc:260] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.560878 13172 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.567528 13386 raft_consensus.cc:2468] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 2.
I20260709 13:23:02.569479 13062 leader_election.cc:304] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:23:02.570218 13172 raft_consensus.cc:2468] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 2.
I20260709 13:23:02.570482 13445 raft_consensus.cc:2804] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:02.571345 13445 raft_consensus.cc:697] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:02.572451 13445 consensus_queue.cc:237] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.582116 12918 catalog_manager.cc:5697] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 1 to 2, leader changed from 7784733ded584427a5e68711de77c761 (127.2.243.67) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.647810 13437 raft_consensus.cc:993] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8: : Instructing follower 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:02.648607 13349 raft_consensus.cc:1081] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 4 LEADER]: Signalling peer 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:02.650749 13172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a"
dest_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:48044
I20260709 13:23:02.651520 13172 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:02.652040 13172 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:02.659220 13172 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.661130 13172 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 5 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:23:02.662416 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:02.662416 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:23:02.663522 13386 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:02.663650 13096 raft_consensus.cc:3055] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:23:02.664219 13096 raft_consensus.cc:740] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:02.665135 13096 consensus_queue.cc:260] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.666574 13096 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:02.672830 13386 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 5.
I20260709 13:23:02.674085 13096 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 5.
I20260709 13:23:02.674472 13136 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:23:02.675400 13438 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:23:02.675854 13438 raft_consensus.cc:697] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 5 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:02.676718 13438 consensus_queue.cc:237] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.684574 13437 raft_consensus.cc:993] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8: : Instructing follower 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:02.685322 13445 raft_consensus.cc:1081] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Signalling peer 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:02.685359 12918 catalog_manager.cc:5697] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 4 to 5, leader changed from 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 5 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:02.688190 13170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290"
dest_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:48044
I20260709 13:23:02.688992 13170 raft_consensus.cc:493] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:02.689416 13170 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:02.699715 13170 raft_consensus.cc:515] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.702240 13170 leader_election.cc:290] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:23:02.703173 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:02.703441 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f257f2b097f34fdf93b4182b1e537290" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:23:02.704066 13386 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:02.704139 13096 raft_consensus.cc:3055] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:02.704710 13096 raft_consensus.cc:740] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:02.705547 13096 consensus_queue.cc:260] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.707046 13096 raft_consensus.cc:3060] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:02.711931 13386 raft_consensus.cc:2468] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 3.
I20260709 13:23:02.713414 13136 leader_election.cc:304] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:23:02.714048 13096 raft_consensus.cc:2468] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 3.
I20260709 13:23:02.714334 13438 raft_consensus.cc:2804] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:02.715034 13438 raft_consensus.cc:697] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:02.716207 13438 consensus_queue.cc:237] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:02.724151 12918 catalog_manager.cc:5697] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 2 to 3, leader changed from 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:03.027457 13386 raft_consensus.cc:1275] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.029052 13445 consensus_queue.cc:1048] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.043998 13170 raft_consensus.cc:1275] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.046175 13437 consensus_queue.cc:1048] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:03.099206 13096 raft_consensus.cc:1275] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:03.100821 13438 consensus_queue.cc:1048] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:03.115455 13385 raft_consensus.cc:1275] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:03.118439 13461 consensus_queue.cc:1048] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:23:03.122807 13386 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 5 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:23:03.125927 13461 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:23:03.140895 13096 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 5 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:23:03.143028 13461 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:23:03.177769 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:03.191970  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:03.200292 13170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74c2388838954694947aaa08e4635327"
dest_uuid: "7784733ded584427a5e68711de77c761"
mode: GRACEFUL
new_leader_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:48064
I20260709 13:23:03.201059 13170 raft_consensus.cc:606] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Received request to transfer leadership to TS 3d1be445e2734b49975a715ceae40ca8
I20260709 13:23:03.204669 13170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a"
dest_uuid: "7784733ded584427a5e68711de77c761"
mode: GRACEFUL
new_leader_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:48064
I20260709 13:23:03.205346 13170 raft_consensus.cc:606] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Received request to transfer leadership to TS 3d1be445e2734b49975a715ceae40ca8
I20260709 13:23:03.209079 13096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b259b4adcaec4a43aa1fe387952a26d4"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
mode: GRACEFUL
new_leader_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:42986
I20260709 13:23:03.209683 13096 raft_consensus.cc:606] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Received request to transfer leadership to TS 7784733ded584427a5e68711de77c761
I20260709 13:23:03.210929  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:03.211488  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:03.212175  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:03.328905 13461 raft_consensus.cc:993] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761: : Instructing follower 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:03.329545 13464 raft_consensus.cc:1081] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Signalling peer 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:03.331669 13096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74c2388838954694947aaa08e4635327"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:42964
I20260709 13:23:03.332270 13096 raft_consensus.cc:493] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:03.332692 13096 raft_consensus.cc:3060] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.338819 13096 raft_consensus.cc:515] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.341581 13096 leader_election.cc:290] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:23:03.342613 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c2388838954694947aaa08e4635327" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:03.343319 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c2388838954694947aaa08e4635327" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:23:03.343446 13386 raft_consensus.cc:3060] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.344202 13172 raft_consensus.cc:3055] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:03.344799 13172 raft_consensus.cc:740] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:03.345813 13172 consensus_queue.cc:260] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.347254 13172 raft_consensus.cc:3060] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.351205 13386 raft_consensus.cc:2468] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 2.
I20260709 13:23:03.352710 13062 leader_election.cc:304] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:23:03.353708 13456 raft_consensus.cc:2804] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.354231 13456 raft_consensus.cc:697] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:03.354466 13172 raft_consensus.cc:2468] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 2.
I20260709 13:23:03.355260 13456 consensus_queue.cc:237] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.365005 12918 catalog_manager.cc:5697] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 1 to 2, leader changed from 7784733ded584427a5e68711de77c761 (127.2.243.67) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 2 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.554486 13464 raft_consensus.cc:993] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761: : Instructing follower 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:03.555130 13461 raft_consensus.cc:1081] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Signalling peer 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:03.557179 13096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:42964
I20260709 13:23:03.557695 13096 raft_consensus.cc:493] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:03.557997 13096 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:03.564854 13096 raft_consensus.cc:515] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.566584 13096 leader_election.cc:290] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 3 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:23:03.567754 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:03.567795 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:23:03.568526 13386 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:03.568590 13172 raft_consensus.cc:3055] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:03.569042 13172 raft_consensus.cc:740] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:03.569900 13172 consensus_queue.cc:260] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.571213 13172 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:03.576287 13386 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 3.
I20260709 13:23:03.577740 13062 leader_election.cc:304] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:23:03.577960 13172 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 3.
I20260709 13:23:03.578588 13456 raft_consensus.cc:2804] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:03.579177 13456 raft_consensus.cc:697] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:03.580082 13456 consensus_queue.cc:237] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.589073 12918 catalog_manager.cc:5697] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 2 to 3, leader changed from 7784733ded584427a5e68711de77c761 (127.2.243.67) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.712045 13471 raft_consensus.cc:993] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8: : Instructing follower 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:03.712682 13471 raft_consensus.cc:1081] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Signalling peer 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:03.714453 13172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b259b4adcaec4a43aa1fe387952a26d4"
dest_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:48044
I20260709 13:23:03.714998 13172 raft_consensus.cc:493] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:03.715349 13172 raft_consensus.cc:3060] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.721479 13172 raft_consensus.cc:515] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.723444 13172 leader_election.cc:290] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:23:03.725134 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b259b4adcaec4a43aa1fe387952a26d4" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:23:03.725075 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b259b4adcaec4a43aa1fe387952a26d4" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:03.726130 13096 raft_consensus.cc:3055] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:03.726157 13386 raft_consensus.cc:3060] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.726640 13096 raft_consensus.cc:740] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:03.727597 13096 consensus_queue.cc:260] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.729274 13096 raft_consensus.cc:3060] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.735605 13386 raft_consensus.cc:2468] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 2.
I20260709 13:23:03.737597 13136 leader_election.cc:304] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:23:03.738128 13096 raft_consensus.cc:2468] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 2.
I20260709 13:23:03.738816 13472 raft_consensus.cc:2804] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.739390 13472 raft_consensus.cc:697] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:03.741133 13472 consensus_queue.cc:237] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:03.749431 13172 raft_consensus.cc:1275] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.750911 13471 consensus_queue.cc:1048] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.752871 12918 catalog_manager.cc:5697] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 1 to 2, leader changed from 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:03.754956 13386 raft_consensus.cc:1275] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.756979 13456 consensus_queue.cc:1048] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.103515 13172 raft_consensus.cc:1275] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:23:04.105216 13471 consensus_queue.cc:1048] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.118368 13386 raft_consensus.cc:1275] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:23:04.122114 13471 consensus_queue.cc:1048] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:04.149529 13096 raft_consensus.cc:1275] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.151078 13472 consensus_queue.cc:1048] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.164218 13386 raft_consensus.cc:1275] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.165940 13472 consensus_queue.cc:1048] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:04.178983 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:04.220165  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:04.229923 13096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
mode: GRACEFUL
new_leader_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:42986
I20260709 13:23:04.230489 13096 raft_consensus.cc:606] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Received request to transfer leadership to TS 7784733ded584427a5e68711de77c761
I20260709 13:23:04.233695 13096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
mode: GRACEFUL
new_leader_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:42986
I20260709 13:23:04.234182 13471 raft_consensus.cc:993] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8: : Instructing follower 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:04.234341 13096 raft_consensus.cc:606] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 3 LEADER]: Received request to transfer leadership to TS 7784733ded584427a5e68711de77c761
I20260709 13:23:04.234903 13437 raft_consensus.cc:1081] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Signalling peer 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:04.236526 13172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad"
dest_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:48044
I20260709 13:23:04.237039 13172 raft_consensus.cc:493] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:04.237442 13172 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:04.237287 13170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a"
dest_uuid: "7784733ded584427a5e68711de77c761"
mode: GRACEFUL
new_leader_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:48064
I20260709 13:23:04.238252 13170 raft_consensus.cc:606] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 5 LEADER]: Received request to transfer leadership to TS 3d1be445e2734b49975a715ceae40ca8
I20260709 13:23:04.239697  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:04.240502  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:04.241322  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:04.246445 13172 raft_consensus.cc:515] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.249191 13172 leader_election.cc:290] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:23:04.250582 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:04.250726 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682312dcb3d2421181b1cf49f05b67ad" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:23:04.251575 13386 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:04.251684 13096 raft_consensus.cc:3055] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:04.252228 13096 raft_consensus.cc:740] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:04.253026 13096 consensus_queue.cc:260] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.254485 13096 raft_consensus.cc:3060] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:04.259392 13386 raft_consensus.cc:2468] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 3.
I20260709 13:23:04.261032 13136 leader_election.cc:304] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:23:04.262065 13096 raft_consensus.cc:2468] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 3.
I20260709 13:23:04.261962 13461 raft_consensus.cc:2804] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:04.263005 13461 raft_consensus.cc:697] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:04.264173 13461 consensus_queue.cc:237] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.274286 12921 catalog_manager.cc:5697] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 2 to 3, leader changed from 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:04.323807 13472 raft_consensus.cc:993] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761: : Instructing follower 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:04.324482 13461 raft_consensus.cc:1081] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 5 LEADER]: Signalling peer 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:04.326396 13096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:42964
I20260709 13:23:04.327003 13096 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:04.327358 13096 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:23:04.333372 13096 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.335291 13096 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 6 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:23:04.336692 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:23:04.336592 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:04.337323 13172 raft_consensus.cc:3055] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:23:04.337713 13386 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:23:04.337827 13172 raft_consensus.cc:740] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:04.339134 13172 consensus_queue.cc:260] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.340557 13172 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:23:04.344761 13386 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 6.
I20260709 13:23:04.346562 13062 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:23:04.347388 13437 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:23:04.347486 13172 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 6.
I20260709 13:23:04.347970 13437 raft_consensus.cc:697] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:04.348881 13437 consensus_queue.cc:237] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.358028 12921 catalog_manager.cc:5697] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 5 to 6, leader changed from 7784733ded584427a5e68711de77c761 (127.2.243.67) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 6 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.511395 13471 raft_consensus.cc:993] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8: : Instructing follower 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:04.511957 13471 raft_consensus.cc:1081] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 3 LEADER]: Signalling peer 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:04.513749 13172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a"
dest_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:48044
I20260709 13:23:04.514333 13172 raft_consensus.cc:493] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:04.514652 13172 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:04.521817 13172 raft_consensus.cc:515] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.523938 13172 leader_election.cc:290] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 4 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:23:04.525115 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:04.525115 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:23:04.526120 13386 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:04.526242 13096 raft_consensus.cc:3055] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:23:04.526696 13096 raft_consensus.cc:740] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:04.527375 13096 consensus_queue.cc:260] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.528475 13096 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:04.533337 13386 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 4.
I20260709 13:23:04.534217 13096 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 4.
I20260709 13:23:04.534924 13136 leader_election.cc:304] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:23:04.535799 13472 raft_consensus.cc:2804] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:23:04.536316 13472 raft_consensus.cc:697] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 4 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:04.537340 13472 consensus_queue.cc:237] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:04.545444 12921 catalog_manager.cc:5697] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 3 to 4, leader changed from 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 4 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:04.645359 13386 raft_consensus.cc:1275] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:04.647068 13472 consensus_queue.cc:1048] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:04.660735 13096 raft_consensus.cc:1275] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:04.668128 13461 consensus_queue.cc:1048] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:04.761263 13172 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 6 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:23:04.762877 13437 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:23:04.776049 13386 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 6 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:23:04.778288 13471 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:23:04.992982 13386 raft_consensus.cc:1275] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 4 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:23:04.994905 13461 consensus_queue.cc:1048] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:05.005807 13096 raft_consensus.cc:1275] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 4 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:23:05.007761 13461 consensus_queue.cc:1048] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:23:05.180332 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:05.252962  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:05.262436 13172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df"
dest_uuid: "7784733ded584427a5e68711de77c761"
mode: GRACEFUL
new_leader_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:48064
I20260709 13:23:05.263093 13172 raft_consensus.cc:606] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Received request to transfer leadership to TS 3d1be445e2734b49975a715ceae40ca8
I20260709 13:23:05.266834 13172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a"
dest_uuid: "7784733ded584427a5e68711de77c761"
mode: GRACEFUL
new_leader_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:48064
I20260709 13:23:05.267534 13172 raft_consensus.cc:606] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 4 LEADER]: Received request to transfer leadership to TS 3d1be445e2734b49975a715ceae40ca8
I20260709 13:23:05.270499 13097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
mode: GRACEFUL
new_leader_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:42986
I20260709 13:23:05.271176 13097 raft_consensus.cc:606] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 6 LEADER]: Received request to transfer leadership to TS 7784733ded584427a5e68711de77c761
I20260709 13:23:05.272784  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:05.273773  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:05.274566  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:05.326608 13473 raft_consensus.cc:993] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761: : Instructing follower 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:05.327270 13472 raft_consensus.cc:1081] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Signalling peer 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:05.329106 13097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:42964
I20260709 13:23:05.329643 13097 raft_consensus.cc:493] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:05.329931 13097 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:05.338419 13097 raft_consensus.cc:515] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.341480 13097 leader_election.cc:290] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 3 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:23:05.342183 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:05.342795 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab0530cb9a547779aa677cf0851c6df" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:23:05.342906 13386 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:05.343653 13172 raft_consensus.cc:3055] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:05.343978 13172 raft_consensus.cc:740] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:05.344789 13172 consensus_queue.cc:260] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.345799 13172 raft_consensus.cc:3060] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:05.350358 13386 raft_consensus.cc:2468] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 3.
I20260709 13:23:05.351395 13172 raft_consensus.cc:2468] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 3.
I20260709 13:23:05.351975 13062 leader_election.cc:304] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:23:05.352942 13497 raft_consensus.cc:2804] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:05.353529 13497 raft_consensus.cc:697] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:05.354274 13497 consensus_queue.cc:237] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.363148 12920 catalog_manager.cc:5697] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 2 to 3, leader changed from 7784733ded584427a5e68711de77c761 (127.2.243.67) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 3 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:05.485504 13472 raft_consensus.cc:993] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761: : Instructing follower 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:05.486187 13461 raft_consensus.cc:1081] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 4 LEADER]: Signalling peer 3d1be445e2734b49975a715ceae40ca8 to start an election
I20260709 13:23:05.488209 13097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a"
dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
 from {username='slave'} at 127.0.0.1:42964
I20260709 13:23:05.489010 13097 raft_consensus.cc:493] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:05.489488 13097 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:05.496973 13097 raft_consensus.cc:515] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.499370 13097 leader_election.cc:290] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 5 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 7784733ded584427a5e68711de77c761 (127.2.243.67:43801)
I20260709 13:23:05.500515 13172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "7784733ded584427a5e68711de77c761"
I20260709 13:23:05.500329 13384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876af370ba314059b0c028f1fa4ad08a" candidate_uuid: "3d1be445e2734b49975a715ceae40ca8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:05.501242 13172 raft_consensus.cc:3055] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:23:05.501273 13384 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:05.502012 13172 raft_consensus.cc:740] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:05.503106 13172 consensus_queue.cc:260] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.504606 13172 raft_consensus.cc:3060] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:05.512388 13384 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 5.
I20260709 13:23:05.513922 13172 raft_consensus.cc:2468] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1be445e2734b49975a715ceae40ca8 in term 5.
I20260709 13:23:05.514356 13062 leader_election.cc:304] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1be445e2734b49975a715ceae40ca8, 44962c0585994ead93c55cac04f60f1b; no voters: 
I20260709 13:23:05.515342 13497 raft_consensus.cc:2804] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:23:05.515924 13497 raft_consensus.cc:697] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:05.516757 13497 consensus_queue.cc:237] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.523888 12920 catalog_manager.cc:5697] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 reported cstate change: term changed from 4 to 5, leader changed from 7784733ded584427a5e68711de77c761 (127.2.243.67) to 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66). New cstate: current_term: 5 leader_uuid: "3d1be445e2734b49975a715ceae40ca8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:05.630002 13497 raft_consensus.cc:993] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8: : Instructing follower 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:05.630576 13497 raft_consensus.cc:1081] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 6 LEADER]: Signalling peer 7784733ded584427a5e68711de77c761 to start an election
I20260709 13:23:05.632784 13172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a"
dest_uuid: "7784733ded584427a5e68711de77c761"
 from {username='slave'} at 127.0.0.1:48044
I20260709 13:23:05.633638 13172 raft_consensus.cc:493] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:05.634063 13172 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:23:05.640585 13172 raft_consensus.cc:515] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.642398 13172 leader_election.cc:290] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 7 election: Requested vote from peers 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413), 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477)
I20260709 13:23:05.643497 13384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "44962c0585994ead93c55cac04f60f1b"
I20260709 13:23:05.643579 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb24f1e43d24411982f6264e685610a" candidate_uuid: "7784733ded584427a5e68711de77c761" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "3d1be445e2734b49975a715ceae40ca8"
I20260709 13:23:05.644279 13384 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:23:05.644433 13097 raft_consensus.cc:3055] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:23:05.644943 13097 raft_consensus.cc:740] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d1be445e2734b49975a715ceae40ca8, State: Running, Role: LEADER
I20260709 13:23:05.645921 13097 consensus_queue.cc:260] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.647133 13097 raft_consensus.cc:3060] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:23:05.652568 13384 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 7.
I20260709 13:23:05.653928 13097 raft_consensus.cc:2468] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7784733ded584427a5e68711de77c761 in term 7.
I20260709 13:23:05.654337 13136 leader_election.cc:304] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44962c0585994ead93c55cac04f60f1b, 7784733ded584427a5e68711de77c761; no voters: 
I20260709 13:23:05.655284 13473 raft_consensus.cc:2804] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:23:05.655907 13473 raft_consensus.cc:697] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 7 LEADER]: Becoming Leader. State: Replica: 7784733ded584427a5e68711de77c761, State: Running, Role: LEADER
I20260709 13:23:05.656785 13473 consensus_queue.cc:237] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } }
I20260709 13:23:05.663991 12920 catalog_manager.cc:5697] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 reported cstate change: term changed from 6 to 7, leader changed from 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66) to 7784733ded584427a5e68711de77c761 (127.2.243.67). New cstate: current_term: 7 leader_uuid: "7784733ded584427a5e68711de77c761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:05.826741 13384 raft_consensus.cc:1275] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:05.828686 13497 consensus_queue.cc:1048] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:05.844667 13172 raft_consensus.cc:1275] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:05.847679 13506 consensus_queue.cc:1048] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:06.065820 13172 raft_consensus.cc:1275] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 5 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:23:06.067474 13437 consensus_queue.cc:1048] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7784733ded584427a5e68711de77c761" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:06.082309 13384 raft_consensus.cc:1275] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 5 FOLLOWER]: Refusing update from remote peer 3d1be445e2734b49975a715ceae40ca8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:23:06.083937 13437 consensus_queue.cc:1048] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:23:06.126793 13384 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 7 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:23:06.128410 13473 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44962c0585994ead93c55cac04f60f1b" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:23:06.142935 13097 raft_consensus.cc:1275] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 7 FOLLOWER]: Refusing update from remote peer 7784733ded584427a5e68711de77c761: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:23:06.144533 13461 consensus_queue.cc:1048] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1be445e2734b49975a715ceae40ca8" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:23:06.181931 12969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:06.283058  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:06.320571  3021 tablet_server.cc:179] TabletServer@127.2.243.65:44413 shutting down...
W20260709 13:23:06.343355 13062 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:23:06.349260 13062 consensus_peers.cc:597] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:06.362648  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:06.363634  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.364516  3021 raft_consensus.cc:2243] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.365202  3021 raft_consensus.cc:2272] T 15b4d0a9466a40ad9b60ca42abc1885b P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.368052  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.369017  3021 raft_consensus.cc:2243] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:06.369560 13062 consensus_peers.cc:597] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:06.369694  3021 raft_consensus.cc:2272] T eea748194cb645219143f4cc1ffdecc3 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.372323  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.373071  3021 raft_consensus.cc:2243] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.373631  3021 raft_consensus.cc:2272] T dbb24f1e43d24411982f6264e685610a P 44962c0585994ead93c55cac04f60f1b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.377030  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.377712  3021 raft_consensus.cc:2243] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.378225  3021 raft_consensus.cc:2272] T f257f2b097f34fdf93b4182b1e537290 P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.380542  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.381167  3021 raft_consensus.cc:2243] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.381716  3021 raft_consensus.cc:2272] T 876af370ba314059b0c028f1fa4ad08a P 44962c0585994ead93c55cac04f60f1b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.385365  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.386153  3021 raft_consensus.cc:2243] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.386719  3021 raft_consensus.cc:2272] T 74c2388838954694947aaa08e4635327 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.389240  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.389904  3021 raft_consensus.cc:2243] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.390377  3021 raft_consensus.cc:2272] T ee840f3cb2eb4b4d81aab41314fa9879 P 44962c0585994ead93c55cac04f60f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.392688  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.393302  3021 raft_consensus.cc:2243] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.393817  3021 raft_consensus.cc:2272] T 6ab0530cb9a547779aa677cf0851c6df P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.397018  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.397758  3021 raft_consensus.cc:2243] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.398329  3021 raft_consensus.cc:2272] T 682312dcb3d2421181b1cf49f05b67ad P 44962c0585994ead93c55cac04f60f1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.400682  3021 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:06.401253  3021 raft_consensus.cc:2243] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.401741  3021 raft_consensus.cc:2272] T b259b4adcaec4a43aa1fe387952a26d4 P 44962c0585994ead93c55cac04f60f1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.438470  3021 tablet_server.cc:196] TabletServer@127.2.243.65:44413 shutdown complete.
W20260709 13:23:06.439148 13062 consensus_peers.cc:597] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:06.465309  3021 tablet_server.cc:179] TabletServer@127.2.243.66:0 shutting down...
W20260709 13:23:06.470516 13062 consensus_peers.cc:597] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:06.500931  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:06.501879  3021 tablet_replica.cc:333] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.502784  3021 raft_consensus.cc:2243] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.503337  3021 raft_consensus.cc:2272] T f257f2b097f34fdf93b4182b1e537290 P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.506421  3021 tablet_replica.cc:333] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.507184  3021 raft_consensus.cc:2243] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.507715  3021 raft_consensus.cc:2272] T dbb24f1e43d24411982f6264e685610a P 3d1be445e2734b49975a715ceae40ca8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.511400  3021 tablet_replica.cc:333] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.512182  3021 raft_consensus.cc:2243] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.513216  3021 raft_consensus.cc:2272] T 6ab0530cb9a547779aa677cf0851c6df P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.516646  3021 tablet_replica.cc:333] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.517387  3021 raft_consensus.cc:2243] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.518461  3021 raft_consensus.cc:2272] T ee840f3cb2eb4b4d81aab41314fa9879 P 3d1be445e2734b49975a715ceae40ca8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.521759  3021 tablet_replica.cc:333] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.522595  3021 raft_consensus.cc:2243] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.523149  3021 raft_consensus.cc:2272] T 682312dcb3d2421181b1cf49f05b67ad P 3d1be445e2734b49975a715ceae40ca8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.526014  3021 tablet_replica.cc:333] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.526712  3021 raft_consensus.cc:2243] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.527223  3021 raft_consensus.cc:2272] T b259b4adcaec4a43aa1fe387952a26d4 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.530054  3021 tablet_replica.cc:333] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.530714  3021 raft_consensus.cc:2243] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.531713  3021 raft_consensus.cc:2272] T eea748194cb645219143f4cc1ffdecc3 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.534243  3021 tablet_replica.cc:333] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.534904  3021 raft_consensus.cc:2243] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.535866  3021 raft_consensus.cc:2272] T 15b4d0a9466a40ad9b60ca42abc1885b P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.539623  3021 tablet_replica.cc:333] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.540477  3021 raft_consensus.cc:2243] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.541613  3021 raft_consensus.cc:2272] T 876af370ba314059b0c028f1fa4ad08a P 3d1be445e2734b49975a715ceae40ca8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.545215  3021 tablet_replica.cc:333] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8: stopping tablet replica
I20260709 13:23:06.546144  3021 raft_consensus.cc:2243] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.547454  3021 raft_consensus.cc:2272] T 74c2388838954694947aaa08e4635327 P 3d1be445e2734b49975a715ceae40ca8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:06.572690 13137 connection.cc:573] client connection to 127.2.243.66:46477 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:23:06.584622 13137 consensus_peers.cc:597] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 -> Peer 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477): Couldn't send request to peer 3d1be445e2734b49975a715ceae40ca8. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:46477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:06.590678 13136 consensus_peers.cc:597] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:06.593874  3021 tablet_server.cc:196] TabletServer@127.2.243.66:0 shutdown complete.
W20260709 13:23:06.607137 13137 consensus_peers.cc:597] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 -> Peer 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477): Couldn't send request to peer 3d1be445e2734b49975a715ceae40ca8. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:46477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:06.607828 13136 consensus_peers.cc:597] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 -> Peer 44962c0585994ead93c55cac04f60f1b (127.2.243.65:44413): Couldn't send request to peer 44962c0585994ead93c55cac04f60f1b. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:06.635859  3021 tablet_server.cc:179] TabletServer@127.2.243.67:0 shutting down...
W20260709 13:23:06.638108 13137 consensus_peers.cc:597] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 -> Peer 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477): Couldn't send request to peer 3d1be445e2734b49975a715ceae40ca8. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:46477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:06.686483  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:06.687492  3021 tablet_replica.cc:333] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.688794  3021 raft_consensus.cc:2243] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.689811  3021 raft_consensus.cc:2272] T dbb24f1e43d24411982f6264e685610a P 7784733ded584427a5e68711de77c761 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.693089  3021 tablet_replica.cc:333] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.693912  3021 raft_consensus.cc:2243] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.694478  3021 raft_consensus.cc:2272] T 6ab0530cb9a547779aa677cf0851c6df P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.698124  3021 tablet_replica.cc:333] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.698891  3021 raft_consensus.cc:2243] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.699496  3021 raft_consensus.cc:2272] T ee840f3cb2eb4b4d81aab41314fa9879 P 7784733ded584427a5e68711de77c761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.702353  3021 tablet_replica.cc:333] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.703238  3021 raft_consensus.cc:2243] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.704252  3021 raft_consensus.cc:2272] T 682312dcb3d2421181b1cf49f05b67ad P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.707829  3021 tablet_replica.cc:333] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.708858  3021 raft_consensus.cc:2243] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:23:06.709244 13137 consensus_peers.cc:597] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 -> Peer 3d1be445e2734b49975a715ceae40ca8 (127.2.243.66:46477): Couldn't send request to peer 3d1be445e2734b49975a715ceae40ca8. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:46477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:06.710711  3021 raft_consensus.cc:2272] T b259b4adcaec4a43aa1fe387952a26d4 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.713511  3021 tablet_replica.cc:333] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.714250  3021 raft_consensus.cc:2243] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.715415  3021 raft_consensus.cc:2272] T f257f2b097f34fdf93b4182b1e537290 P 7784733ded584427a5e68711de77c761 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.718390  3021 tablet_replica.cc:333] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.719120  3021 raft_consensus.cc:2243] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.719734  3021 raft_consensus.cc:2272] T eea748194cb645219143f4cc1ffdecc3 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.722339  3021 tablet_replica.cc:333] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.723145  3021 raft_consensus.cc:2243] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.723743  3021 raft_consensus.cc:2272] T 15b4d0a9466a40ad9b60ca42abc1885b P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.727063  3021 tablet_replica.cc:333] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.727804  3021 raft_consensus.cc:2243] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.728452  3021 raft_consensus.cc:2272] T 876af370ba314059b0c028f1fa4ad08a P 7784733ded584427a5e68711de77c761 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.733086  3021 tablet_replica.cc:333] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761: stopping tablet replica
I20260709 13:23:06.733772  3021 raft_consensus.cc:2243] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:06.734350  3021 raft_consensus.cc:2272] T 74c2388838954694947aaa08e4635327 P 7784733ded584427a5e68711de77c761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.775727  3021 tablet_server.cc:196] TabletServer@127.2.243.67:0 shutdown complete.
I20260709 13:23:06.812577  3021 master.cc:562] Master@127.2.243.126:37913 shutting down...
I20260709 13:23:06.848685  3021 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:06.849403  3021 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:06.849788  3021 tablet_replica.cc:333] T 00000000000000000000000000000000 P 489a8fffc860400caecb8ca23f74abb3: stopping tablet replica
I20260709 13:23:06.873608  3021 master.cc:584] Master@127.2.243.126:37913 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13962 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:23:06.936574  3021 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.243.126:41175
I20260709 13:23:06.938050  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:06.944952 13523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:06.945329 13522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:06.946379 13525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:06.947376  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:06.948693  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:06.948892  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:06.949002  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603386948990 us; error 0 us; skew 500 ppm
I20260709 13:23:06.949550  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:06.953109  3021 webserver.cc:533] Webserver started at http://127.2.243.126:33745/ using document root <none> and password file <none>
I20260709 13:23:06.953677  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:06.953853  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:06.954131  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:06.956040  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/master-0-root/instance:
uuid: "ca4ac49925724e84900695ee5a526eb5"
format_stamp: "Formatted at 2026-07-09 13:23:06 on dist-test-slave-ftjc"
I20260709 13:23:06.961575  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:06.966475 13530 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:06.967626  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:23:06.968176  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/master-0-root
uuid: "ca4ac49925724e84900695ee5a526eb5"
format_stamp: "Formatted at 2026-07-09 13:23:06 on dist-test-slave-ftjc"
I20260709 13:23:06.968657  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:06.999367  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:07.000972  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:07.059525  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.126:41175
I20260709 13:23:07.059607 13581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.126:41175 every 8 connection(s)
I20260709 13:23:07.064476 13582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:07.085685 13582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5: Bootstrap starting.
I20260709 13:23:07.094770 13582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.101310 13582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5: No bootstrap required, opened a new log
I20260709 13:23:07.104187 13582 raft_consensus.cc:359] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4ac49925724e84900695ee5a526eb5" member_type: VOTER }
I20260709 13:23:07.104806 13582 raft_consensus.cc:385] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.105059 13582 raft_consensus.cc:740] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4ac49925724e84900695ee5a526eb5, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.105795 13582 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4ac49925724e84900695ee5a526eb5" member_type: VOTER }
I20260709 13:23:07.106307 13582 raft_consensus.cc:399] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:07.106573 13582 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:07.106884 13582 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.115219 13582 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4ac49925724e84900695ee5a526eb5" member_type: VOTER }
I20260709 13:23:07.116039 13582 leader_election.cc:304] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca4ac49925724e84900695ee5a526eb5; no voters: 
I20260709 13:23:07.117664 13582 leader_election.cc:290] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:07.118259 13585 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:07.120043 13585 raft_consensus.cc:697] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 1 LEADER]: Becoming Leader. State: Replica: ca4ac49925724e84900695ee5a526eb5, State: Running, Role: LEADER
I20260709 13:23:07.120909 13585 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4ac49925724e84900695ee5a526eb5" member_type: VOTER }
I20260709 13:23:07.121532 13582 sys_catalog.cc:565] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:07.126936 13586 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca4ac49925724e84900695ee5a526eb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4ac49925724e84900695ee5a526eb5" member_type: VOTER } }
I20260709 13:23:07.126935 13587 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca4ac49925724e84900695ee5a526eb5. Latest consensus state: current_term: 1 leader_uuid: "ca4ac49925724e84900695ee5a526eb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca4ac49925724e84900695ee5a526eb5" member_type: VOTER } }
I20260709 13:23:07.128000 13586 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:07.128041 13587 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:07.131393 13592 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:07.140074 13592 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:07.143568  3021 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:07.153242 13592 catalog_manager.cc:1383] Generated new cluster ID: a5dfbf598ce84f9fac53e9d5affd98f2
I20260709 13:23:07.153618 13592 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:07.177698 13592 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:07.179329 13592 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:07.198274 13592 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5: Generated new TSK 0
I20260709 13:23:07.199077 13592 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:07.211896  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:07.219844 13603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:07.221835 13604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:07.224401  3021 server_base.cc:1061] running on GCE node
W20260709 13:23:07.224457 13606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:07.226003  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:07.226233  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:07.226380  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603387226367 us; error 0 us; skew 500 ppm
I20260709 13:23:07.226995  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:07.230412  3021 webserver.cc:533] Webserver started at http://127.2.243.65:36415/ using document root <none> and password file <none>
I20260709 13:23:07.230979  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:07.231161  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:07.231403  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:07.232825  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-0-root/instance:
uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
format_stamp: "Formatted at 2026-07-09 13:23:07 on dist-test-slave-ftjc"
I20260709 13:23:07.239964  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:23:07.245142 13611 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:07.246309  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:23:07.246670  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
format_stamp: "Formatted at 2026-07-09 13:23:07 on dist-test-slave-ftjc"
I20260709 13:23:07.246977  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:07.305044  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:07.306820  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:07.309183  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:07.312057  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:07.312346  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:07.312758  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:07.312980  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:07.374686  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:36017
I20260709 13:23:07.374823 13673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:36017 every 8 connection(s)
I20260709 13:23:07.381220  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:07.392333 13678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:07.393573 13679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:07.402246  3021 server_base.cc:1061] running on GCE node
W20260709 13:23:07.402433 13681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:07.404635 13674 heartbeater.cc:344] Connected to a master server at 127.2.243.126:41175
I20260709 13:23:07.405372 13674 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:07.406560 13674 heartbeater.cc:507] Master 127.2.243.126:41175 requested a full tablet report, sending...
I20260709 13:23:07.406898  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:07.407305  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:07.407541  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603387407518 us; error 0 us; skew 500 ppm
I20260709 13:23:07.408584  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:07.409890 13547 ts_manager.cc:194] Registered new tserver with Master: 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65:36017)
I20260709 13:23:07.412185  3021 webserver.cc:533] Webserver started at http://127.2.243.66:39941/ using document root <none> and password file <none>
I20260709 13:23:07.412571 13547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39266
I20260709 13:23:07.413218  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:07.413722  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:07.414152  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:07.415416  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-1-root/instance:
uuid: "d19bb05530b4455293b9a58ce563445a"
format_stamp: "Formatted at 2026-07-09 13:23:07 on dist-test-slave-ftjc"
I20260709 13:23:07.421013  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:23:07.426141 13686 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:07.427450  3021 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:23:07.427915  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-1-root
uuid: "d19bb05530b4455293b9a58ce563445a"
format_stamp: "Formatted at 2026-07-09 13:23:07 on dist-test-slave-ftjc"
I20260709 13:23:07.428197  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:07.464754  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:07.466981  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:07.469095  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:07.472244  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:07.472602  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:23:07.473166  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:07.473390  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:07.531459  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.66:37729
I20260709 13:23:07.531584 13748 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.66:37729 every 8 connection(s)
I20260709 13:23:07.537460  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:07.547415 13752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:07.548321 13753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:07.553308 13755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:07.554141  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:07.555686  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:23:07.555883 13749 heartbeater.cc:344] Connected to a master server at 127.2.243.126:41175
W20260709 13:23:07.556017  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:07.556463  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603387556437 us; error 0 us; skew 500 ppm
I20260709 13:23:07.556512 13749 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:07.557257  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:07.557777 13749 heartbeater.cc:507] Master 127.2.243.126:41175 requested a full tablet report, sending...
I20260709 13:23:07.560794  3021 webserver.cc:533] Webserver started at http://127.2.243.67:35693/ using document root <none> and password file <none>
I20260709 13:23:07.560794 13547 ts_manager.cc:194] Registered new tserver with Master: d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729)
I20260709 13:23:07.562165  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:07.562572  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:07.562958  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:07.563866 13547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39270
I20260709 13:23:07.565167  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-2-root/instance:
uuid: "c51dd8e094e14a75bd74f99dee559593"
format_stamp: "Formatted at 2026-07-09 13:23:07 on dist-test-slave-ftjc"
I20260709 13:23:07.571504  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:23:07.576279 13760 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:07.577397  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:23:07.577883  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-2-root
uuid: "c51dd8e094e14a75bd74f99dee559593"
format_stamp: "Formatted at 2026-07-09 13:23:07 on dist-test-slave-ftjc"
I20260709 13:23:07.578298  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603048513324-3021-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:07.593170  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:07.594820  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:07.596757  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:07.599529  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:07.599860  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:07.600128  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:07.600313  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:07.657979  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.67:45177
I20260709 13:23:07.658108 13822 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.67:45177 every 8 connection(s)
I20260709 13:23:07.675817 13823 heartbeater.cc:344] Connected to a master server at 127.2.243.126:41175
I20260709 13:23:07.676584 13823 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:07.677639 13823 heartbeater.cc:507] Master 127.2.243.126:41175 requested a full tablet report, sending...
I20260709 13:23:07.680634 13547 ts_manager.cc:194] Registered new tserver with Master: c51dd8e094e14a75bd74f99dee559593 (127.2.243.67:45177)
I20260709 13:23:07.681644  3021 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019691374s
I20260709 13:23:07.682327 13547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39280
I20260709 13:23:07.720455 13547 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39292:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:07.723332 13547 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:07.803249 13787 tablet_service.cc:1511] Processing CreateTablet for tablet 64fc0de553f649adb9e59c57dac8409e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1c85c36d965d44749e5804ad5a3a48a4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:07.803249 13788 tablet_service.cc:1511] Processing CreateTablet for tablet e891b5ee285441efba07041aa8ffeba5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1c85c36d965d44749e5804ad5a3a48a4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:07.805282 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64fc0de553f649adb9e59c57dac8409e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:07.806205 13638 tablet_service.cc:1511] Processing CreateTablet for tablet 64fc0de553f649adb9e59c57dac8409e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1c85c36d965d44749e5804ad5a3a48a4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:07.806070 13714 tablet_service.cc:1511] Processing CreateTablet for tablet e891b5ee285441efba07041aa8ffeba5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1c85c36d965d44749e5804ad5a3a48a4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:07.807209 13639 tablet_service.cc:1511] Processing CreateTablet for tablet e891b5ee285441efba07041aa8ffeba5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1c85c36d965d44749e5804ad5a3a48a4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:07.807865 13638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64fc0de553f649adb9e59c57dac8409e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:07.809511 13639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e891b5ee285441efba07041aa8ffeba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:07.810357 13788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e891b5ee285441efba07041aa8ffeba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:07.810089 13713 tablet_service.cc:1511] Processing CreateTablet for tablet 64fc0de553f649adb9e59c57dac8409e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1c85c36d965d44749e5804ad5a3a48a4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:07.807865 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e891b5ee285441efba07041aa8ffeba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:07.816876 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64fc0de553f649adb9e59c57dac8409e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:07.840090 13841 tablet_bootstrap.cc:492] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593: Bootstrap starting.
I20260709 13:23:07.848968 13842 tablet_bootstrap.cc:492] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030: Bootstrap starting.
I20260709 13:23:07.854774 13841 tablet_bootstrap.cc:654] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.858103 13842 tablet_bootstrap.cc:654] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.864009 13843 tablet_bootstrap.cc:492] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a: Bootstrap starting.
I20260709 13:23:07.871244 13841 tablet_bootstrap.cc:492] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593: No bootstrap required, opened a new log
I20260709 13:23:07.872009 13841 ts_tablet_manager.cc:1403] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593: Time spent bootstrapping tablet: real 0.033s	user 0.003s	sys 0.020s
I20260709 13:23:07.875674 13841 raft_consensus.cc:359] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.876654 13841 raft_consensus.cc:385] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.877002 13841 raft_consensus.cc:740] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51dd8e094e14a75bd74f99dee559593, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.877996 13843 tablet_bootstrap.cc:654] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.878029 13841 consensus_queue.cc:260] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.880028 13842 tablet_bootstrap.cc:492] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030: No bootstrap required, opened a new log
I20260709 13:23:07.880865 13842 ts_tablet_manager.cc:1403] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.011s
I20260709 13:23:07.881371 13823 heartbeater.cc:499] Master 127.2.243.126:41175 was elected leader, sending a full tablet report...
I20260709 13:23:07.882000 13841 ts_tablet_manager.cc:1434] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:23:07.883026 13841 tablet_bootstrap.cc:492] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593: Bootstrap starting.
I20260709 13:23:07.885485 13842 raft_consensus.cc:359] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.886972 13842 raft_consensus.cc:385] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.887523 13842 raft_consensus.cc:740] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab17b4d6eca4a96a7f38875e85c6030, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.888763 13842 consensus_queue.cc:260] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.892799 13841 tablet_bootstrap.cc:654] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.899818 13842 ts_tablet_manager.cc:1434] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.012s
I20260709 13:23:07.903294 13674 heartbeater.cc:499] Master 127.2.243.126:41175 was elected leader, sending a full tablet report...
I20260709 13:23:07.905427 13842 tablet_bootstrap.cc:492] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030: Bootstrap starting.
I20260709 13:23:07.905690 13843 tablet_bootstrap.cc:492] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a: No bootstrap required, opened a new log
I20260709 13:23:07.906325 13843 ts_tablet_manager.cc:1403] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.014s
I20260709 13:23:07.909874 13843 raft_consensus.cc:359] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.910823 13843 raft_consensus.cc:385] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.911227 13843 raft_consensus.cc:740] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19bb05530b4455293b9a58ce563445a, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.912138 13843 consensus_queue.cc:260] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.916428 13841 tablet_bootstrap.cc:492] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593: No bootstrap required, opened a new log
I20260709 13:23:07.917129 13843 ts_tablet_manager.cc:1434] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.006s
I20260709 13:23:07.917906 13749 heartbeater.cc:499] Master 127.2.243.126:41175 was elected leader, sending a full tablet report...
I20260709 13:23:07.918452 13843 tablet_bootstrap.cc:492] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a: Bootstrap starting.
I20260709 13:23:07.919461 13842 tablet_bootstrap.cc:654] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.917168 13841 ts_tablet_manager.cc:1403] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.004s
I20260709 13:23:07.926869 13843 tablet_bootstrap.cc:654] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.928032 13841 raft_consensus.cc:359] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.929047 13841 raft_consensus.cc:385] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.929526 13841 raft_consensus.cc:740] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51dd8e094e14a75bd74f99dee559593, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.930929 13841 consensus_queue.cc:260] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.933706 13841 ts_tablet_manager.cc:1434] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:23:07.936094 13843 tablet_bootstrap.cc:492] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a: No bootstrap required, opened a new log
I20260709 13:23:07.936841 13843 ts_tablet_manager.cc:1403] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:23:07.937011 13842 tablet_bootstrap.cc:492] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030: No bootstrap required, opened a new log
I20260709 13:23:07.937637 13842 ts_tablet_manager.cc:1403] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 13:23:07.940896 13843 raft_consensus.cc:359] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.941238 13842 raft_consensus.cc:359] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.941922 13843 raft_consensus.cc:385] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.941982 13842 raft_consensus.cc:385] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.942404 13843 raft_consensus.cc:740] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19bb05530b4455293b9a58ce563445a, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.942505 13842 raft_consensus.cc:740] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab17b4d6eca4a96a7f38875e85c6030, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.943429 13842 consensus_queue.cc:260] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.943429 13843 consensus_queue.cc:260] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:07.946218 13842 ts_tablet_manager.cc:1434] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:07.946456 13843 ts_tablet_manager.cc:1434] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
W20260709 13:23:08.137120 13595 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:08.149257 13846 raft_consensus.cc:493] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.150105 13846 raft_consensus.cc:515] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.152830 13846 leader_election.cc:290] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65:36017), d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729)
I20260709 13:23:08.163851 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64fc0de553f649adb9e59c57dac8409e" candidate_uuid: "c51dd8e094e14a75bd74f99dee559593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" is_pre_election: true
I20260709 13:23:08.164798 13649 raft_consensus.cc:2468] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51dd8e094e14a75bd74f99dee559593 in term 0.
I20260709 13:23:08.166105 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64fc0de553f649adb9e59c57dac8409e" candidate_uuid: "c51dd8e094e14a75bd74f99dee559593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19bb05530b4455293b9a58ce563445a" is_pre_election: true
I20260709 13:23:08.166553 13763 leader_election.cc:304] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab17b4d6eca4a96a7f38875e85c6030, c51dd8e094e14a75bd74f99dee559593; no voters: 
I20260709 13:23:08.166942 13724 raft_consensus.cc:2468] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51dd8e094e14a75bd74f99dee559593 in term 0.
I20260709 13:23:08.167591 13846 raft_consensus.cc:2804] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:08.168565 13846 raft_consensus.cc:493] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:08.168972 13846 raft_consensus.cc:3060] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.176146 13846 raft_consensus.cc:515] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.178249 13846 leader_election.cc:290] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [CANDIDATE]: Term 1 election: Requested vote from peers 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65:36017), d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729)
I20260709 13:23:08.179625 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64fc0de553f649adb9e59c57dac8409e" candidate_uuid: "c51dd8e094e14a75bd74f99dee559593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
I20260709 13:23:08.179921 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64fc0de553f649adb9e59c57dac8409e" candidate_uuid: "c51dd8e094e14a75bd74f99dee559593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19bb05530b4455293b9a58ce563445a"
I20260709 13:23:08.180418 13649 raft_consensus.cc:3060] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.180828 13724 raft_consensus.cc:3060] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.189038 13724 raft_consensus.cc:2468] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51dd8e094e14a75bd74f99dee559593 in term 1.
I20260709 13:23:08.190479 13763 leader_election.cc:304] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51dd8e094e14a75bd74f99dee559593, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:08.190582 13649 raft_consensus.cc:2468] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51dd8e094e14a75bd74f99dee559593 in term 1.
I20260709 13:23:08.191257 13846 raft_consensus.cc:2804] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:08.192716 13846 raft_consensus.cc:697] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 1 LEADER]: Becoming Leader. State: Replica: c51dd8e094e14a75bd74f99dee559593, State: Running, Role: LEADER
I20260709 13:23:08.193789 13846 consensus_queue.cc:237] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.203876 13547 catalog_manager.cc:5697] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51dd8e094e14a75bd74f99dee559593 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "c51dd8e094e14a75bd74f99dee559593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:08.260113 13850 raft_consensus.cc:493] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.260815 13850 raft_consensus.cc:515] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.263226 13850 leader_election.cc:290] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65:36017), c51dd8e094e14a75bd74f99dee559593 (127.2.243.67:45177)
I20260709 13:23:08.276880 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891b5ee285441efba07041aa8ffeba5" candidate_uuid: "d19bb05530b4455293b9a58ce563445a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" is_pre_election: true
I20260709 13:23:08.277808 13649 raft_consensus.cc:2468] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19bb05530b4455293b9a58ce563445a in term 0.
I20260709 13:23:08.279109 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891b5ee285441efba07041aa8ffeba5" candidate_uuid: "d19bb05530b4455293b9a58ce563445a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51dd8e094e14a75bd74f99dee559593" is_pre_election: true
I20260709 13:23:08.279451 13689 leader_election.cc:304] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab17b4d6eca4a96a7f38875e85c6030, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:08.280015 13798 raft_consensus.cc:2468] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19bb05530b4455293b9a58ce563445a in term 0.
I20260709 13:23:08.280534 13850 raft_consensus.cc:2804] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:08.281047 13850 raft_consensus.cc:493] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:08.281316 13850 raft_consensus.cc:3060] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.289275 13850 raft_consensus.cc:515] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.292061 13850 leader_election.cc:290] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [CANDIDATE]: Term 1 election: Requested vote from peers 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65:36017), c51dd8e094e14a75bd74f99dee559593 (127.2.243.67:45177)
I20260709 13:23:08.293152 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891b5ee285441efba07041aa8ffeba5" candidate_uuid: "d19bb05530b4455293b9a58ce563445a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
I20260709 13:23:08.293900 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891b5ee285441efba07041aa8ffeba5" candidate_uuid: "d19bb05530b4455293b9a58ce563445a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51dd8e094e14a75bd74f99dee559593"
I20260709 13:23:08.293949 13649 raft_consensus.cc:3060] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.294809 13798 raft_consensus.cc:3060] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.301971 13649 raft_consensus.cc:2468] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19bb05530b4455293b9a58ce563445a in term 1.
I20260709 13:23:08.302274 13798 raft_consensus.cc:2468] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19bb05530b4455293b9a58ce563445a in term 1.
I20260709 13:23:08.303630 13689 leader_election.cc:304] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab17b4d6eca4a96a7f38875e85c6030, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:08.304603 13850 raft_consensus.cc:2804] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:08.305814 13850 raft_consensus.cc:697] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 1 LEADER]: Becoming Leader. State: Replica: d19bb05530b4455293b9a58ce563445a, State: Running, Role: LEADER
I20260709 13:23:08.306766 13850 consensus_queue.cc:237] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.315814 13547 catalog_manager.cc:5697] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a reported cstate change: term changed from 0 to 1, leader changed from <none> to d19bb05530b4455293b9a58ce563445a (127.2.243.66). New cstate: current_term: 1 leader_uuid: "d19bb05530b4455293b9a58ce563445a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:08.419088 13547 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39300:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:08.421476 13547 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:08.452766 13638 tablet_service.cc:1511] Processing CreateTablet for tablet 520f5913c12e49fcb11b52f2bd67e109 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0ef1b411e907453995b51f3ac0d697f5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:08.453832 13714 tablet_service.cc:1511] Processing CreateTablet for tablet 520f5913c12e49fcb11b52f2bd67e109 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0ef1b411e907453995b51f3ac0d697f5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:08.454422 13638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520f5913c12e49fcb11b52f2bd67e109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:08.455296 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520f5913c12e49fcb11b52f2bd67e109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:08.455685 13787 tablet_service.cc:1511] Processing CreateTablet for tablet 520f5913c12e49fcb11b52f2bd67e109 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0ef1b411e907453995b51f3ac0d697f5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:08.457226 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520f5913c12e49fcb11b52f2bd67e109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:08.463261 13713 tablet_service.cc:1511] Processing CreateTablet for tablet 228ee8e3d4674858bd8d01a04a6db446 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0ef1b411e907453995b51f3ac0d697f5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:08.463515 13639 tablet_service.cc:1511] Processing CreateTablet for tablet 228ee8e3d4674858bd8d01a04a6db446 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0ef1b411e907453995b51f3ac0d697f5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:08.465016 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228ee8e3d4674858bd8d01a04a6db446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:08.465085 13639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228ee8e3d4674858bd8d01a04a6db446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:08.469882 13788 tablet_service.cc:1511] Processing CreateTablet for tablet 228ee8e3d4674858bd8d01a04a6db446 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0ef1b411e907453995b51f3ac0d697f5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:08.472216 13788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228ee8e3d4674858bd8d01a04a6db446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:08.495761 13867 tablet_bootstrap.cc:492] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593: Bootstrap starting.
I20260709 13:23:08.504817 13867 tablet_bootstrap.cc:654] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.515718 13866 tablet_bootstrap.cc:492] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030: Bootstrap starting.
I20260709 13:23:08.519129 13867 tablet_bootstrap.cc:492] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593: No bootstrap required, opened a new log
I20260709 13:23:08.520009 13867 ts_tablet_manager.cc:1403] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.010s
I20260709 13:23:08.524165 13867 raft_consensus.cc:359] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.525628 13867 raft_consensus.cc:385] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.526070 13867 raft_consensus.cc:740] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51dd8e094e14a75bd74f99dee559593, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.529492 13866 tablet_bootstrap.cc:654] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.531716 13867 consensus_queue.cc:260] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.535439 13869 tablet_bootstrap.cc:492] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a: Bootstrap starting.
I20260709 13:23:08.544111 13867 ts_tablet_manager.cc:1434] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:23:08.546047 13867 tablet_bootstrap.cc:492] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593: Bootstrap starting.
I20260709 13:23:08.548254 13866 tablet_bootstrap.cc:492] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030: No bootstrap required, opened a new log
I20260709 13:23:08.548228 13869 tablet_bootstrap.cc:654] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.549350 13866 ts_tablet_manager.cc:1403] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.011s
I20260709 13:23:08.553880 13866 raft_consensus.cc:359] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.555184 13867 tablet_bootstrap.cc:654] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.555258 13866 raft_consensus.cc:385] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.557385 13866 raft_consensus.cc:740] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab17b4d6eca4a96a7f38875e85c6030, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.560262 13866 consensus_queue.cc:260] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.563522 13869 tablet_bootstrap.cc:492] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a: No bootstrap required, opened a new log
I20260709 13:23:08.564312 13867 tablet_bootstrap.cc:492] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593: No bootstrap required, opened a new log
I20260709 13:23:08.564518 13869 ts_tablet_manager.cc:1403] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a: Time spent bootstrapping tablet: real 0.029s	user 0.024s	sys 0.004s
I20260709 13:23:08.565408 13867 ts_tablet_manager.cc:1403] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 13:23:08.565480 13866 ts_tablet_manager.cc:1434] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.006s
I20260709 13:23:08.567132 13866 tablet_bootstrap.cc:492] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030: Bootstrap starting.
I20260709 13:23:08.569772 13867 raft_consensus.cc:359] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.570694 13867 raft_consensus.cc:385] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.571180 13867 raft_consensus.cc:740] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51dd8e094e14a75bd74f99dee559593, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.572299 13867 consensus_queue.cc:260] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.575093 13867 ts_tablet_manager.cc:1434] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.008s
I20260709 13:23:08.575881 13866 tablet_bootstrap.cc:654] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.577693 13869 raft_consensus.cc:359] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.578711 13869 raft_consensus.cc:385] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.579092 13869 raft_consensus.cc:740] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19bb05530b4455293b9a58ce563445a, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.580189 13869 consensus_queue.cc:260] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.583542 13869 ts_tablet_manager.cc:1434] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:23:08.585000 13866 tablet_bootstrap.cc:492] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030: No bootstrap required, opened a new log
I20260709 13:23:08.585178 13869 tablet_bootstrap.cc:492] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a: Bootstrap starting.
I20260709 13:23:08.585911 13866 ts_tablet_manager.cc:1403] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:23:08.589895 13866 raft_consensus.cc:359] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.591272 13866 raft_consensus.cc:385] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.591668 13866 raft_consensus.cc:740] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab17b4d6eca4a96a7f38875e85c6030, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.592824 13866 consensus_queue.cc:260] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.596859 13866 ts_tablet_manager.cc:1434] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
I20260709 13:23:08.597553 13869 tablet_bootstrap.cc:654] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.607779 13869 tablet_bootstrap.cc:492] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a: No bootstrap required, opened a new log
I20260709 13:23:08.608429 13869 ts_tablet_manager.cc:1403] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 13:23:08.611382 13869 raft_consensus.cc:359] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.612069 13869 raft_consensus.cc:385] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.612340 13869 raft_consensus.cc:740] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19bb05530b4455293b9a58ce563445a, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.613019 13869 consensus_queue.cc:260] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.615214 13869 ts_tablet_manager.cc:1434] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:23:08.671399 13873 raft_consensus.cc:493] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.672135 13873 raft_consensus.cc:515] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.674638 13873 leader_election.cc:290] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729), c51dd8e094e14a75bd74f99dee559593 (127.2.243.67:45177)
I20260709 13:23:08.688061 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ee8e3d4674858bd8d01a04a6db446" candidate_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19bb05530b4455293b9a58ce563445a" is_pre_election: true
I20260709 13:23:08.689116 13724 raft_consensus.cc:2468] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ab17b4d6eca4a96a7f38875e85c6030 in term 0.
I20260709 13:23:08.690048 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ee8e3d4674858bd8d01a04a6db446" candidate_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51dd8e094e14a75bd74f99dee559593" is_pre_election: true
I20260709 13:23:08.690645 13614 leader_election.cc:304] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab17b4d6eca4a96a7f38875e85c6030, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:08.691275 13798 raft_consensus.cc:2468] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ab17b4d6eca4a96a7f38875e85c6030 in term 0.
I20260709 13:23:08.691972 13873 raft_consensus.cc:2804] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:08.692442 13873 raft_consensus.cc:493] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:08.692832 13873 raft_consensus.cc:3060] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.697422 13846 consensus_queue.cc:1048] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:08.702113 13873 raft_consensus.cc:515] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.706593 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ee8e3d4674858bd8d01a04a6db446" candidate_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51dd8e094e14a75bd74f99dee559593"
I20260709 13:23:08.706700 13723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ee8e3d4674858bd8d01a04a6db446" candidate_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19bb05530b4455293b9a58ce563445a"
I20260709 13:23:08.707909 13798 raft_consensus.cc:3060] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.707998 13723 raft_consensus.cc:3060] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.712906 13873 leader_election.cc:290] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [CANDIDATE]: Term 1 election: Requested vote from peers d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729), c51dd8e094e14a75bd74f99dee559593 (127.2.243.67:45177)
I20260709 13:23:08.723224 13723 raft_consensus.cc:2468] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab17b4d6eca4a96a7f38875e85c6030 in term 1.
I20260709 13:23:08.726222 13798 raft_consensus.cc:2468] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab17b4d6eca4a96a7f38875e85c6030 in term 1.
I20260709 13:23:08.726091 13614 leader_election.cc:304] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab17b4d6eca4a96a7f38875e85c6030, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:08.730160 13873 raft_consensus.cc:2804] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:08.732824 13873 raft_consensus.cc:697] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 LEADER]: Becoming Leader. State: Replica: 8ab17b4d6eca4a96a7f38875e85c6030, State: Running, Role: LEADER
I20260709 13:23:08.733989 13873 consensus_queue.cc:237] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.740389 13846 raft_consensus.cc:493] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.743775 13850 consensus_queue.cc:1048] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:08.741402 13846 raft_consensus.cc:515] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.747066 13846 leader_election.cc:290] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65:36017), d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729)
I20260709 13:23:08.740216 13884 consensus_queue.cc:1048] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:23:08.748332 13546 catalog_manager.cc:5697] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65). New cstate: current_term: 1 leader_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:08.752545 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520f5913c12e49fcb11b52f2bd67e109" candidate_uuid: "c51dd8e094e14a75bd74f99dee559593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19bb05530b4455293b9a58ce563445a" is_pre_election: true
I20260709 13:23:08.749984 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520f5913c12e49fcb11b52f2bd67e109" candidate_uuid: "c51dd8e094e14a75bd74f99dee559593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" is_pre_election: true
I20260709 13:23:08.753769 13724 raft_consensus.cc:2468] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51dd8e094e14a75bd74f99dee559593 in term 0.
I20260709 13:23:08.754151 13649 raft_consensus.cc:2468] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51dd8e094e14a75bd74f99dee559593 in term 0.
I20260709 13:23:08.755702 13763 leader_election.cc:304] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51dd8e094e14a75bd74f99dee559593, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:08.758103 13880 raft_consensus.cc:2804] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:08.758623 13880 raft_consensus.cc:493] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:08.758991 13880 raft_consensus.cc:3060] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.771314 13880 raft_consensus.cc:515] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.776316 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520f5913c12e49fcb11b52f2bd67e109" candidate_uuid: "c51dd8e094e14a75bd74f99dee559593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
I20260709 13:23:08.777876 13647 raft_consensus.cc:3060] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.777951 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520f5913c12e49fcb11b52f2bd67e109" candidate_uuid: "c51dd8e094e14a75bd74f99dee559593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d19bb05530b4455293b9a58ce563445a"
I20260709 13:23:08.778787 13724 raft_consensus.cc:3060] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.787112 13858 consensus_queue.cc:1048] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:08.791859 13880 leader_election.cc:290] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [CANDIDATE]: Term 1 election: Requested vote from peers 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65:36017), d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729)
I20260709 13:23:08.791311 13724 raft_consensus.cc:2468] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51dd8e094e14a75bd74f99dee559593 in term 1.
I20260709 13:23:08.793867 13763 leader_election.cc:304] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51dd8e094e14a75bd74f99dee559593, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:08.795078 13880 raft_consensus.cc:2804] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:08.795920 13880 raft_consensus.cc:697] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 1 LEADER]: Becoming Leader. State: Replica: c51dd8e094e14a75bd74f99dee559593, State: Running, Role: LEADER
I20260709 13:23:08.797014 13880 consensus_queue.cc:237] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:08.805588 13647 raft_consensus.cc:2468] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51dd8e094e14a75bd74f99dee559593 in term 1.
I20260709 13:23:08.831271 13544 catalog_manager.cc:5697] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51dd8e094e14a75bd74f99dee559593 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "c51dd8e094e14a75bd74f99dee559593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:08.914755 13724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e891b5ee285441efba07041aa8ffeba5"
dest_uuid: "d19bb05530b4455293b9a58ce563445a"
mode: GRACEFUL
new_leader_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
 from {username='slave'} at 127.0.0.1:33396
I20260709 13:23:08.915438 13724 raft_consensus.cc:606] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 1 LEADER]: Received request to transfer leadership to TS 8ab17b4d6eca4a96a7f38875e85c6030
I20260709 13:23:08.939071 13798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "520f5913c12e49fcb11b52f2bd67e109"
dest_uuid: "c51dd8e094e14a75bd74f99dee559593"
mode: GRACEFUL
new_leader_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
 from {username='slave'} at 127.0.0.1:60316
I20260709 13:23:08.939765 13798 raft_consensus.cc:606] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 1 LEADER]: Received request to transfer leadership to TS 8ab17b4d6eca4a96a7f38875e85c6030
I20260709 13:23:09.214146 13858 raft_consensus.cc:993] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a: : Instructing follower 8ab17b4d6eca4a96a7f38875e85c6030 to start an election
I20260709 13:23:09.214736 13850 raft_consensus.cc:1081] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 1 LEADER]: Signalling peer 8ab17b4d6eca4a96a7f38875e85c6030 to start an election
I20260709 13:23:09.216639 13646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e891b5ee285441efba07041aa8ffeba5"
dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
 from {username='slave'} at 127.0.0.1:50860
I20260709 13:23:09.217268 13646 raft_consensus.cc:493] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:09.217553 13646 raft_consensus.cc:3060] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.225291 13646 raft_consensus.cc:515] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.227761 13646 leader_election.cc:290] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [CANDIDATE]: Term 2 election: Requested vote from peers d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729), c51dd8e094e14a75bd74f99dee559593 (127.2.243.67:45177)
I20260709 13:23:09.229293 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891b5ee285441efba07041aa8ffeba5" candidate_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51dd8e094e14a75bd74f99dee559593"
I20260709 13:23:09.229194 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891b5ee285441efba07041aa8ffeba5" candidate_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19bb05530b4455293b9a58ce563445a"
I20260709 13:23:09.230365 13798 raft_consensus.cc:3060] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.230398 13724 raft_consensus.cc:3055] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:09.231288 13724 raft_consensus.cc:740] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d19bb05530b4455293b9a58ce563445a, State: Running, Role: LEADER
I20260709 13:23:09.232261 13724 consensus_queue.cc:260] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.233764 13724 raft_consensus.cc:3060] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.237847 13798 raft_consensus.cc:2468] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab17b4d6eca4a96a7f38875e85c6030 in term 2.
I20260709 13:23:09.239452 13612 leader_election.cc:304] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab17b4d6eca4a96a7f38875e85c6030, c51dd8e094e14a75bd74f99dee559593; no voters: 
I20260709 13:23:09.240469 13873 raft_consensus.cc:2804] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:09.241803 13873 raft_consensus.cc:697] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 LEADER]: Becoming Leader. State: Replica: 8ab17b4d6eca4a96a7f38875e85c6030, State: Running, Role: LEADER
I20260709 13:23:09.241683 13724 raft_consensus.cc:2468] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab17b4d6eca4a96a7f38875e85c6030 in term 2.
I20260709 13:23:09.243084 13873 consensus_queue.cc:237] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.252293 13546 catalog_manager.cc:5697] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 reported cstate change: term changed from 1 to 2, leader changed from d19bb05530b4455293b9a58ce563445a (127.2.243.66) to 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:09.258334 13873 consensus_queue.cc:1048] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:09.282598 13873 consensus_queue.cc:1048] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:09.358469 13880 consensus_queue.cc:1048] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:09.367237 13884 raft_consensus.cc:993] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593: : Instructing follower 8ab17b4d6eca4a96a7f38875e85c6030 to start an election
I20260709 13:23:09.367897 13846 raft_consensus.cc:1081] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 1 LEADER]: Signalling peer 8ab17b4d6eca4a96a7f38875e85c6030 to start an election
I20260709 13:23:09.371886 13649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "520f5913c12e49fcb11b52f2bd67e109"
dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
 from {username='slave'} at 127.0.0.1:50854
I20260709 13:23:09.372589 13649 raft_consensus.cc:493] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:09.373306 13649 raft_consensus.cc:3060] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.375243 13846 consensus_queue.cc:1048] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:09.386185 13649 raft_consensus.cc:515] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.390620 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520f5913c12e49fcb11b52f2bd67e109" candidate_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d19bb05530b4455293b9a58ce563445a"
I20260709 13:23:09.391362 13724 raft_consensus.cc:3060] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.392565 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520f5913c12e49fcb11b52f2bd67e109" candidate_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51dd8e094e14a75bd74f99dee559593"
I20260709 13:23:09.393478 13798 raft_consensus.cc:3055] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:09.393879 13798 raft_consensus.cc:740] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51dd8e094e14a75bd74f99dee559593, State: Running, Role: LEADER
I20260709 13:23:09.394811 13798 consensus_queue.cc:260] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.395330 13649 leader_election.cc:290] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [CANDIDATE]: Term 2 election: Requested vote from peers d19bb05530b4455293b9a58ce563445a (127.2.243.66:37729), c51dd8e094e14a75bd74f99dee559593 (127.2.243.67:45177)
I20260709 13:23:09.396272 13798 raft_consensus.cc:3060] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.401782 13724 raft_consensus.cc:2468] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab17b4d6eca4a96a7f38875e85c6030 in term 2.
I20260709 13:23:09.403293 13614 leader_election.cc:304] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab17b4d6eca4a96a7f38875e85c6030, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:09.404281 13896 raft_consensus.cc:2804] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:09.404917 13896 raft_consensus.cc:697] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 LEADER]: Becoming Leader. State: Replica: 8ab17b4d6eca4a96a7f38875e85c6030, State: Running, Role: LEADER
I20260709 13:23:09.404964 13798 raft_consensus.cc:2468] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab17b4d6eca4a96a7f38875e85c6030 in term 2.
I20260709 13:23:09.406399 13896 consensus_queue.cc:237] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.415810 13547 catalog_manager.cc:5697] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 reported cstate change: term changed from 1 to 2, leader changed from c51dd8e094e14a75bd74f99dee559593 (127.2.243.67) to 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:09.480191  3021 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:23:09.482210  3021 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:23:09.482728  3021 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:23:09.497632 13649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "228ee8e3d4674858bd8d01a04a6db446"
dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
mode: GRACEFUL
new_leader_uuid: "d19bb05530b4455293b9a58ce563445a"
 from {username='slave'} at 127.0.0.1:50874
I20260709 13:23:09.498282 13649 raft_consensus.cc:606] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 LEADER]: Received request to transfer leadership to TS d19bb05530b4455293b9a58ce563445a
I20260709 13:23:09.499773  3021 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:23:09.708392 13798 raft_consensus.cc:1275] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Refusing update from remote peer 8ab17b4d6eca4a96a7f38875e85c6030: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:09.710256 13896 consensus_queue.cc:1048] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:09.720638 13724 raft_consensus.cc:1275] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Refusing update from remote peer 8ab17b4d6eca4a96a7f38875e85c6030: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:09.723526 13873 consensus_queue.cc:1048] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:09.732136 13873 raft_consensus.cc:993] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030: : Instructing follower d19bb05530b4455293b9a58ce563445a to start an election
I20260709 13:23:09.736256 13894 raft_consensus.cc:1081] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 LEADER]: Signalling peer d19bb05530b4455293b9a58ce563445a to start an election
I20260709 13:23:09.739143 13723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "228ee8e3d4674858bd8d01a04a6db446"
dest_uuid: "d19bb05530b4455293b9a58ce563445a"
 from {username='slave'} at 127.0.0.1:33394
I20260709 13:23:09.740041 13723 raft_consensus.cc:493] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:09.740513 13723 raft_consensus.cc:3060] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.750329 13723 raft_consensus.cc:515] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.752745 13723 leader_election.cc:290] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [CANDIDATE]: Term 2 election: Requested vote from peers 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65:36017), c51dd8e094e14a75bd74f99dee559593 (127.2.243.67:45177)
I20260709 13:23:09.753902 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ee8e3d4674858bd8d01a04a6db446" candidate_uuid: "d19bb05530b4455293b9a58ce563445a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ab17b4d6eca4a96a7f38875e85c6030"
I20260709 13:23:09.754081 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ee8e3d4674858bd8d01a04a6db446" candidate_uuid: "d19bb05530b4455293b9a58ce563445a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51dd8e094e14a75bd74f99dee559593"
I20260709 13:23:09.754796 13649 raft_consensus.cc:3055] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:09.754899 13798 raft_consensus.cc:3060] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.755182 13649 raft_consensus.cc:740] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ab17b4d6eca4a96a7f38875e85c6030, State: Running, Role: LEADER
I20260709 13:23:09.756175 13649 consensus_queue.cc:260] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.757529 13649 raft_consensus.cc:3060] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.762676 13798 raft_consensus.cc:2468] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19bb05530b4455293b9a58ce563445a in term 2.
I20260709 13:23:09.764856 13687 leader_election.cc:304] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51dd8e094e14a75bd74f99dee559593, d19bb05530b4455293b9a58ce563445a; no voters: 
I20260709 13:23:09.765187 13649 raft_consensus.cc:2468] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19bb05530b4455293b9a58ce563445a in term 2.
I20260709 13:23:09.765766 13850 raft_consensus.cc:2804] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:09.767169 13850 raft_consensus.cc:697] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 2 LEADER]: Becoming Leader. State: Replica: d19bb05530b4455293b9a58ce563445a, State: Running, Role: LEADER
I20260709 13:23:09.768306 13850 consensus_queue.cc:237] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } }
I20260709 13:23:09.775547 13547 catalog_manager.cc:5697] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a reported cstate change: term changed from 1 to 2, leader changed from 8ab17b4d6eca4a96a7f38875e85c6030 (127.2.243.65) to d19bb05530b4455293b9a58ce563445a (127.2.243.66). New cstate: current_term: 2 leader_uuid: "d19bb05530b4455293b9a58ce563445a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab17b4d6eca4a96a7f38875e85c6030" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d19bb05530b4455293b9a58ce563445a" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51dd8e094e14a75bd74f99dee559593" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 45177 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:09.890319  3021 tablet_server.cc:179] TabletServer@127.2.243.65:0 shutting down...
I20260709 13:23:09.915561  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:09.916420  3021 tablet_replica.cc:333] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030: stopping tablet replica
I20260709 13:23:09.917114  3021 raft_consensus.cc:2243] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.917640  3021 raft_consensus.cc:2272] T 228ee8e3d4674858bd8d01a04a6db446 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.920595  3021 tablet_replica.cc:333] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030: stopping tablet replica
I20260709 13:23:09.921252  3021 raft_consensus.cc:2243] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:09.922016  3021 pending_rounds.cc:70] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030: Trying to abort 1 pending ops.
I20260709 13:23:09.922252  3021 pending_rounds.cc:77] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639483021582336 op_type: NO_OP noop_request { }
I20260709 13:23:09.922610  3021 raft_consensus.cc:2889] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:09.922995  3021 raft_consensus.cc:2272] T 520f5913c12e49fcb11b52f2bd67e109 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.925976  3021 tablet_replica.cc:333] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030: stopping tablet replica
I20260709 13:23:09.926642  3021 raft_consensus.cc:2243] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.927165  3021 raft_consensus.cc:2272] T 64fc0de553f649adb9e59c57dac8409e P 8ab17b4d6eca4a96a7f38875e85c6030 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.929961  3021 tablet_replica.cc:333] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030: stopping tablet replica
I20260709 13:23:09.930662  3021 raft_consensus.cc:2243] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:09.931634  3021 raft_consensus.cc:2272] T e891b5ee285441efba07041aa8ffeba5 P 8ab17b4d6eca4a96a7f38875e85c6030 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.960036  3021 tablet_server.cc:196] TabletServer@127.2.243.65:0 shutdown complete.
I20260709 13:23:09.975759  3021 tablet_server.cc:179] TabletServer@127.2.243.66:0 shutting down...
I20260709 13:23:10.000804  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:10.001650  3021 tablet_replica.cc:333] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a: stopping tablet replica
I20260709 13:23:10.002465  3021 raft_consensus.cc:2243] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.003212  3021 pending_rounds.cc:70] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a: Trying to abort 1 pending ops.
I20260709 13:23:10.003412  3021 pending_rounds.cc:77] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639484500643840 op_type: NO_OP noop_request { }
I20260709 13:23:10.003674  3021 raft_consensus.cc:2889] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:10.003937  3021 raft_consensus.cc:2272] T 228ee8e3d4674858bd8d01a04a6db446 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.007269  3021 tablet_replica.cc:333] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a: stopping tablet replica
I20260709 13:23:10.007928  3021 raft_consensus.cc:2243] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.008534  3021 raft_consensus.cc:2272] T 520f5913c12e49fcb11b52f2bd67e109 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.011453  3021 tablet_replica.cc:333] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a: stopping tablet replica
I20260709 13:23:10.012697  3021 raft_consensus.cc:2243] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.013247  3021 raft_consensus.cc:2272] T e891b5ee285441efba07041aa8ffeba5 P d19bb05530b4455293b9a58ce563445a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.016156  3021 tablet_replica.cc:333] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a: stopping tablet replica
I20260709 13:23:10.016844  3021 raft_consensus.cc:2243] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.017298  3021 raft_consensus.cc:2272] T 64fc0de553f649adb9e59c57dac8409e P d19bb05530b4455293b9a58ce563445a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.043417  3021 tablet_server.cc:196] TabletServer@127.2.243.66:0 shutdown complete.
I20260709 13:23:10.060721  3021 tablet_server.cc:179] TabletServer@127.2.243.67:0 shutting down...
I20260709 13:23:10.089845  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:10.090734  3021 tablet_replica.cc:333] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593: stopping tablet replica
I20260709 13:23:10.126534  3021 raft_consensus.cc:2243] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.127761  3021 raft_consensus.cc:2272] T 228ee8e3d4674858bd8d01a04a6db446 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.132834  3021 tablet_replica.cc:333] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593: stopping tablet replica
I20260709 13:23:10.133831  3021 raft_consensus.cc:2243] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.134725  3021 raft_consensus.cc:2272] T 520f5913c12e49fcb11b52f2bd67e109 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.140619  3021 tablet_replica.cc:333] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593: stopping tablet replica
I20260709 13:23:10.141551  3021 raft_consensus.cc:2243] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.142369  3021 raft_consensus.cc:2272] T e891b5ee285441efba07041aa8ffeba5 P c51dd8e094e14a75bd74f99dee559593 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.146319  3021 tablet_replica.cc:333] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593: stopping tablet replica
I20260709 13:23:10.146898  3021 raft_consensus.cc:2243] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.148821  3021 raft_consensus.cc:2272] T 64fc0de553f649adb9e59c57dac8409e P c51dd8e094e14a75bd74f99dee559593 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.184484  3021 tablet_server.cc:196] TabletServer@127.2.243.67:0 shutdown complete.
I20260709 13:23:10.214155  3021 master.cc:562] Master@127.2.243.126:41175 shutting down...
I20260709 13:23:10.245857  3021 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.246850  3021 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.247225  3021 tablet_replica.cc:333] T 00000000000000000000000000000000 P ca4ac49925724e84900695ee5a526eb5: stopping tablet replica
I20260709 13:23:10.271997  3021 master.cc:584] Master@127.2.243.126:41175 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3394 ms)
[----------] 6 tests from LeaderRebalancerTest (341621 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:23:10.331455  3021 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.243.126:39909
I20260709 13:23:10.333017  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:10.340672 13906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:10.341637 13907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:10.343510 13909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:10.343839  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:10.344974  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:10.345180  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:10.345407  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603390345383 us; error 0 us; skew 500 ppm
I20260709 13:23:10.346228  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:10.349556  3021 webserver.cc:533] Webserver started at http://127.2.243.126:39925/ using document root <none> and password file <none>
I20260709 13:23:10.350181  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:10.350405  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:10.350761  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:10.352314  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/master-0-root/instance:
uuid: "0154e0f52e0d401593c0fb7434671c61"
format_stamp: "Formatted at 2026-07-09 13:23:10 on dist-test-slave-ftjc"
I20260709 13:23:10.358146  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:10.363116 13914 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:10.364246  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:23:10.364638  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/master-0-root
uuid: "0154e0f52e0d401593c0fb7434671c61"
format_stamp: "Formatted at 2026-07-09 13:23:10 on dist-test-slave-ftjc"
I20260709 13:23:10.364934  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:10.385834  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:10.387557  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:10.440193  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.126:39909
I20260709 13:23:10.440322 13965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.126:39909 every 8 connection(s)
I20260709 13:23:10.445511 13966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:10.464426 13966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61: Bootstrap starting.
I20260709 13:23:10.470849 13966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:10.476934 13966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61: No bootstrap required, opened a new log
I20260709 13:23:10.479902 13966 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0154e0f52e0d401593c0fb7434671c61" member_type: VOTER }
I20260709 13:23:10.480454 13966 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:10.480659 13966 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0154e0f52e0d401593c0fb7434671c61, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.481379 13966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0154e0f52e0d401593c0fb7434671c61" member_type: VOTER }
I20260709 13:23:10.481899 13966 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:10.482115 13966 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:10.482344 13966 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:10.488415 13966 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0154e0f52e0d401593c0fb7434671c61" member_type: VOTER }
I20260709 13:23:10.489092 13966 leader_election.cc:304] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0154e0f52e0d401593c0fb7434671c61; no voters: 
I20260709 13:23:10.490424 13966 leader_election.cc:290] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:10.491007 13969 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:10.493148 13969 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 1 LEADER]: Becoming Leader. State: Replica: 0154e0f52e0d401593c0fb7434671c61, State: Running, Role: LEADER
I20260709 13:23:10.494112 13969 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0154e0f52e0d401593c0fb7434671c61" member_type: VOTER }
I20260709 13:23:10.494457 13966 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:10.498190 13970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0154e0f52e0d401593c0fb7434671c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0154e0f52e0d401593c0fb7434671c61" member_type: VOTER } }
I20260709 13:23:10.498190 13971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0154e0f52e0d401593c0fb7434671c61. Latest consensus state: current_term: 1 leader_uuid: "0154e0f52e0d401593c0fb7434671c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0154e0f52e0d401593c0fb7434671c61" member_type: VOTER } }
I20260709 13:23:10.499042 13970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:10.499176 13971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:10.507005 13974 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:10.513522 13974 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:10.515354  3021 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:10.525000 13974 catalog_manager.cc:1383] Generated new cluster ID: fca79d5da4c94fc0b9901c46b1928a97
I20260709 13:23:10.525382 13974 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:10.546168 13974 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:10.548235 13974 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:10.567487 13974 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61: Generated new TSK 0
I20260709 13:23:10.568464 13974 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:10.582906  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:10.591323 13987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:10.592828 13988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:10.595773  3021 server_base.cc:1061] running on GCE node
W20260709 13:23:10.596231 13990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:10.597647  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:10.597891  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:10.598033  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603390598019 us; error 0 us; skew 500 ppm
I20260709 13:23:10.598642  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:10.601692  3021 webserver.cc:533] Webserver started at http://127.2.243.65:43555/ using document root <none> and password file <none>
I20260709 13:23:10.602250  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:10.602432  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:10.602665  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:10.604306  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-0-root/instance:
uuid: "b662c9fb95644b5bb159e204db929836"
format_stamp: "Formatted at 2026-07-09 13:23:10 on dist-test-slave-ftjc"
I20260709 13:23:10.610280  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:23:10.615092 13995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:10.616182  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:23:10.616698  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "b662c9fb95644b5bb159e204db929836"
format_stamp: "Formatted at 2026-07-09 13:23:10 on dist-test-slave-ftjc"
I20260709 13:23:10.617026  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:10.653689  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:10.655263  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:10.657330  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:10.660202  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:10.660566  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:23:10.660874  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:10.661058  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:10.720207  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:37973
I20260709 13:23:10.720314 14057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:37973 every 8 connection(s)
I20260709 13:23:10.727079  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:10.737546 14062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:10.741156 14063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:10.741936 14065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:10.742316  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:10.744668  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:10.744946  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:10.745225  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603390745199 us; error 0 us; skew 500 ppm
I20260709 13:23:10.745595 14058 heartbeater.cc:344] Connected to a master server at 127.2.243.126:39909
I20260709 13:23:10.746145  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:10.746145 14058 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:10.748152 14058 heartbeater.cc:507] Master 127.2.243.126:39909 requested a full tablet report, sending...
I20260709 13:23:10.751168  3021 webserver.cc:533] Webserver started at http://127.2.243.66:46337/ using document root <none> and password file <none>
I20260709 13:23:10.751453 13931 ts_manager.cc:194] Registered new tserver with Master: b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973)
I20260709 13:23:10.752013  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:10.752388  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:10.752723  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:10.753938 13931 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47024
I20260709 13:23:10.754274  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-1-root/instance:
uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
format_stamp: "Formatted at 2026-07-09 13:23:10 on dist-test-slave-ftjc"
I20260709 13:23:10.761350  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:10.766368 14070 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:10.768078  3021 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:23:10.768702  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-1-root
uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
format_stamp: "Formatted at 2026-07-09 13:23:10 on dist-test-slave-ftjc"
I20260709 13:23:10.769182  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:10.793138  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:10.795199  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:10.797236  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:10.800257  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:10.800537  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:23:10.800935  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:10.801090  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:10.860458  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.66:39281
I20260709 13:23:10.860524 14133 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.66:39281 every 8 connection(s)
I20260709 13:23:10.867930  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:10.878463 14137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:10.881547 14138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:10.887540 14134 heartbeater.cc:344] Connected to a master server at 127.2.243.126:39909
I20260709 13:23:10.888285 14134 heartbeater.cc:461] Registering TS with master...
W20260709 13:23:10.888259 14140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:10.888605  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:10.889833 14134 heartbeater.cc:507] Master 127.2.243.126:39909 requested a full tablet report, sending...
I20260709 13:23:10.889991  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:10.890421  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:10.890632  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603390890614 us; error 0 us; skew 500 ppm
I20260709 13:23:10.891563  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:10.893558 13931 ts_manager.cc:194] Registered new tserver with Master: a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:10.895489  3021 webserver.cc:533] Webserver started at http://127.2.243.67:45481/ using document root <none> and password file <none>
I20260709 13:23:10.896201 13931 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47032
I20260709 13:23:10.896459  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:10.896827  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:10.897197  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:10.899320  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-2-root/instance:
uuid: "db886523de6f4dd0b7d366f5276de514"
format_stamp: "Formatted at 2026-07-09 13:23:10 on dist-test-slave-ftjc"
I20260709 13:23:10.905689  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:23:10.910509 14145 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:10.911808  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:23:10.912261  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-2-root
uuid: "db886523de6f4dd0b7d366f5276de514"
format_stamp: "Formatted at 2026-07-09 13:23:10 on dist-test-slave-ftjc"
I20260709 13:23:10.912663  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603048513324-3021-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:10.926550  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:10.928102  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:10.930083  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:10.933308  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:10.933706  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:10.934013  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:10.934226  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:10.993494  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.67:40631
I20260709 13:23:10.993606 14207 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.67:40631 every 8 connection(s)
I20260709 13:23:11.011705 14208 heartbeater.cc:344] Connected to a master server at 127.2.243.126:39909
I20260709 13:23:11.012202 14208 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:11.013211 14208 heartbeater.cc:507] Master 127.2.243.126:39909 requested a full tablet report, sending...
I20260709 13:23:11.016183 13931 ts_manager.cc:194] Registered new tserver with Master: db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.016422  3021 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018963474s
I20260709 13:23:11.017978 13931 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47044
I20260709 13:23:11.050676 13931 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47060:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:11.054630 13931 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:11.148501 14023 tablet_service.cc:1511] Processing CreateTablet for tablet eb1f2a2970624c2781536ca8d63094fd (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:11.150846 14023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1f2a2970624c2781536ca8d63094fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.153777 14022 tablet_service.cc:1511] Processing CreateTablet for tablet 458e21aa52ba48889d4f90a877289f5b (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:11.154222 14097 tablet_service.cc:1511] Processing CreateTablet for tablet 458e21aa52ba48889d4f90a877289f5b (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:11.154672 14098 tablet_service.cc:1511] Processing CreateTablet for tablet eb1f2a2970624c2781536ca8d63094fd (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:11.155720 14022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458e21aa52ba48889d4f90a877289f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.156248 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458e21aa52ba48889d4f90a877289f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.157878 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 24c0c04ede294e58a16689d3caf7caa5 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:11.157882 14095 tablet_service.cc:1511] Processing CreateTablet for tablet a9e0aefcfd114f658f43a25a0b39c7f1 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:11.161562 14020 tablet_service.cc:1511] Processing CreateTablet for tablet a9e0aefcfd114f658f43a25a0b39c7f1 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:11.163987 14020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e0aefcfd114f658f43a25a0b39c7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.157811 14021 tablet_service.cc:1511] Processing CreateTablet for tablet 24c0c04ede294e58a16689d3caf7caa5 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:11.165722 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c0c04ede294e58a16689d3caf7caa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.166136 14094 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee7c427864c4187a85097099bd95ab5 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:11.158599 14098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1f2a2970624c2781536ca8d63094fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.167842 14019 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee7c427864c4187a85097099bd95ab5 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:11.168970 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e0aefcfd114f658f43a25a0b39c7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.169492 14019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee7c427864c4187a85097099bd95ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.171456 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee7c427864c4187a85097099bd95ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.173894 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c0c04ede294e58a16689d3caf7caa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.175185 14093 tablet_service.cc:1511] Processing CreateTablet for tablet 52e8dc4c3b70438c9f6bea36cb52d951 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:11.187234 14018 tablet_service.cc:1511] Processing CreateTablet for tablet 52e8dc4c3b70438c9f6bea36cb52d951 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:11.194778 14018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e8dc4c3b70438c9f6bea36cb52d951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.197088 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e8dc4c3b70438c9f6bea36cb52d951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.207907 14017 tablet_service.cc:1511] Processing CreateTablet for tablet 65ab465ed9a74b04a7fa5d843d888abc (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:11.210440 14017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ab465ed9a74b04a7fa5d843d888abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.211073 14173 tablet_service.cc:1511] Processing CreateTablet for tablet eb1f2a2970624c2781536ca8d63094fd (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:11.213204 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1f2a2970624c2781536ca8d63094fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.214257 14092 tablet_service.cc:1511] Processing CreateTablet for tablet 65ab465ed9a74b04a7fa5d843d888abc (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:11.216411 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ab465ed9a74b04a7fa5d843d888abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.221616 14016 tablet_service.cc:1511] Processing CreateTablet for tablet 238f1767354e4e6a85680d8362f770eb (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:11.223474 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238f1767354e4e6a85680d8362f770eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.226735 14091 tablet_service.cc:1511] Processing CreateTablet for tablet 238f1767354e4e6a85680d8362f770eb (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:11.229508 14091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238f1767354e4e6a85680d8362f770eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.240104 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 458e21aa52ba48889d4f90a877289f5b (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:11.242655 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458e21aa52ba48889d4f90a877289f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.265609 14015 tablet_service.cc:1511] Processing CreateTablet for tablet 98d12d39c60e4af992a9477a7b5f7349 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:11.268122 14015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d12d39c60e4af992a9477a7b5f7349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.268379 14090 tablet_service.cc:1511] Processing CreateTablet for tablet 98d12d39c60e4af992a9477a7b5f7349 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:11.271955 14090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d12d39c60e4af992a9477a7b5f7349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.278306 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 24c0c04ede294e58a16689d3caf7caa5 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:11.284657 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c0c04ede294e58a16689d3caf7caa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.290803 14170 tablet_service.cc:1511] Processing CreateTablet for tablet a9e0aefcfd114f658f43a25a0b39c7f1 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:11.292752 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e0aefcfd114f658f43a25a0b39c7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.298880 14169 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee7c427864c4187a85097099bd95ab5 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:11.300907 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee7c427864c4187a85097099bd95ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.306922 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 52e8dc4c3b70438c9f6bea36cb52d951 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:11.309188 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e8dc4c3b70438c9f6bea36cb52d951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.353197 14167 tablet_service.cc:1511] Processing CreateTablet for tablet 65ab465ed9a74b04a7fa5d843d888abc (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:11.355209 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ab465ed9a74b04a7fa5d843d888abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.358362 14166 tablet_service.cc:1511] Processing CreateTablet for tablet 238f1767354e4e6a85680d8362f770eb (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:11.362036 14165 tablet_service.cc:1511] Processing CreateTablet for tablet 98d12d39c60e4af992a9477a7b5f7349 (DEFAULT_TABLE table=test-workload [id=a3ae2a16a7af41a79f63a2203aa610cc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:11.363590 14166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238f1767354e4e6a85680d8362f770eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.369765 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d12d39c60e4af992a9477a7b5f7349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:11.398247 14226 tablet_bootstrap.cc:492] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:11.429524 14225 tablet_bootstrap.cc:492] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:11.467633 14226 tablet_bootstrap.cc:654] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.483209 14225 tablet_bootstrap.cc:654] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.496975 14227 tablet_bootstrap.cc:492] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:11.502135 14226 tablet_bootstrap.cc:492] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:11.502942 14226 ts_tablet_manager.cc:1403] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.105s	user 0.023s	sys 0.017s
I20260709 13:23:11.508124 14226 raft_consensus.cc:359] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.509158 14226 raft_consensus.cc:385] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.509625 14226 raft_consensus.cc:740] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
W20260709 13:23:11.510533 13979 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:11.512758 14225 tablet_bootstrap.cc:492] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:11.512207 14226 consensus_queue.cc:260] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.513455 14225 ts_tablet_manager.cc:1403] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.006s
I20260709 13:23:11.515676 14208 heartbeater.cc:499] Master 127.2.243.126:39909 was elected leader, sending a full tablet report...
I20260709 13:23:11.516268 14226 ts_tablet_manager.cc:1434] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.013s	user 0.013s	sys 0.000s
I20260709 13:23:11.516628 14227 tablet_bootstrap.cc:654] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.517563 14226 tablet_bootstrap.cc:492] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:11.517215 14225 raft_consensus.cc:359] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.518061 14225 raft_consensus.cc:385] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.518379 14225 raft_consensus.cc:740] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.519472 14225 consensus_queue.cc:260] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.528327 14225 ts_tablet_manager.cc:1434] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:23:11.529179 14226 tablet_bootstrap.cc:654] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.529837 14058 heartbeater.cc:499] Master 127.2.243.126:39909 was elected leader, sending a full tablet report...
I20260709 13:23:11.530531 14225 tablet_bootstrap.cc:492] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:11.541270 14225 tablet_bootstrap.cc:654] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.546397 14227 tablet_bootstrap.cc:492] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:11.547375 14227 ts_tablet_manager.cc:1403] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.016s
I20260709 13:23:11.552595 14227 raft_consensus.cc:359] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.553494 14227 raft_consensus.cc:385] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.553824 14227 raft_consensus.cc:740] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.554643 14226 tablet_bootstrap.cc:492] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:11.554821 14225 tablet_bootstrap.cc:492] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:11.555239 14227 consensus_queue.cc:260] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.555727 14225 ts_tablet_manager.cc:1403] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:23:11.555646 14226 ts_tablet_manager.cc:1403] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.011s
I20260709 13:23:11.559994 14226 raft_consensus.cc:359] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.561030 14226 raft_consensus.cc:385] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.561983 14226 raft_consensus.cc:740] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.561023 14225 raft_consensus.cc:359] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.562664 14225 raft_consensus.cc:385] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.563134 14225 raft_consensus.cc:740] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.563338 14226 consensus_queue.cc:260] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.564908 14225 consensus_queue.cc:260] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.567245 14226 ts_tablet_manager.cc:1434] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:23:11.568787 14226 tablet_bootstrap.cc:492] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:11.568781 14227 ts_tablet_manager.cc:1434] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.012s
I20260709 13:23:11.569581 14225 ts_tablet_manager.cc:1434] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.013s	user 0.014s	sys 0.000s
I20260709 13:23:11.570675 14225 tablet_bootstrap.cc:492] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:11.571518 14134 heartbeater.cc:499] Master 127.2.243.126:39909 was elected leader, sending a full tablet report...
I20260709 13:23:11.578161 14226 tablet_bootstrap.cc:654] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.578562 14225 tablet_bootstrap.cc:654] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.578965 14227 tablet_bootstrap.cc:492] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:11.588896 14225 tablet_bootstrap.cc:492] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:11.589481 14227 tablet_bootstrap.cc:654] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.589674 14225 ts_tablet_manager.cc:1403] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 13:23:11.593788 14225 raft_consensus.cc:359] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.594903 14225 raft_consensus.cc:385] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.595328 14225 raft_consensus.cc:740] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.599216 14225 consensus_queue.cc:260] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.600714 14226 tablet_bootstrap.cc:492] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:11.601387 14226 ts_tablet_manager.cc:1403] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.017s
I20260709 13:23:11.605628 14226 raft_consensus.cc:359] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.606580 14226 raft_consensus.cc:385] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.606897 14225 ts_tablet_manager.cc:1434] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:23:11.607440 14226 raft_consensus.cc:740] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.608901 14225 tablet_bootstrap.cc:492] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:11.608932 14226 consensus_queue.cc:260] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.612510 14226 ts_tablet_manager.cc:1434] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.006s
I20260709 13:23:11.614674 14226 tablet_bootstrap.cc:492] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:11.625012 14227 tablet_bootstrap.cc:492] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:11.625907 14227 ts_tablet_manager.cc:1403] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.019s
I20260709 13:23:11.627082 14225 tablet_bootstrap.cc:654] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.630234 14226 tablet_bootstrap.cc:654] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.633759 14227 raft_consensus.cc:359] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.635143 14227 raft_consensus.cc:385] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.635723 14227 raft_consensus.cc:740] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.636909 14227 consensus_queue.cc:260] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.639847 14227 ts_tablet_manager.cc:1434] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:23:11.641402 14227 tablet_bootstrap.cc:492] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:11.641961 14225 tablet_bootstrap.cc:492] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:11.642643 14225 ts_tablet_manager.cc:1403] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.014s
I20260709 13:23:11.642866 14226 tablet_bootstrap.cc:492] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:11.643501 14226 ts_tablet_manager.cc:1403] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.007s
I20260709 13:23:11.651585 14226 raft_consensus.cc:359] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.652472 14226 raft_consensus.cc:385] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.648485 14225 raft_consensus.cc:359] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.653017 14226 raft_consensus.cc:740] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.653278 14225 raft_consensus.cc:385] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.653743 14225 raft_consensus.cc:740] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.654893 14225 consensus_queue.cc:260] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.656380 14227 tablet_bootstrap.cc:654] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.654529 14226 consensus_queue.cc:260] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.657536 14225 ts_tablet_manager.cc:1434] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:23:11.659147 14225 tablet_bootstrap.cc:492] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:11.659200 14226 ts_tablet_manager.cc:1434] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:23:11.660753 14226 tablet_bootstrap.cc:492] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:11.664481 14235 raft_consensus.cc:493] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:11.665380 14235 raft_consensus.cc:515] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.668044 14225 tablet_bootstrap.cc:654] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.670959 14230 raft_consensus.cc:493] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:11.671995 14230 raft_consensus.cc:515] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.682601 14225 tablet_bootstrap.cc:492] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:11.683357 14225 ts_tablet_manager.cc:1403] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 13:23:11.689927 14232 raft_consensus.cc:493] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:11.690665 14232 raft_consensus.cc:515] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.694222 14230 leader_election.cc:290] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:11.701962 14235 leader_election.cc:290] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.703069 14232 leader_election.cc:290] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.687670 14225 raft_consensus.cc:359] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.708113 14225 raft_consensus.cc:385] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.708673 14225 raft_consensus.cc:740] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.716084 14225 consensus_queue.cc:260] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.725359 14225 ts_tablet_manager.cc:1434] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:23:11.734548 14226 tablet_bootstrap.cc:654] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.744472 14225 tablet_bootstrap.cc:492] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:11.749344 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:11.750778 14183 raft_consensus.cc:2468] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:11.752872 14072 leader_election.cc:304] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:11.754226 14235 raft_consensus.cc:2804] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:11.754680 14235 raft_consensus.cc:493] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:11.755039 14235 raft_consensus.cc:3060] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:11.758538 14225 tablet_bootstrap.cc:654] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.758761 14227 tablet_bootstrap.cc:492] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:11.759534 14227 ts_tablet_manager.cc:1403] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.118s	user 0.037s	sys 0.042s
I20260709 13:23:11.766387 14227 raft_consensus.cc:359] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.770304 14227 raft_consensus.cc:385] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.772008 14227 raft_consensus.cc:740] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.773353 14227 consensus_queue.cc:260] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.776636 14230 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:11.777732 14230 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.781230 14232 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:11.782061 14232 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.787487 14232 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.789971 14230 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:11.784118 14235 raft_consensus.cc:515] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.798090 14256 raft_consensus.cc:493] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:11.799126 14227 ts_tablet_manager.cc:1434] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.013s
I20260709 13:23:11.798871 14256 raft_consensus.cc:515] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.800534 14227 tablet_bootstrap.cc:492] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:11.804426 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:11.808096 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:11.809178 14182 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 0.
I20260709 13:23:11.810827 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:11.811067 13997 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:11.811946 14032 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:11.813988 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:11.814884 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:11.816006 14232 raft_consensus.cc:2804] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:11.816428 14227 tablet_bootstrap.cc:654] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.817018 14148 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
W20260709 13:23:11.817443 14073 leader_election.cc:343] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:11.818457 14148 leader_election.cc:343] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.820075 14232 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:11.819563 14230 raft_consensus.cc:2804] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:11.821244 14232 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:11.821282 14230 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:11.822352 14230 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:11.821798 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f2a2970624c2781536ca8d63094fd" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
W20260709 13:23:11.821890 14073 leader_election.cc:343] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.826483 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0aefcfd114f658f43a25a0b39c7f1" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:11.827337 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:11.828042 14182 raft_consensus.cc:3060] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:11.828524 14032 raft_consensus.cc:2468] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:11.824935 14235 leader_election.cc:290] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.835860 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0aefcfd114f658f43a25a0b39c7f1" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:11.846745 14181 raft_consensus.cc:2468] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
W20260709 13:23:11.837478 13997 leader_election.cc:343] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.847420 14230 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.848623 14072 leader_election.cc:304] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:11.850898 14235 raft_consensus.cc:2804] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:11.851498 14235 raft_consensus.cc:493] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:11.851720 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:11.851967 14235 raft_consensus.cc:3060] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:11.857275 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f2a2970624c2781536ca8d63094fd" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:11.858533 14109 raft_consensus.cc:2468] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 0.
I20260709 13:23:11.824455 14256 leader_election.cc:290] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.861651 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:11.863387 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:11.864319 13998 leader_election.cc:304] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: db886523de6f4dd0b7d366f5276de514
I20260709 13:23:11.864881 14182 raft_consensus.cc:2468] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:11.865183 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
W20260709 13:23:11.866937 14148 leader_election.cc:343] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:11.871615 14148 leader_election.cc:343] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.871742 14072 leader_election.cc:304] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: b662c9fb95644b5bb159e204db929836
I20260709 13:23:11.860332 14230 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:11.861681 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:11.874315 14256 raft_consensus.cc:2804] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:11.877349 14226 tablet_bootstrap.cc:492] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:11.877257 14232 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
W20260709 13:23:11.878723 13998 leader_election.cc:343] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.877351 14225 tablet_bootstrap.cc:492] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:11.882407 14227 tablet_bootstrap.cc:492] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:11.881791 14032 raft_consensus.cc:2393] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate db886523de6f4dd0b7d366f5276de514 in current term 1: Already voted for candidate b662c9fb95644b5bb159e204db929836 in this term.
I20260709 13:23:11.883090 14232 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.884122 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:11.882185 14226 ts_tablet_manager.cc:1403] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.017s
I20260709 13:23:11.881507 14259 raft_consensus.cc:2804] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:11.886165 14259 raft_consensus.cc:493] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:11.886659 14259 raft_consensus.cc:3060] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:11.887126 13998 leader_election.cc:343] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.889248 14226 raft_consensus.cc:359] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.890143 14226 raft_consensus.cc:385] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.890437 14226 raft_consensus.cc:740] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.890631 14148 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db886523de6f4dd0b7d366f5276de514; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836
I20260709 13:23:11.884657 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:11.880910 14256 raft_consensus.cc:697] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:11.891952 14230 raft_consensus.cc:2749] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:11.891734 14226 consensus_queue.cc:260] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.892728 14227 ts_tablet_manager.cc:1403] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.026s
I20260709 13:23:11.893795 14182 raft_consensus.cc:2393] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b662c9fb95644b5bb159e204db929836 in current term 1: Already voted for candidate db886523de6f4dd0b7d366f5276de514 in this term.
I20260709 13:23:11.897675 13997 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662c9fb95644b5bb159e204db929836; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514
I20260709 13:23:11.897858 14227 raft_consensus.cc:359] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.898751 14227 raft_consensus.cc:385] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.899055 14227 raft_consensus.cc:740] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.899247 14230 raft_consensus.cc:493] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:11.883123 14235 raft_consensus.cc:515] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.899855 14230 raft_consensus.cc:515] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.902099 14230 leader_election.cc:290] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:11.904129 14256 consensus_queue.cc:237] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.904870 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:11.905717 14032 raft_consensus.cc:2468] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:11.905942 14232 raft_consensus.cc:2749] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:11.907140 14148 leader_election.cc:304] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:11.908779 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:11.885236 14225 ts_tablet_manager.cc:1403] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.141s	user 0.021s	sys 0.021s
I20260709 13:23:11.909396 14227 consensus_queue.cc:260] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.908931 14230 raft_consensus.cc:2804] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:11.910933 14230 raft_consensus.cc:493] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:11.911374 14230 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:11.911870 14148 leader_election.cc:343] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.912505 14227 ts_tablet_manager.cc:1434] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.002s
I20260709 13:23:11.912941 14235 leader_election.cc:290] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.916205 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0aefcfd114f658f43a25a0b39c7f1" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:11.916553 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0aefcfd114f658f43a25a0b39c7f1" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:11.917052 14032 raft_consensus.cc:3060] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:11.917841 14182 raft_consensus.cc:3060] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:11.924706 14225 raft_consensus.cc:359] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.925832 14225 raft_consensus.cc:385] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:11.926185 14225 raft_consensus.cc:740] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.915601 14227 tablet_bootstrap.cc:492] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:11.928176 14032 raft_consensus.cc:2468] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:11.930132 14230 raft_consensus.cc:515] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.936779 14073 leader_election.cc:304] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:11.937947 14235 raft_consensus.cc:2804] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:11.938491 14235 raft_consensus.cc:697] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:11.934873 14232 raft_consensus.cc:493] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:11.939361 14232 raft_consensus.cc:515] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.939538 14235 consensus_queue.cc:237] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.941195 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:11.942178 14031 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:11.934995 14182 raft_consensus.cc:2468] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:11.944763 14232 leader_election.cc:290] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:11.933146 14225 consensus_queue.cc:260] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.947185 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d12d39c60e4af992a9477a7b5f7349" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:11.950589 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d12d39c60e4af992a9477a7b5f7349" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
W20260709 13:23:11.957852 13998 leader_election.cc:343] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.962509 14225 ts_tablet_manager.cc:1434] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.003s
I20260709 13:23:11.958177 14227 tablet_bootstrap.cc:654] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:11.958683 14148 leader_election.cc:304] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db886523de6f4dd0b7d366f5276de514; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836
W20260709 13:23:11.962915 13997 leader_election.cc:343] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.955892 13931 catalog_manager.cc:5697] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:11.963899 14225 tablet_bootstrap.cc:492] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:11.963707 13997 leader_election.cc:304] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662c9fb95644b5bb159e204db929836; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514
I20260709 13:23:11.966720 14232 raft_consensus.cc:2749] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:11.970630 14230 leader_election.cc:290] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:11.971676 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:11.972024 14230 raft_consensus.cc:2749] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:23:11.974565 14148 leader_election.cc:343] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:11.978243 14031 raft_consensus.cc:2468] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:11.980824 14148 leader_election.cc:304] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e
I20260709 13:23:11.987640 14230 raft_consensus.cc:2804] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:11.988744 14230 raft_consensus.cc:697] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:11.990329 14230 consensus_queue.cc:237] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:11.993563 14226 ts_tablet_manager.cc:1434] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.108s	user 0.052s	sys 0.054s
I20260709 13:23:11.995590 14226 tablet_bootstrap.cc:492] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:11.996093 14259 raft_consensus.cc:515] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.009567 14226 tablet_bootstrap.cc:654] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.013155 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f2a2970624c2781536ca8d63094fd" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:12.014456 14106 raft_consensus.cc:3060] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.025175 14227 tablet_bootstrap.cc:492] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:12.024686 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f2a2970624c2781536ca8d63094fd" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:12.025933 14227 ts_tablet_manager.cc:1403] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.036s
W20260709 13:23:12.027942 13997 leader_election.cc:343] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:12.029043 14259 leader_election.cc:290] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.030076 14227 raft_consensus.cc:359] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.031087 14227 raft_consensus.cc:385] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.031415 14227 raft_consensus.cc:740] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.032879 14225 tablet_bootstrap.cc:654] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.032383 14227 consensus_queue.cc:260] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.035463 14227 ts_tablet_manager.cc:1434] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:23:12.036787 14227 tablet_bootstrap.cc:492] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:12.047041 14227 tablet_bootstrap.cc:654] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.049530 13928 catalog_manager.cc:5697] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 0 to 1, leader changed from <none> to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:12.027791 14106 raft_consensus.cc:2468] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 1.
I20260709 13:23:12.055719 13998 leader_election.cc:304] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: db886523de6f4dd0b7d366f5276de514
I20260709 13:23:12.058362 14226 tablet_bootstrap.cc:492] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:12.059280 14226 ts_tablet_manager.cc:1403] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.064s	user 0.031s	sys 0.024s
I20260709 13:23:12.059791 14227 tablet_bootstrap.cc:492] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:12.060417 14227 ts_tablet_manager.cc:1403] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.011s
I20260709 13:23:12.060559 14259 raft_consensus.cc:2804] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:12.061185 14259 raft_consensus.cc:697] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:12.062171 14259 consensus_queue.cc:237] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.063987 14227 raft_consensus.cc:359] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.064999 14227 raft_consensus.cc:385] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.065075 14226 raft_consensus.cc:359] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.066372 14226 raft_consensus.cc:385] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.066977 14226 raft_consensus.cc:740] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.068603 14225 tablet_bootstrap.cc:492] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:12.068224 14226 consensus_queue.cc:260] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.069352 14225 ts_tablet_manager.cc:1403] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.106s	user 0.022s	sys 0.004s
I20260709 13:23:12.071576 14226 ts_tablet_manager.cc:1434] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.010s
I20260709 13:23:12.065356 14227 raft_consensus.cc:740] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.071179 13931 catalog_manager.cc:5697] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.073675 14226 tablet_bootstrap.cc:492] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:12.073613 14227 consensus_queue.cc:260] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.076427 14227 ts_tablet_manager.cc:1434] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:23:12.077672 14227 tablet_bootstrap.cc:492] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:12.085292 14226 tablet_bootstrap.cc:654] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.086133 14225 raft_consensus.cc:359] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.087344 14225 raft_consensus.cc:385] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.088168 14225 raft_consensus.cc:740] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.089717 14225 consensus_queue.cc:260] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.095834 14225 ts_tablet_manager.cc:1434] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:23:12.102954 14225 tablet_bootstrap.cc:492] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:12.106640 14227 tablet_bootstrap.cc:654] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.116497 14226 tablet_bootstrap.cc:492] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:12.117544 14226 ts_tablet_manager.cc:1403] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.011s
I20260709 13:23:12.118280 13929 catalog_manager.cc:5697] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 0 to 1, leader changed from <none> to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 1 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.123497 14227 tablet_bootstrap.cc:492] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:12.123978 14225 tablet_bootstrap.cc:654] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.124248 14227 ts_tablet_manager.cc:1403] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.006s
I20260709 13:23:12.123673 14226 raft_consensus.cc:359] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.124747 14226 raft_consensus.cc:385] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.125065 14226 raft_consensus.cc:740] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.126009 14226 consensus_queue.cc:260] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.128573 14226 ts_tablet_manager.cc:1434] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:23:12.129678 14226 tablet_bootstrap.cc:492] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:12.137465 14226 tablet_bootstrap.cc:654] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.137660 14227 raft_consensus.cc:359] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.138597 14227 raft_consensus.cc:385] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.139815 14227 raft_consensus.cc:740] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.143560 14227 consensus_queue.cc:260] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.146343 14225 tablet_bootstrap.cc:492] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:12.146394 14226 tablet_bootstrap.cc:492] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:12.147107 14225 ts_tablet_manager.cc:1403] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.006s
I20260709 13:23:12.147254 14226 ts_tablet_manager.cc:1403] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:23:12.150136 14227 ts_tablet_manager.cc:1434] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:23:12.150787 14225 raft_consensus.cc:359] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.151553 14227 tablet_bootstrap.cc:492] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:12.151225 14226 raft_consensus.cc:359] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.151677 14225 raft_consensus.cc:385] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.152097 14225 raft_consensus.cc:740] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.151988 14226 raft_consensus.cc:385] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.152696 14226 raft_consensus.cc:740] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.154222 14226 consensus_queue.cc:260] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.154552 14225 consensus_queue.cc:260] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.157452 14225 ts_tablet_manager.cc:1434] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:23:12.158618 14225 tablet_bootstrap.cc:492] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:12.161253 14227 tablet_bootstrap.cc:654] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.161751 14226 ts_tablet_manager.cc:1434] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:23:12.163322 14226 tablet_bootstrap.cc:492] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:12.166297 14225 tablet_bootstrap.cc:654] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.172410 14226 tablet_bootstrap.cc:654] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.174139 14227 tablet_bootstrap.cc:492] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:12.175055 14227 ts_tablet_manager.cc:1403] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:23:12.178766 14225 tablet_bootstrap.cc:492] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:12.179478 14225 ts_tablet_manager.cc:1403] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:23:12.179870 14227 raft_consensus.cc:359] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.181066 14227 raft_consensus.cc:385] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.181468 14227 raft_consensus.cc:740] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.183040 14227 consensus_queue.cc:260] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.183065 14225 raft_consensus.cc:359] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.184437 14225 raft_consensus.cc:385] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.184823 14225 raft_consensus.cc:740] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.185824 14225 consensus_queue.cc:260] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.189420 14225 ts_tablet_manager.cc:1434] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:23:12.191165 14227 ts_tablet_manager.cc:1434] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:23:12.193473 14227 tablet_bootstrap.cc:492] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:12.194895 14235 raft_consensus.cc:493] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:12.195569 14235 raft_consensus.cc:515] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.196426 14226 tablet_bootstrap.cc:492] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:12.197077 14226 ts_tablet_manager.cc:1403] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.011s
I20260709 13:23:12.198490 14235 leader_election.cc:290] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.200536 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ab465ed9a74b04a7fa5d843d888abc" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:12.200587 14226 raft_consensus.cc:359] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.201535 14031 raft_consensus.cc:2468] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:12.201660 14226 raft_consensus.cc:385] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.202232 14226 raft_consensus.cc:740] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.203166 14073 leader_election.cc:304] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:12.203552 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ab465ed9a74b04a7fa5d843d888abc" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:12.203249 14226 consensus_queue.cc:260] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.204366 14182 raft_consensus.cc:2468] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:12.206136 14226 ts_tablet_manager.cc:1434] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:23:12.207003 14235 raft_consensus.cc:2804] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:12.207543 14235 raft_consensus.cc:493] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:12.207935 14235 raft_consensus.cc:3060] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.217692 14235 raft_consensus.cc:515] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.221016 14235 leader_election.cc:290] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.221347 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ab465ed9a74b04a7fa5d843d888abc" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:12.222080 14031 raft_consensus.cc:3060] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.222492 14227 tablet_bootstrap.cc:654] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:12.225664 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ab465ed9a74b04a7fa5d843d888abc" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:12.226431 14182 raft_consensus.cc:3060] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.229270 14227 tablet_bootstrap.cc:492] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:12.230007 14227 ts_tablet_manager.cc:1403] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.001s
I20260709 13:23:12.232046 14031 raft_consensus.cc:2468] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:12.233821 14182 raft_consensus.cc:2468] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:12.233707 14073 leader_election.cc:304] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:12.233563 14227 raft_consensus.cc:359] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.234686 14227 raft_consensus.cc:385] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:12.234997 14235 raft_consensus.cc:2804] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:12.235013 14227 raft_consensus.cc:740] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.235700 14235 raft_consensus.cc:697] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:12.236178 14227 consensus_queue.cc:260] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.236635 14235 consensus_queue.cc:237] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.238229 14227 ts_tablet_manager.cc:1434] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:12.246078 13929 catalog_manager.cc:5697] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.276953 14235 raft_consensus.cc:493] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:12.277566 14235 raft_consensus.cc:515] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.279431 14235 leader_election.cc:290] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.280629 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e8dc4c3b70438c9f6bea36cb52d951" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:12.280648 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e8dc4c3b70438c9f6bea36cb52d951" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:12.281692 14031 raft_consensus.cc:2468] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:12.281720 14182 raft_consensus.cc:2468] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:12.283386 14072 leader_election.cc:304] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:12.284180 14235 raft_consensus.cc:2804] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:12.284603 14235 raft_consensus.cc:493] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:12.284900 14235 raft_consensus.cc:3060] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.291499 14235 raft_consensus.cc:515] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.293521 14235 leader_election.cc:290] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.294639 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e8dc4c3b70438c9f6bea36cb52d951" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:12.294641 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e8dc4c3b70438c9f6bea36cb52d951" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:12.295413 14031 raft_consensus.cc:3060] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.295553 14182 raft_consensus.cc:3060] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.301380 14235 raft_consensus.cc:493] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:12.302163 14235 raft_consensus.cc:515] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.303233 14031 raft_consensus.cc:2468] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:12.303408 14182 raft_consensus.cc:2468] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:12.304813 14073 leader_election.cc:304] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:12.305821 14256 raft_consensus.cc:2804] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:12.306442 14256 raft_consensus.cc:697] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:12.307157 14235 leader_election.cc:290] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.307858 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:12.307490 14256 consensus_queue.cc:237] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.308732 14031 raft_consensus.cc:2393] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in current term 1: Already voted for candidate db886523de6f4dd0b7d366f5276de514 in this term.
I20260709 13:23:12.308753 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:12.310827 14072 leader_election.cc:304] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e; no voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514
I20260709 13:23:12.311759 14235 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.322582 13928 catalog_manager.cc:5697] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.324079 14235 raft_consensus.cc:2749] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:12.328830 14235 consensus_queue.cc:1048] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:12.344098 14031 raft_consensus.cc:3060] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.355438 14253 consensus_queue.cc:1048] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:12.357300 14256 consensus_queue.cc:1048] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:12.360705 14235 consensus_queue.cc:1048] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:12.401413 14230 consensus_queue.cc:1048] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:12.408279 14253 raft_consensus.cc:493] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:12.409194 14253 raft_consensus.cc:515] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.414397 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238f1767354e4e6a85680d8362f770eb" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:12.415342 14031 raft_consensus.cc:2468] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:12.415819 14230 consensus_queue.cc:1048] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:12.417001 14073 leader_election.cc:304] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:12.417982 14235 raft_consensus.cc:2804] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:12.418380 14235 raft_consensus.cc:493] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:12.418713 14235 raft_consensus.cc:3060] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.424419 14253 leader_election.cc:290] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.425766 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238f1767354e4e6a85680d8362f770eb" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:12.426699 14181 raft_consensus.cc:2468] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:12.430722 14235 raft_consensus.cc:515] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.434278 14235 leader_election.cc:290] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.435134 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238f1767354e4e6a85680d8362f770eb" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:12.435527 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238f1767354e4e6a85680d8362f770eb" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:12.435967 14031 raft_consensus.cc:3060] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.436147 14181 raft_consensus.cc:3060] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.445529 14031 raft_consensus.cc:2468] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:12.445529 14181 raft_consensus.cc:2468] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:12.447085 14072 leader_election.cc:304] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:12.448133 14235 raft_consensus.cc:2804] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:12.449056 14235 raft_consensus.cc:697] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:12.449934 14235 consensus_queue.cc:237] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.460101 13928 catalog_manager.cc:5697] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.478974 14230 raft_consensus.cc:493] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:12.479746 14230 raft_consensus.cc:515] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.481925 14230 leader_election.cc:290] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:12.483013 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f2a2970624c2781536ca8d63094fd" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:12.483282 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f2a2970624c2781536ca8d63094fd" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:12.484269 14106 raft_consensus.cc:2393] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate db886523de6f4dd0b7d366f5276de514 in current term 1: Already voted for candidate b662c9fb95644b5bb159e204db929836 in this term.
I20260709 13:23:12.485340 14148 leader_election.cc:304] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db886523de6f4dd0b7d366f5276de514; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836
I20260709 13:23:12.486240 14230 raft_consensus.cc:3060] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.498927 14260 raft_consensus.cc:493] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:12.499768 14260 raft_consensus.cc:515] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.501221 14230 raft_consensus.cc:2749] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:12.503510 14260 leader_election.cc:290] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:12.504977 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d12d39c60e4af992a9477a7b5f7349" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:12.505158 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d12d39c60e4af992a9477a7b5f7349" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:12.505856 14031 raft_consensus.cc:2468] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:12.505980 14106 raft_consensus.cc:2468] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:12.508862 14148 leader_election.cc:304] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:12.509982 14260 raft_consensus.cc:2804] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:12.510353 14260 raft_consensus.cc:493] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:12.510665 14260 raft_consensus.cc:3060] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:12.518409 13979 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:12.526244 14260 raft_consensus.cc:515] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.529353 14260 leader_election.cc:290] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:12.535795 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d12d39c60e4af992a9477a7b5f7349" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:12.537046 14031 raft_consensus.cc:3060] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.558702 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d12d39c60e4af992a9477a7b5f7349" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:12.559610 14106 raft_consensus.cc:3060] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.565857 14031 raft_consensus.cc:2468] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:12.567941 14148 leader_election.cc:304] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:12.569165 14260 raft_consensus.cc:2804] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:12.569789 14260 raft_consensus.cc:697] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:12.570803 14260 consensus_queue.cc:237] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.572777 14106 raft_consensus.cc:2468] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:12.577688 14235 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:12.580114 14235 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:12.620602 14235 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:12.802899 14259 consensus_queue.cc:1048] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:12.827200 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:12.828286 14182 raft_consensus.cc:2393] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in current term 1: Already voted for candidate db886523de6f4dd0b7d366f5276de514 in this term.
I20260709 13:23:12.828989 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:12.830062 14031 raft_consensus.cc:2393] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in current term 1: Already voted for candidate b662c9fb95644b5bb159e204db929836 in this term.
I20260709 13:23:12.830248 14259 consensus_queue.cc:1048] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:12.836418 14072 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e; no voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514
I20260709 13:23:12.837760 14256 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:12.847281 14253 consensus_queue.cc:1048] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:12.851394 14253 consensus_queue.cc:1048] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:12.858107 14256 raft_consensus.cc:2749] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:12.859658 14235 consensus_queue.cc:1048] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:12.842549 13928 catalog_manager.cc:5697] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 0 to 1, leader changed from <none> to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:12.878158 14256 consensus_queue.cc:1048] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:13.035212 14260 consensus_queue.cc:1048] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:13.051563 14230 consensus_queue.cc:1048] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:13.075350 14253 consensus_queue.cc:1048] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:13.076464 14300 consensus_queue.cc:1048] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:23:13.524879 13979 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:23:13.653993 13962 debug-util.cc:398] Leaking SignalData structure 0x7b080025fe20 after lost signal to thread 3024
W20260709 13:23:13.655392 13962 debug-util.cc:398] Leaking SignalData structure 0x7b0800345380 after lost signal to thread 13965
W20260709 13:23:13.656826 13962 debug-util.cc:398] Leaking SignalData structure 0x7b080014ce00 after lost signal to thread 14057
W20260709 13:23:13.658025 13962 debug-util.cc:398] Leaking SignalData structure 0x7b0800096a40 after lost signal to thread 14133
W20260709 13:23:13.659205 13962 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9da0 after lost signal to thread 14207
I20260709 13:23:14.012488 14230 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:14.013269 14230 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.015813 14230 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:14.016949 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:14.017189 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:14.017865 14033 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:14.017912 14106 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:14.019722 14148 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:14.020653 14230 raft_consensus.cc:2804] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:14.021171 14230 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:14.021518 14230 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.028983 14230 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.031112 14230 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 2 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:14.032382 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:14.032197 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:14.033226 14106 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.033273 14033 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.042367 14106 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 2.
I20260709 13:23:14.042367 14033 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 2.
I20260709 13:23:14.044107 14148 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:14.045053 14230 raft_consensus.cc:2804] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:14.045593 14230 raft_consensus.cc:697] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 2 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:14.046816 14230 consensus_queue.cc:237] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.061345 13931 catalog_manager.cc:5697] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 0 to 2, leader changed from <none> to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:14.133638 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b"
dest_uuid: "db886523de6f4dd0b7d366f5276de514"
mode: GRACEFUL
new_leader_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:23:14.134403 14181 raft_consensus.cc:606] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Received request to transfer leadership to TS b662c9fb95644b5bb159e204db929836
I20260709 13:23:14.154429 14106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5"
dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
mode: GRACEFUL
new_leader_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:45642
I20260709 13:23:14.155351 14106 raft_consensus.cc:606] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Received request to transfer leadership to TS b662c9fb95644b5bb159e204db929836
I20260709 13:23:14.163493 14106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9e0aefcfd114f658f43a25a0b39c7f1"
dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
mode: GRACEFUL
new_leader_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:45642
I20260709 13:23:14.164428 14106 raft_consensus.cc:606] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Received request to transfer leadership to TS b662c9fb95644b5bb159e204db929836
I20260709 13:23:14.172390 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5"
dest_uuid: "db886523de6f4dd0b7d366f5276de514"
mode: GRACEFUL
new_leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:23:14.173240 14181 raft_consensus.cc:606] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 2 LEADER]: Received request to transfer leadership to TS a2e8dad7b86a4cebb9d628fa7a5cf76e
I20260709 13:23:14.326860 14321 raft_consensus.cc:993] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e: : Instructing follower b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:14.327724 14321 raft_consensus.cc:1081] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Signalling peer b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:14.330431 14030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9e0aefcfd114f658f43a25a0b39c7f1"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:23:14.331156 14030 raft_consensus.cc:493] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:14.331585 14030 raft_consensus.cc:3060] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.339051 14030 raft_consensus.cc:515] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.341816 14030 leader_election.cc:290] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:14.342458 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0aefcfd114f658f43a25a0b39c7f1" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:14.342572 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0aefcfd114f658f43a25a0b39c7f1" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:14.343847 14181 raft_consensus.cc:3060] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.343309 14106 raft_consensus.cc:3055] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:14.344357 14106 raft_consensus.cc:740] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:14.345373 14106 consensus_queue.cc:260] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.346764 14106 raft_consensus.cc:3060] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.351994 14181 raft_consensus.cc:2468] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:14.353003 14183 raft_consensus.cc:1240] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Rejecting Update request from peer a2e8dad7b86a4cebb9d628fa7a5cf76e for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:14.353941 13997 leader_election.cc:304] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:14.355160 14259 raft_consensus.cc:2804] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:14.360989 14106 raft_consensus.cc:2468] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:14.362696 14259 raft_consensus.cc:697] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:14.364524 14259 consensus_queue.cc:237] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.376462 13929 catalog_manager.cc:5697] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 1 to 2, leader changed from a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66) to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:14.427724 14312 raft_consensus.cc:993] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514: : Instructing follower b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:14.428468 14230 raft_consensus.cc:1081] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Signalling peer b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:14.430348 14030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:57690
I20260709 13:23:14.430994 14030 raft_consensus.cc:493] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:14.431346 14030 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.438043 14030 raft_consensus.cc:515] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.440178 14030 leader_election.cc:290] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:14.441430 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:14.441618 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:14.442363 14106 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.442806 14183 raft_consensus.cc:3055] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:14.443377 14183 raft_consensus.cc:740] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:14.444232 14183 consensus_queue.cc:260] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.446013 14183 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.451673 14030 raft_consensus.cc:1275] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:23:14.454044 14230 consensus_queue.cc:1048] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:14.454522 14106 raft_consensus.cc:2468] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:14.456447 13998 leader_election.cc:304] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:14.457448 14183 raft_consensus.cc:2468] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:14.457679 14259 raft_consensus.cc:2804] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:14.462961 14259 raft_consensus.cc:697] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:14.464236 14259 consensus_queue.cc:237] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.484716 14106 raft_consensus.cc:1275] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:23:14.484059 13929 catalog_manager.cc:5697] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 1 to 2, leader changed from db886523de6f4dd0b7d366f5276de514 (127.2.243.67) to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:14.486908 14230 consensus_queue.cc:1048] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:14.505019 14230 raft_consensus.cc:993] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514: : Instructing follower a2e8dad7b86a4cebb9d628fa7a5cf76e to start an election
I20260709 13:23:14.505755 14312 raft_consensus.cc:1081] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 2 LEADER]: Signalling peer a2e8dad7b86a4cebb9d628fa7a5cf76e to start an election
I20260709 13:23:14.508165 14106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5"
dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
 from {username='slave'} at 127.0.0.1:35620
I20260709 13:23:14.509061 14106 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:14.509577 14106 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:14.517071 14106 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.519237 14106 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 3 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:14.520290 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:14.521123 14033 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:14.522473 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:14.523216 14183 raft_consensus.cc:3055] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:14.523546 14183 raft_consensus.cc:740] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:14.524793 14183 consensus_queue.cc:260] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.526176 14183 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:14.531479 14033 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 3.
I20260709 13:23:14.533408 14073 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:14.534595 14322 raft_consensus.cc:2804] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:14.535143 14322 raft_consensus.cc:697] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:14.536209 14322 consensus_queue.cc:237] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.536671 14183 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 3.
I20260709 13:23:14.545694 13929 catalog_manager.cc:5697] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 2 to 3, leader changed from db886523de6f4dd0b7d366f5276de514 (127.2.243.67) to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 3 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:14.571763 14322 raft_consensus.cc:993] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: : Instructing follower b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:14.572290 14300 raft_consensus.cc:1081] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Signalling peer b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:14.574414 14033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:23:14.575161 14033 raft_consensus.cc:493] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:14.575594 14033 raft_consensus.cc:3060] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.585170 14033 raft_consensus.cc:515] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.587348 14033 leader_election.cc:290] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:14.588788 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:14.588827 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c0c04ede294e58a16689d3caf7caa5" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:14.589846 14106 raft_consensus.cc:3055] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:14.589807 14183 raft_consensus.cc:3060] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.590432 14106 raft_consensus.cc:740] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:14.591421 14106 consensus_queue.cc:260] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.592648 14106 raft_consensus.cc:3060] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.599169 14106 raft_consensus.cc:2468] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:14.600191 14183 raft_consensus.cc:2468] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:14.600577 13998 leader_election.cc:304] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:14.601687 14259 raft_consensus.cc:2804] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:14.602296 14259 raft_consensus.cc:697] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:14.603361 14259 consensus_queue.cc:237] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:14.613755 13929 catalog_manager.cc:5697] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 1 to 2, leader changed from a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66) to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:14.885471 14183 raft_consensus.cc:1275] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:14.887596 14259 consensus_queue.cc:1048] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:14.899518 14106 raft_consensus.cc:1275] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:14.902809 14323 consensus_queue.cc:1048] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:14.921729 14183 raft_consensus.cc:1275] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:14.923686 14325 consensus_queue.cc:1048] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:14.945324 14106 raft_consensus.cc:1275] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:14.949661 14259 consensus_queue.cc:1048] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:14.987259 14033 raft_consensus.cc:1275] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Refusing update from remote peer a2e8dad7b86a4cebb9d628fa7a5cf76e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:23:14.989306 14337 consensus_queue.cc:1048] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:15.001289 14183 raft_consensus.cc:1275] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Refusing update from remote peer a2e8dad7b86a4cebb9d628fa7a5cf76e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:23:15.003186 14337 consensus_queue.cc:1048] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:15.043232 14183 raft_consensus.cc:1275] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:15.045048 14259 consensus_queue.cc:1048] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:15.057088 14106 raft_consensus.cc:1275] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:15.059020 14323 consensus_queue.cc:1048] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:17.234323 13931 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44854:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:17.238673 13931 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:17.311908 14016 tablet_service.cc:1511] Processing CreateTablet for tablet f8559cc216db4afb918ef75b3e3512ee (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:17.313077 14094 tablet_service.cc:1511] Processing CreateTablet for tablet f8559cc216db4afb918ef75b3e3512ee (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:17.313982 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8559cc216db4afb918ef75b3e3512ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.314842 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8559cc216db4afb918ef75b3e3512ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.318985 14018 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccf4a9ab7cc4769991c3201e7ab29a7 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:17.321054 14018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccf4a9ab7cc4769991c3201e7ab29a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.320407 14166 tablet_service.cc:1511] Processing CreateTablet for tablet f8559cc216db4afb918ef75b3e3512ee (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:17.322758 14166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8559cc216db4afb918ef75b3e3512ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.334748 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccf4a9ab7cc4769991c3201e7ab29a7 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:17.339438 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccf4a9ab7cc4769991c3201e7ab29a7 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:17.341105 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccf4a9ab7cc4769991c3201e7ab29a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.342936 14021 tablet_service.cc:1511] Processing CreateTablet for tablet 98d2c5fc272842cc8f559b9d06ae7df3 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:17.344547 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d2c5fc272842cc8f559b9d06ae7df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.347993 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccf4a9ab7cc4769991c3201e7ab29a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.364020 14094 tablet_service.cc:1511] Processing CreateTablet for tablet 98d2c5fc272842cc8f559b9d06ae7df3 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:17.365869 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d2c5fc272842cc8f559b9d06ae7df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.365538 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 98d2c5fc272842cc8f559b9d06ae7df3 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:17.367110 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d2c5fc272842cc8f559b9d06ae7df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.367578 14352 tablet_bootstrap.cc:492] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:17.367261 14017 tablet_service.cc:1511] Processing CreateTablet for tablet 463b007f16004ab5b8d8c835765fc26b (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:17.371163 14017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463b007f16004ab5b8d8c835765fc26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.378053 14352 tablet_bootstrap.cc:654] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.402881 14353 tablet_bootstrap.cc:492] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:17.410077 14090 tablet_service.cc:1511] Processing CreateTablet for tablet 463b007f16004ab5b8d8c835765fc26b (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:17.411062 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 463b007f16004ab5b8d8c835765fc26b (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:17.411965 14090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463b007f16004ab5b8d8c835765fc26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.412802 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463b007f16004ab5b8d8c835765fc26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.416168 14015 tablet_service.cc:1511] Processing CreateTablet for tablet 298f745310a74a47876d52900df93041 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:17.418434 14015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298f745310a74a47876d52900df93041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.418531 14097 tablet_service.cc:1511] Processing CreateTablet for tablet 298f745310a74a47876d52900df93041 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:17.420117 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298f745310a74a47876d52900df93041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.424649 14165 tablet_service.cc:1511] Processing CreateTablet for tablet 298f745310a74a47876d52900df93041 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:17.432986 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298f745310a74a47876d52900df93041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.447150 14353 tablet_bootstrap.cc:654] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.450809 14352 tablet_bootstrap.cc:492] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:17.451697 14352 ts_tablet_manager.cc:1403] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.005s
I20260709 13:23:17.463610 14093 tablet_service.cc:1511] Processing CreateTablet for tablet aa7634f6546640e58cba32f0af843138 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:17.463914 14016 tablet_service.cc:1511] Processing CreateTablet for tablet aa7634f6546640e58cba32f0af843138 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:17.465266 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7634f6546640e58cba32f0af843138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.465633 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7634f6546640e58cba32f0af843138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.463610 14166 tablet_service.cc:1511] Processing CreateTablet for tablet aa7634f6546640e58cba32f0af843138 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:17.471741 14166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7634f6546640e58cba32f0af843138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.453544 14355 tablet_bootstrap.cc:492] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:17.487457 14017 tablet_service.cc:1511] Processing CreateTablet for tablet 075163cc1eca4043ba451af1a657f15b (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:17.473769 14353 tablet_bootstrap.cc:492] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:17.491324 14353 ts_tablet_manager.cc:1403] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.009s
I20260709 13:23:17.495033 14353 raft_consensus.cc:359] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.496006 14353 raft_consensus.cc:385] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.496548 14353 raft_consensus.cc:740] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.497601 14353 consensus_queue.cc:260] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.502516 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 075163cc1eca4043ba451af1a657f15b (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:17.504465 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075163cc1eca4043ba451af1a657f15b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.504976 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 075163cc1eca4043ba451af1a657f15b (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:17.506708 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075163cc1eca4043ba451af1a657f15b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.459789 14352 raft_consensus.cc:359] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.509408 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 1f00f645f7b64975879f3d45a8a1b3cd (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:17.516216 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f00f645f7b64975879f3d45a8a1b3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.516790 14094 tablet_service.cc:1511] Processing CreateTablet for tablet 1f00f645f7b64975879f3d45a8a1b3cd (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:17.518399 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f00f645f7b64975879f3d45a8a1b3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.519140 14352 raft_consensus.cc:385] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.519606 14352 raft_consensus.cc:740] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.520605 14352 consensus_queue.cc:260] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.521693 14016 tablet_service.cc:1511] Processing CreateTablet for tablet 1f00f645f7b64975879f3d45a8a1b3cd (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:17.526674 14352 ts_tablet_manager.cc:1434] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:23:17.533452 14352 tablet_bootstrap.cc:492] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:17.533818 14353 ts_tablet_manager.cc:1434] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:23:17.548399 14165 tablet_service.cc:1511] Processing CreateTablet for tablet c95e674505f34cea9f84dc6d5637d188 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:17.499418 14017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075163cc1eca4043ba451af1a657f15b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.523536 14021 tablet_service.cc:1511] Processing CreateTablet for tablet c95e674505f34cea9f84dc6d5637d188 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:17.552784 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f00f645f7b64975879f3d45a8a1b3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.553980 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95e674505f34cea9f84dc6d5637d188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.554634 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95e674505f34cea9f84dc6d5637d188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:17.554138 14353 tablet_bootstrap.cc:492] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:17.537922 14355 tablet_bootstrap.cc:654] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.569597 14090 tablet_service.cc:1511] Processing CreateTablet for tablet c95e674505f34cea9f84dc6d5637d188 (DEFAULT_TABLE table=soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:17.586467 14353 tablet_bootstrap.cc:654] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.588810 14090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95e674505f34cea9f84dc6d5637d188. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:23:17.591018 13979 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:17.595515 14355 tablet_bootstrap.cc:492] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:17.604862 14355 ts_tablet_manager.cc:1403] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.004s
I20260709 13:23:17.577049 14352 tablet_bootstrap.cc:654] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.620087 14355 raft_consensus.cc:359] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.624338 14355 raft_consensus.cc:385] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.626252 14355 raft_consensus.cc:740] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.631891 14312 raft_consensus.cc:493] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:17.632967 14312 raft_consensus.cc:515] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.637792 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:17.638068 14352 tablet_bootstrap.cc:492] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:17.638727 14352 ts_tablet_manager.cc:1403] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.004s
I20260709 13:23:17.638810 14353 tablet_bootstrap.cc:492] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:17.639526 14353 ts_tablet_manager.cc:1403] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.008s
W20260709 13:23:17.639948 14148 leader_election.cc:343] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:17.642469 14312 leader_election.cc:290] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:17.642722 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:17.643476 14355 consensus_queue.cc:260] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.643716 14353 raft_consensus.cc:359] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
W20260709 13:23:17.644961 14148 leader_election.cc:343] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:17.645201 14353 raft_consensus.cc:385] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.645622 14353 raft_consensus.cc:740] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.646297 14355 ts_tablet_manager.cc:1434] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:23:17.645591 14148 leader_election.cc:304] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db886523de6f4dd0b7d366f5276de514; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836
I20260709 13:23:17.649525 14312 raft_consensus.cc:2749] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:17.646970 14353 consensus_queue.cc:260] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.647583 14355 tablet_bootstrap.cc:492] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:17.648146 14352 raft_consensus.cc:359] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.650548 14352 raft_consensus.cc:385] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.650903 14352 raft_consensus.cc:740] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.652323 14352 consensus_queue.cc:260] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.659040 14355 tablet_bootstrap.cc:654] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.662330 14353 ts_tablet_manager.cc:1434] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:23:17.663763 14353 tablet_bootstrap.cc:492] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:17.665302 14352 ts_tablet_manager.cc:1434] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.006s
I20260709 13:23:17.667169 14352 tablet_bootstrap.cc:492] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:17.675348 14353 tablet_bootstrap.cc:654] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.677019 14352 tablet_bootstrap.cc:654] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.691220 14355 tablet_bootstrap.cc:492] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:17.692037 14355 ts_tablet_manager.cc:1403] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.006s
I20260709 13:23:17.692797 14353 tablet_bootstrap.cc:492] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:17.693922 14353 ts_tablet_manager.cc:1403] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 13:23:17.696072 14355 raft_consensus.cc:359] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.697316 14355 raft_consensus.cc:385] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.697736 14355 raft_consensus.cc:740] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.698904 14353 raft_consensus.cc:359] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.698935 14355 consensus_queue.cc:260] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.700122 14353 raft_consensus.cc:385] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.700141 14352 tablet_bootstrap.cc:492] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:17.700634 14353 raft_consensus.cc:740] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.701082 14352 ts_tablet_manager.cc:1403] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.002s
I20260709 13:23:17.701649 14353 consensus_queue.cc:260] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.704843 14353 ts_tablet_manager.cc:1434] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:23:17.705307 14355 ts_tablet_manager.cc:1434] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:23:17.706211 14353 tablet_bootstrap.cc:492] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:17.706593 14355 tablet_bootstrap.cc:492] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:17.717936 14353 tablet_bootstrap.cc:654] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.728760 14355 tablet_bootstrap.cc:654] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.734604 14353 tablet_bootstrap.cc:492] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:17.735944 14353 ts_tablet_manager.cc:1403] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.012s
I20260709 13:23:17.740065 14353 raft_consensus.cc:359] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.741160 14353 raft_consensus.cc:385] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.741562 14353 raft_consensus.cc:740] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.742560 14353 consensus_queue.cc:260] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.711572 14352 raft_consensus.cc:359] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.744511 14352 raft_consensus.cc:385] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.744912 14352 raft_consensus.cc:740] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.745712 14353 ts_tablet_manager.cc:1434] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:23:17.745958 14352 consensus_queue.cc:260] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.749326 14355 tablet_bootstrap.cc:492] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:17.750164 14355 ts_tablet_manager.cc:1403] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.011s
I20260709 13:23:17.751227 14352 ts_tablet_manager.cc:1434] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.002s
I20260709 13:23:17.752951 14352 tablet_bootstrap.cc:492] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:17.748780 14353 tablet_bootstrap.cc:492] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:17.762152 14355 raft_consensus.cc:359] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.763298 14355 raft_consensus.cc:385] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.763732 14355 raft_consensus.cc:740] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.765077 14355 consensus_queue.cc:260] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.770362 14353 tablet_bootstrap.cc:654] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.772617 14355 ts_tablet_manager.cc:1434] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.007s
I20260709 13:23:17.774325 14355 tablet_bootstrap.cc:492] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:17.775835 14312 raft_consensus.cc:493] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:17.776575 14312 raft_consensus.cc:515] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.777493 14352 tablet_bootstrap.cc:654] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.781726 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8559cc216db4afb918ef75b3e3512ee" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:17.782866 14033 raft_consensus.cc:2468] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:17.788502 14148 leader_election.cc:304] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:17.791127 14312 leader_election.cc:290] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:17.792184 14312 raft_consensus.cc:2804] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:17.793095 14312 raft_consensus.cc:493] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:17.794229 14312 raft_consensus.cc:3060] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:17.810082 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8559cc216db4afb918ef75b3e3512ee" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:17.811132 14106 raft_consensus.cc:2468] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:17.823628 14312 raft_consensus.cc:515] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.829221 14353 tablet_bootstrap.cc:492] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:17.829694 14352 tablet_bootstrap.cc:492] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:17.830008 14353 ts_tablet_manager.cc:1403] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.023s
I20260709 13:23:17.830261 14352 ts_tablet_manager.cc:1403] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.078s	user 0.025s	sys 0.015s
I20260709 13:23:17.832058 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8559cc216db4afb918ef75b3e3512ee" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:17.832949 14033 raft_consensus.cc:3060] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:17.834091 14352 raft_consensus.cc:359] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.835294 14352 raft_consensus.cc:385] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.835808 14352 raft_consensus.cc:740] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.836202 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8559cc216db4afb918ef75b3e3512ee" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:17.834201 14353 raft_consensus.cc:359] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.837131 14352 consensus_queue.cc:260] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.837723 14106 raft_consensus.cc:3060] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:17.837834 14353 raft_consensus.cc:385] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.838294 14353 raft_consensus.cc:740] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.839474 14353 consensus_queue.cc:260] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.835939 14312 leader_election.cc:290] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:17.842193 14353 ts_tablet_manager.cc:1434] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:23:17.848281 14353 tablet_bootstrap.cc:492] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:17.844201 14352 ts_tablet_manager.cc:1434] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:23:17.854440 14352 tablet_bootstrap.cc:492] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:17.835932 14355 tablet_bootstrap.cc:654] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.873132 14352 tablet_bootstrap.cc:654] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.872066 14033 raft_consensus.cc:2468] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:17.879482 14353 tablet_bootstrap.cc:654] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.880975 14148 leader_election.cc:304] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:17.882295 14312 raft_consensus.cc:2804] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:17.888520 14312 raft_consensus.cc:697] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:17.889729 14312 consensus_queue.cc:237] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.873646 14106 raft_consensus.cc:2468] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:17.909420 14355 tablet_bootstrap.cc:492] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:17.915688 14355 ts_tablet_manager.cc:1403] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.006s
I20260709 13:23:17.919214 13928 catalog_manager.cc:5697] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 0 to 1, leader changed from <none> to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:17.921094 14352 tablet_bootstrap.cc:492] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:17.922482 14352 ts_tablet_manager.cc:1403] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.015s
I20260709 13:23:17.922078 14355 raft_consensus.cc:359] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.924674 14355 raft_consensus.cc:385] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.925153 14355 raft_consensus.cc:740] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.926229 14355 consensus_queue.cc:260] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.928036 14353 tablet_bootstrap.cc:492] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:17.929852 14353 ts_tablet_manager.cc:1403] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.082s	user 0.034s	sys 0.010s
I20260709 13:23:17.931546 14355 ts_tablet_manager.cc:1434] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.005s
I20260709 13:23:17.933192 14355 tablet_bootstrap.cc:492] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:17.934252 14353 raft_consensus.cc:359] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.935232 14353 raft_consensus.cc:385] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.935542 14353 raft_consensus.cc:740] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.935703 14312 raft_consensus.cc:493] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:17.936563 14312 raft_consensus.cc:515] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.938151 14353 consensus_queue.cc:260] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.941094 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:17.941642 14353 ts_tablet_manager.cc:1434] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:23:17.941900 14033 raft_consensus.cc:2468] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:17.942359 14355 tablet_bootstrap.cc:654] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.944103 14323 raft_consensus.cc:493] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:17.943572 14148 leader_election.cc:304] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:17.946825 14323 raft_consensus.cc:515] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.947430 14371 raft_consensus.cc:2804] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:17.948012 14371 raft_consensus.cc:493] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:17.948418 14371 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:17.942972 14353 tablet_bootstrap.cc:492] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:17.953694 14323 leader_election.cc:290] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:17.955279 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463b007f16004ab5b8d8c835765fc26b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:17.956229 14181 raft_consensus.cc:2468] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 0.
I20260709 13:23:17.958271 13997 leader_election.cc:304] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:17.962675 14353 tablet_bootstrap.cc:654] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:17.963009 14323 raft_consensus.cc:2804] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:17.965595 14323 raft_consensus.cc:493] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:17.967103 14352 raft_consensus.cc:359] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.969885 14323 raft_consensus.cc:3060] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:17.969933 14352 raft_consensus.cc:385] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:17.978521 14352 raft_consensus.cc:740] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:17.982750 14371 raft_consensus.cc:515] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:17.989627 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:17.984720 14312 leader_election.cc:290] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:17.994766 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463b007f16004ab5b8d8c835765fc26b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:17.986651 14355 tablet_bootstrap.cc:492] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:17.994716 14033 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:17.996495 14355 ts_tablet_manager.cc:1403] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.014s
I20260709 13:23:17.987442 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:17.997869 14106 raft_consensus.cc:2468] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:18.000262 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:18.000931 14106 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.001073 14355 raft_consensus.cc:359] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.002259 14355 raft_consensus.cc:385] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.002635 14355 raft_consensus.cc:740] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.003602 14371 leader_election.cc:290] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:18.005757 14353 tablet_bootstrap.cc:492] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:18.006593 14353 ts_tablet_manager.cc:1403] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.015s
I20260709 13:23:17.986356 14352 consensus_queue.cc:260] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.010236 14107 raft_consensus.cc:2468] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 0.
I20260709 13:23:18.010721 14353 raft_consensus.cc:359] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.011831 14353 raft_consensus.cc:385] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.013712 14355 consensus_queue.cc:260] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.020653 14323 raft_consensus.cc:515] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.021692 14355 ts_tablet_manager.cc:1434] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.005s
I20260709 13:23:18.023058 14355 tablet_bootstrap.cc:492] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:18.025220 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463b007f16004ab5b8d8c835765fc26b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:18.026167 14181 raft_consensus.cc:3060] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.012202 14353 raft_consensus.cc:740] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.027278 14353 consensus_queue.cc:260] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.029948 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463b007f16004ab5b8d8c835765fc26b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:18.030392 14353 ts_tablet_manager.cc:1434] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:23:18.030824 14107 raft_consensus.cc:3060] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.031910 14353 tablet_bootstrap.cc:492] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:18.012178 14106 raft_consensus.cc:2468] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:18.037904 14148 leader_election.cc:304] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:18.038968 14371 raft_consensus.cc:2804] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:18.039528 14371 raft_consensus.cc:697] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:18.040529 14371 consensus_queue.cc:237] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.042171 14352 ts_tablet_manager.cc:1434] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.119s	user 0.011s	sys 0.001s
I20260709 13:23:18.043560 14352 tablet_bootstrap.cc:492] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:18.036512 14323 leader_election.cc:290] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.047677 14181 raft_consensus.cc:2468] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 1.
I20260709 13:23:18.049691 13997 leader_election.cc:304] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:18.050352 14107 raft_consensus.cc:2468] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 1.
I20260709 13:23:18.051518 14323 raft_consensus.cc:2804] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:18.052798 14355 tablet_bootstrap.cc:654] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.053299 14323 raft_consensus.cc:697] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:18.055933 14033 raft_consensus.cc:2468] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:18.055570 14323 consensus_queue.cc:237] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.072691 14376 raft_consensus.cc:493] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:18.073769 14376 raft_consensus.cc:515] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.075071 14353 tablet_bootstrap.cc:654] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.077491 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298f745310a74a47876d52900df93041" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:18.078526 14107 raft_consensus.cc:2468] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 0.
I20260709 13:23:18.079205 14352 tablet_bootstrap.cc:654] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.081969 13998 leader_election.cc:304] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:18.094430 14376 leader_election.cc:290] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.095304 14376 raft_consensus.cc:2804] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:18.097324 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298f745310a74a47876d52900df93041" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:18.098317 14181 raft_consensus.cc:2468] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 0.
I20260709 13:23:18.100448 14376 raft_consensus.cc:493] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:18.101066 14376 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.101842 13928 catalog_manager.cc:5697] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 0 to 1, leader changed from <none> to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:18.119474 14352 tablet_bootstrap.cc:492] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:18.120239 14352 ts_tablet_manager.cc:1403] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.021s
I20260709 13:23:18.124651 14352 raft_consensus.cc:359] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.125576 14352 raft_consensus.cc:385] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.125898 14352 raft_consensus.cc:740] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.126814 14352 consensus_queue.cc:260] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.130949 14353 tablet_bootstrap.cc:492] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:18.131609 14353 ts_tablet_manager.cc:1403] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.013s
I20260709 13:23:18.138685 14355 tablet_bootstrap.cc:492] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:18.139667 14355 ts_tablet_manager.cc:1403] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.000s
I20260709 13:23:18.140231 14353 raft_consensus.cc:359] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.141167 14353 raft_consensus.cc:385] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.141705 14352 ts_tablet_manager.cc:1434] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:23:18.143155 14352 tablet_bootstrap.cc:492] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:18.145206 14368 raft_consensus.cc:493] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:18.144968 14355 raft_consensus.cc:359] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.141930 14376 raft_consensus.cc:515] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.145778 14368 raft_consensus.cc:515] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.147750 14376 leader_election.cc:290] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.150417 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298f745310a74a47876d52900df93041" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:18.150796 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7634f6546640e58cba32f0af843138" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:18.151206 14107 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.151508 14181 raft_consensus.cc:2468] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:18.154656 14072 leader_election.cc:304] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:18.156075 14368 leader_election.cc:290] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.156635 14337 raft_consensus.cc:2804] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:18.157351 14337 raft_consensus.cc:493] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:18.157806 14337 raft_consensus.cc:3060] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.151719 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298f745310a74a47876d52900df93041" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:18.144366 14353 raft_consensus.cc:740] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.160749 14352 tablet_bootstrap.cc:654] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.160863 14183 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.161674 14353 consensus_queue.cc:260] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.164315 14353 ts_tablet_manager.cc:1434] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:23:18.165570 14353 tablet_bootstrap.cc:492] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514: Bootstrap starting.
I20260709 13:23:18.160804 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7634f6546640e58cba32f0af843138" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:18.174250 14353 tablet_bootstrap.cc:654] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.174588 14107 raft_consensus.cc:2468] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 1.
I20260709 13:23:18.176371 14371 raft_consensus.cc:493] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:18.177023 14371 raft_consensus.cc:515] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.177561 13998 leader_election.cc:304] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:18.179252 14376 raft_consensus.cc:2804] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:18.179756 14371 leader_election.cc:290] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:18.180269 14376 raft_consensus.cc:697] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:18.181298 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:18.181540 14376 consensus_queue.cc:237] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.183524 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
W20260709 13:23:18.183964 14148 leader_election.cc:343] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:18.185215 14148 leader_election.cc:343] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:18.185889 14148 leader_election.cc:304] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db886523de6f4dd0b7d366f5276de514; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836
I20260709 13:23:18.175132 14183 raft_consensus.cc:2468] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 1.
I20260709 13:23:18.165326 13930 catalog_manager.cc:5697] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 0 to 1, leader changed from <none> to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 1 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:18.197103 14352 tablet_bootstrap.cc:492] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:18.197964 14352 ts_tablet_manager.cc:1403] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.005s
I20260709 13:23:18.200784 14368 raft_consensus.cc:493] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:18.201810 14368 raft_consensus.cc:515] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.206522 14352 raft_consensus.cc:359] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.207008 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:18.207122 14368 leader_election.cc:290] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.213577 14352 raft_consensus.cc:385] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.210667 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:18.214419 14352 raft_consensus.cc:740] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.215219 14181 raft_consensus.cc:2468] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:18.146055 14355 raft_consensus.cc:385] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.216279 14355 raft_consensus.cc:740] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.217172 14072 leader_election.cc:304] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:18.194168 14371 raft_consensus.cc:2749] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:18.217760 14355 consensus_queue.cc:260] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.219412 14368 raft_consensus.cc:2804] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:18.219974 14368 raft_consensus.cc:493] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:18.215682 14352 consensus_queue.cc:260] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.220497 14368 raft_consensus.cc:3060] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.220453 14033 raft_consensus.cc:2468] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:18.224722 14030 raft_consensus.cc:2468] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:18.224484 14337 raft_consensus.cc:515] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.227447 14337 leader_election.cc:290] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.229431 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7634f6546640e58cba32f0af843138" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:18.230517 14352 ts_tablet_manager.cc:1434] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.002s
I20260709 13:23:18.230301 14181 raft_consensus.cc:3060] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.231945 14352 tablet_bootstrap.cc:492] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:18.233094 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7634f6546640e58cba32f0af843138" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:18.234356 14033 raft_consensus.cc:3060] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.237002 14355 ts_tablet_manager.cc:1434] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.000s
I20260709 13:23:18.238505 14355 tablet_bootstrap.cc:492] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:18.258111 14352 tablet_bootstrap.cc:654] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.257781 14033 raft_consensus.cc:2468] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:18.264256 14073 leader_election.cc:304] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:18.265377 14337 raft_consensus.cc:2804] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:18.265637 14355 tablet_bootstrap.cc:654] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.266031 14337 raft_consensus.cc:697] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:18.267383 14337 consensus_queue.cc:237] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.268692 13928 catalog_manager.cc:5697] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 0 to 1, leader changed from <none> to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 1 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:18.269904 14353 tablet_bootstrap.cc:492] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514: No bootstrap required, opened a new log
I20260709 13:23:18.270514 14353 ts_tablet_manager.cc:1403] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.005s
I20260709 13:23:18.279264 14355 tablet_bootstrap.cc:492] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:18.280097 14355 ts_tablet_manager.cc:1403] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.010s
I20260709 13:23:18.283249 14368 raft_consensus.cc:515] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.281165 14181 raft_consensus.cc:2468] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:18.283232 14353 raft_consensus.cc:359] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.286999 14352 tablet_bootstrap.cc:492] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:18.291270 14353 raft_consensus.cc:385] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.291577 14352 ts_tablet_manager.cc:1403] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.007s
I20260709 13:23:18.291658 14353 raft_consensus.cc:740] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.292820 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:18.292755 14353 consensus_queue.cc:260] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.293612 14183 raft_consensus.cc:3060] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.292973 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:18.294238 14033 raft_consensus.cc:3060] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.295667 14353 ts_tablet_manager.cc:1434] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:23:18.295387 14355 raft_consensus.cc:359] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.296784 14352 raft_consensus.cc:359] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.297571 14352 raft_consensus.cc:385] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.297950 14352 raft_consensus.cc:740] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.291946 13930 catalog_manager.cc:5697] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:18.304328 14368 leader_election.cc:290] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.306164 14371 raft_consensus.cc:493] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:18.298843 14352 consensus_queue.cc:260] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.306797 14371 raft_consensus.cc:515] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.309267 14352 ts_tablet_manager.cc:1434] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:23:18.309387 14371 leader_election.cc:290] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:18.296443 14355 raft_consensus.cc:385] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.311482 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95e674505f34cea9f84dc6d5637d188" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:18.322584 14355 raft_consensus.cc:740] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.323089 14352 tablet_bootstrap.cc:492] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Bootstrap starting.
I20260709 13:23:18.323680 14355 consensus_queue.cc:260] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.303490 14183 raft_consensus.cc:2468] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:18.325224 14367 consensus_queue.cc:1048] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.326892 14355 ts_tablet_manager.cc:1434] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:23:18.330077 14355 tablet_bootstrap.cc:492] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:18.331647 14072 leader_election.cc:304] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:18.333622 14337 raft_consensus.cc:2804] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:18.320940 14033 raft_consensus.cc:2468] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:18.322888 14107 raft_consensus.cc:2468] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 0.
I20260709 13:23:18.334290 14337 raft_consensus.cc:697] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:18.335593 14148 leader_election.cc:304] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:18.336781 14371 raft_consensus.cc:2804] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:18.337205 14371 raft_consensus.cc:493] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:18.337586 14371 raft_consensus.cc:3060] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.339311 14355 tablet_bootstrap.cc:654] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.335414 14337 consensus_queue.cc:237] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.311482 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95e674505f34cea9f84dc6d5637d188" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
W20260709 13:23:18.343853 14148 leader_election.cc:343] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:18.346025 14352 tablet_bootstrap.cc:654] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.358006 14371 raft_consensus.cc:515] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.370740 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95e674505f34cea9f84dc6d5637d188" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
W20260709 13:23:18.377653 14148 leader_election.cc:343] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:18.389202 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95e674505f34cea9f84dc6d5637d188" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:18.390197 14107 raft_consensus.cc:3060] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.392390 14352 tablet_bootstrap.cc:492] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e: No bootstrap required, opened a new log
I20260709 13:23:18.393088 14352 ts_tablet_manager.cc:1403] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.028s
I20260709 13:23:18.393498 14371 leader_election.cc:290] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:18.392431 14355 tablet_bootstrap.cc:492] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:18.396802 14355 ts_tablet_manager.cc:1403] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.023s
I20260709 13:23:18.400725 14355 raft_consensus.cc:359] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.404582 14355 raft_consensus.cc:385] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.405064 14355 raft_consensus.cc:740] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.406105 14355 consensus_queue.cc:260] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.406452 14368 raft_consensus.cc:493] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:18.407364 14368 raft_consensus.cc:515] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.409559 14355 ts_tablet_manager.cc:1434] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:23:18.410733 14368 leader_election.cc:290] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.411082 14355 tablet_bootstrap.cc:492] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836: Bootstrap starting.
I20260709 13:23:18.403509 14352 raft_consensus.cc:359] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.411499 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f00f645f7b64975879f3d45a8a1b3cd" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836" is_pre_election: true
I20260709 13:23:18.412204 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f00f645f7b64975879f3d45a8a1b3cd" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:18.412566 14032 raft_consensus.cc:2468] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:18.413368 14183 raft_consensus.cc:2468] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 0.
I20260709 13:23:18.414703 14073 leader_election.cc:304] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:18.411940 14352 raft_consensus.cc:385] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.415854 14368 raft_consensus.cc:2804] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:18.415920 14352 raft_consensus.cc:740] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.416426 14368 raft_consensus.cc:493] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:18.416980 14368 raft_consensus.cc:3060] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.416941 14352 consensus_queue.cc:260] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.422233 14355 tablet_bootstrap.cc:654] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:18.425248 14352 ts_tablet_manager.cc:1434] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:23:18.435377 14107 raft_consensus.cc:2468] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 1.
I20260709 13:23:18.438074 14368 raft_consensus.cc:515] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.439507 14148 leader_election.cc:304] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: b662c9fb95644b5bb159e204db929836
I20260709 13:23:18.440594 14368 leader_election.cc:290] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.441499 14371 raft_consensus.cc:2804] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:18.441867 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f00f645f7b64975879f3d45a8a1b3cd" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:18.442086 14371 raft_consensus.cc:697] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:18.442013 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f00f645f7b64975879f3d45a8a1b3cd" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:18.443462 14032 raft_consensus.cc:3060] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.443897 14371 consensus_queue.cc:237] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.448524 14183 raft_consensus.cc:3060] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.451943 14376 raft_consensus.cc:493] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:18.456924 14376 raft_consensus.cc:515] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.459422 14376 leader_election.cc:290] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.460670 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:18.461566 14181 raft_consensus.cc:2468] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 0.
I20260709 13:23:18.462800 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:18.463567 14106 raft_consensus.cc:2468] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 0.
I20260709 13:23:18.464871 13997 leader_election.cc:304] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:18.465405 14032 raft_consensus.cc:2468] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:18.465143 14367 consensus_queue.cc:1048] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.463589 13929 catalog_manager.cc:5697] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:18.472296 14376 raft_consensus.cc:2804] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:18.472942 14376 raft_consensus.cc:493] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:18.473297 14376 raft_consensus.cc:3060] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.479672 14073 leader_election.cc:304] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:18.485601 14368 raft_consensus.cc:2804] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:18.486183 14368 raft_consensus.cc:697] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:18.487075 14368 consensus_queue.cc:237] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.487960 14183 raft_consensus.cc:2468] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 1.
I20260709 13:23:18.514209 14383 consensus_queue.cc:1048] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.534044 13929 catalog_manager.cc:5697] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 0 to 1, leader changed from <none> to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:18.542687 14376 raft_consensus.cc:515] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.545612 14376 leader_election.cc:290] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.547358 13928 catalog_manager.cc:5697] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:18.548962 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:18.549892 14183 raft_consensus.cc:3060] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.551033 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:18.551801 14106 raft_consensus.cc:3060] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.553455 14355 tablet_bootstrap.cc:492] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836: No bootstrap required, opened a new log
I20260709 13:23:18.554481 14355 ts_tablet_manager.cc:1403] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.008s
I20260709 13:23:18.558866 14355 raft_consensus.cc:359] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.559890 14355 raft_consensus.cc:385] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:18.560178 14355 raft_consensus.cc:740] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Initialized, Role: FOLLOWER
I20260709 13:23:18.560899 14355 consensus_queue.cc:260] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.563387 14355 ts_tablet_manager.cc:1434] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:23:18.565819 14383 consensus_queue.cc:1048] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.570744 14371 consensus_queue.cc:1048] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.581091 14106 raft_consensus.cc:2468] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 1.
I20260709 13:23:18.582780 13998 leader_election.cc:304] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:18.584029 14383 raft_consensus.cc:2804] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:18.584672 14383 raft_consensus.cc:697] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:18.585688 14383 consensus_queue.cc:237] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.593669 14183 raft_consensus.cc:2468] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 1.
W20260709 13:23:18.615296 13979 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:18.636049 14367 consensus_queue.cc:1048] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.661715 13929 catalog_manager.cc:5697] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 0 to 1, leader changed from <none> to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 1 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:18.663686 14323 consensus_queue.cc:1048] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.697177 14376 consensus_queue.cc:1048] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.773309 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8559cc216db4afb918ef75b3e3512ee"
dest_uuid: "db886523de6f4dd0b7d366f5276de514"
mode: GRACEFUL
new_leader_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:23:18.774554 14183 raft_consensus.cc:606] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Received request to transfer leadership to TS b662c9fb95644b5bb159e204db929836
I20260709 13:23:18.782202 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7"
dest_uuid: "db886523de6f4dd0b7d366f5276de514"
mode: GRACEFUL
new_leader_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:23:18.782940 14183 raft_consensus.cc:606] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Received request to transfer leadership to TS b662c9fb95644b5bb159e204db929836
I20260709 13:23:18.790185 14104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3"
dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
mode: GRACEFUL
new_leader_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:45642
I20260709 13:23:18.791263 14104 raft_consensus.cc:606] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Received request to transfer leadership to TS b662c9fb95644b5bb159e204db929836
I20260709 13:23:18.819406 14030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "298f745310a74a47876d52900df93041"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
mode: GRACEFUL
new_leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
 from {username='slave'} at 127.0.0.1:40944
I20260709 13:23:18.820135 14030 raft_consensus.cc:606] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Received request to transfer leadership to TS a2e8dad7b86a4cebb9d628fa7a5cf76e
I20260709 13:23:18.831502 14030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
mode: GRACEFUL
new_leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
 from {username='slave'} at 127.0.0.1:40944
I20260709 13:23:18.832242 14030 raft_consensus.cc:606] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Received request to transfer leadership to TS a2e8dad7b86a4cebb9d628fa7a5cf76e
I20260709 13:23:18.842140 14376 raft_consensus.cc:493] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:18.842963 14376 raft_consensus.cc:515] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.845481 14376 leader_election.cc:290] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:18.847198 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95e674505f34cea9f84dc6d5637d188" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db886523de6f4dd0b7d366f5276de514" is_pre_election: true
I20260709 13:23:18.847498 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95e674505f34cea9f84dc6d5637d188" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" is_pre_election: true
I20260709 13:23:18.848620 14106 raft_consensus.cc:2393] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b662c9fb95644b5bb159e204db929836 in current term 1: Already voted for candidate db886523de6f4dd0b7d366f5276de514 in this term.
I20260709 13:23:18.849633 14389 consensus_queue.cc:1048] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.850694 13998 leader_election.cc:304] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662c9fb95644b5bb159e204db929836; no voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514
I20260709 13:23:18.852100 14376 raft_consensus.cc:3060] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:18.863905 14376 raft_consensus.cc:2749] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:18.873477 14337 consensus_queue.cc:1048] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.875556 14368 consensus_queue.cc:1048] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.884924 14389 consensus_queue.cc:1048] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.941185 14389 raft_consensus.cc:993] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: : Instructing follower b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:18.941943 14389 raft_consensus.cc:1081] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Signalling peer b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:18.944231 14030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:23:18.945010 14030 raft_consensus.cc:493] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:18.945454 14030 raft_consensus.cc:3060] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:18.962172 14367 consensus_queue.cc:1048] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.969483 14030 raft_consensus.cc:515] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.970263 14389 consensus_queue.cc:1048] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:18.974025 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:18.974766 14106 raft_consensus.cc:3055] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:18.975106 14106 raft_consensus.cc:740] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:18.976009 14106 consensus_queue.cc:260] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:18.977416 14106 raft_consensus.cc:3060] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.002497 14389 consensus_queue.cc:1048] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:19.002982 14312 consensus_queue.cc:1048] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:19.017051 14030 leader_election.cc:290] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:19.023589 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2c5fc272842cc8f559b9d06ae7df3" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:19.026908 14106 raft_consensus.cc:2468] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:19.029590 13998 leader_election.cc:304] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:19.030984 14183 raft_consensus.cc:3060] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.035535 14383 raft_consensus.cc:2804] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:19.036612 14383 raft_consensus.cc:697] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:19.037639 14383 consensus_queue.cc:237] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.052750 14399 raft_consensus.cc:993] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: : Instructing follower b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:19.053295 14399 raft_consensus.cc:1081] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Signalling peer b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:19.056010 14032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:57690
I20260709 13:23:19.058290 14183 raft_consensus.cc:2468] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:19.058640 14032 raft_consensus.cc:493] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:19.059403 14032 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.063727 14367 raft_consensus.cc:993] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: : Instructing follower b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:19.064661 14367 raft_consensus.cc:1081] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Signalling peer b662c9fb95644b5bb159e204db929836 to start an election
I20260709 13:23:19.067481 14030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8559cc216db4afb918ef75b3e3512ee"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
 from {username='slave'} at 127.0.0.1:57690
I20260709 13:23:19.068379 14030 raft_consensus.cc:493] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:19.069339 14030 raft_consensus.cc:3060] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.077873 13930 catalog_manager.cc:5697] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 1 to 2, leader changed from a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66) to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:19.081650 14032 raft_consensus.cc:515] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.085681 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:19.086417 14106 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.086465 14032 leader_election.cc:290] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:19.087740 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:19.088286 14183 raft_consensus.cc:3055] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:19.088711 14183 raft_consensus.cc:740] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:19.089538 14183 consensus_queue.cc:260] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.090622 14183 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.095372 14106 raft_consensus.cc:2468] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:19.097573 13998 leader_election.cc:304] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:19.097465 14183 raft_consensus.cc:2468] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:19.098191 14030 raft_consensus.cc:515] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.098809 14383 raft_consensus.cc:2804] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:19.099377 14383 raft_consensus.cc:697] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:19.100414 14383 consensus_queue.cc:237] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.101975 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8559cc216db4afb918ef75b3e3512ee" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:19.102466 14030 leader_election.cc:290] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Requested vote from peers a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:19.102849 14106 raft_consensus.cc:3060] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.103190 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8559cc216db4afb918ef75b3e3512ee" candidate_uuid: "b662c9fb95644b5bb159e204db929836" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:19.103895 14181 raft_consensus.cc:3055] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:19.104251 14181 raft_consensus.cc:740] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:19.105235 14181 consensus_queue.cc:260] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.106729 14181 raft_consensus.cc:3060] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.111058 13930 catalog_manager.cc:5697] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 1 to 2, leader changed from db886523de6f4dd0b7d366f5276de514 (127.2.243.67) to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:19.112789 14106 raft_consensus.cc:2468] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:19.114265 13998 leader_election.cc:304] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:19.115185 14383 raft_consensus.cc:2804] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:19.115761 14181 raft_consensus.cc:2468] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662c9fb95644b5bb159e204db929836 in term 2.
I20260709 13:23:19.116042 14383 raft_consensus.cc:697] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Becoming Leader. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:19.117444 14383 consensus_queue.cc:237] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.128330 13930 catalog_manager.cc:5697] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 reported cstate change: term changed from 1 to 2, leader changed from db886523de6f4dd0b7d366f5276de514 (127.2.243.67) to b662c9fb95644b5bb159e204db929836 (127.2.243.65). New cstate: current_term: 2 leader_uuid: "b662c9fb95644b5bb159e204db929836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:19.158614 14376 raft_consensus.cc:993] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836: : Instructing follower a2e8dad7b86a4cebb9d628fa7a5cf76e to start an election
I20260709 13:23:19.159176 14383 raft_consensus.cc:1081] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Signalling peer a2e8dad7b86a4cebb9d628fa7a5cf76e to start an election
I20260709 13:23:19.161051 14106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "298f745310a74a47876d52900df93041"
dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
 from {username='slave'} at 127.0.0.1:35612
I20260709 13:23:19.161549 14106 raft_consensus.cc:493] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:19.161803 14106 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.168823 14106 raft_consensus.cc:515] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.171588 14106 leader_election.cc:290] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 2 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:19.173913 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298f745310a74a47876d52900df93041" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:19.174496 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298f745310a74a47876d52900df93041" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:19.175128 14030 raft_consensus.cc:3055] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:19.175310 14181 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.175709 14030 raft_consensus.cc:740] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:19.177067 14030 consensus_queue.cc:260] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.178568 14030 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.185382 14181 raft_consensus.cc:2468] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 2.
I20260709 13:23:19.187155 14072 leader_election.cc:304] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:19.188400 14421 raft_consensus.cc:2804] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:19.188957 14421 raft_consensus.cc:697] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:19.189952 14421 consensus_queue.cc:237] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.194341 14030 raft_consensus.cc:2468] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 2.
I20260709 13:23:19.203183 13930 catalog_manager.cc:5697] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 1 to 2, leader changed from b662c9fb95644b5bb159e204db929836 (127.2.243.65) to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:19.204654 14383 consensus_queue.cc:1048] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:19.214540 14376 raft_consensus.cc:993] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836: : Instructing follower a2e8dad7b86a4cebb9d628fa7a5cf76e to start an election
I20260709 13:23:19.215260 14323 raft_consensus.cc:1081] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Signalling peer a2e8dad7b86a4cebb9d628fa7a5cf76e to start an election
I20260709 13:23:19.221570 14383 consensus_queue.cc:1048] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:19.235284 14107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b"
dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
 from {username='slave'} at 127.0.0.1:35612
I20260709 13:23:19.237568 14107 raft_consensus.cc:493] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:19.238134 14107 raft_consensus.cc:3060] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.247572 14107 raft_consensus.cc:515] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.251857 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:19.252825 14030 raft_consensus.cc:3055] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:19.253268 14030 raft_consensus.cc:740] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:19.251796 14107 leader_election.cc:290] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 2 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631)
I20260709 13:23:19.254187 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075163cc1eca4043ba451af1a657f15b" candidate_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db886523de6f4dd0b7d366f5276de514"
I20260709 13:23:19.254226 14030 consensus_queue.cc:260] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.255616 14181 raft_consensus.cc:3060] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.256031 14030 raft_consensus.cc:3060] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.264036 14030 raft_consensus.cc:2468] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 2.
I20260709 13:23:19.264041 14181 raft_consensus.cc:2468] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e8dad7b86a4cebb9d628fa7a5cf76e in term 2.
I20260709 13:23:19.265802 14073 leader_election.cc:304] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, b662c9fb95644b5bb159e204db929836; no voters: 
I20260709 13:23:19.267148 14421 raft_consensus.cc:2804] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:19.267714 14421 raft_consensus.cc:697] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 LEADER]: Becoming Leader. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:19.268824 14421 consensus_queue.cc:237] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:19.277549 13929 catalog_manager.cc:5697] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e reported cstate change: term changed from 1 to 2, leader changed from b662c9fb95644b5bb159e204db929836 (127.2.243.65) to a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:19.482357 14183 raft_consensus.cc:1275] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.484045 14425 consensus_queue.cc:1048] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:19.494333 14107 raft_consensus.cc:1275] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.497223 14383 consensus_queue.cc:1048] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:19.512428 14107 raft_consensus.cc:1275] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.514031 14425 consensus_queue.cc:1048] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:19.524613 14183 raft_consensus.cc:1275] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.526656 14425 consensus_queue.cc:1048] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:19.597196 14032 raft_consensus.cc:1275] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Refusing update from remote peer a2e8dad7b86a4cebb9d628fa7a5cf76e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.598992 14389 consensus_queue.cc:1048] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:19.609035 14183 raft_consensus.cc:1275] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Refusing update from remote peer a2e8dad7b86a4cebb9d628fa7a5cf76e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.611146 14427 consensus_queue.cc:1048] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:19.640429 14107 raft_consensus.cc:1275] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.642274 14425 consensus_queue.cc:1048] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:19.649576 14183 raft_consensus.cc:1275] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Refusing update from remote peer b662c9fb95644b5bb159e204db929836: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.652616 14383 consensus_queue.cc:1048] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:19.786516 14183 raft_consensus.cc:1275] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Refusing update from remote peer a2e8dad7b86a4cebb9d628fa7a5cf76e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.788439 14368 consensus_queue.cc:1048] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:19.798648 14030 raft_consensus.cc:1275] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Refusing update from remote peer a2e8dad7b86a4cebb9d628fa7a5cf76e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:19.802214 14389 consensus_queue.cc:1048] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:21.845993 13931 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44854:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:23:21.876590 13931 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44854:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:23:21.913569  3021 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:23:22.025226 14452 log.cc:927] Time spent T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
W20260709 13:23:22.100195 14458 log.cc:927] Time spent T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:23:22.285959 14468 log.cc:927] Time spent T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:23:22.277670 14483 tablet.cc:1724] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.294528 14487 tablet.cc:1724] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.295164 14109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "298f745310a74a47876d52900df93041"
dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
mode: GRACEFUL
new_leader_uuid: "db886523de6f4dd0b7d366f5276de514"
 from {username='slave'} at 127.0.0.1:45658
W20260709 13:23:22.317667 14474 log.cc:927] Time spent T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.002s
W20260709 13:23:22.322784 14470 log.cc:927] Time spent T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514: Append to log took a long time: real 0.198s	user 0.005s	sys 0.000s
W20260709 13:23:22.326727 14481 log.cc:927] Time spent T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:23:22.382611 14059 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:f8559cc216db4afb918ef75b3e3512ee)
I20260709 13:23:22.307854 14109 raft_consensus.cc:606] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 LEADER]: Received request to transfer leadership to TS db886523de6f4dd0b7d366f5276de514
I20260709 13:23:22.414057 14493 tablet.cc:1724] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:23:22.414184 14475 log.cc:927] Time spent T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 13:23:22.417028 14427 raft_consensus.cc:993] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e: : Instructing follower db886523de6f4dd0b7d366f5276de514 to start an election
I20260709 13:23:22.417840 14489 raft_consensus.cc:1081] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 LEADER]: Signalling peer db886523de6f4dd0b7d366f5276de514 to start an election
I20260709 13:23:22.420243 14492 tablet.cc:1724] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.433405 14494 tablet.cc:1724] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.440894 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "298f745310a74a47876d52900df93041"
dest_uuid: "db886523de6f4dd0b7d366f5276de514"
 from {username='slave'} at 127.0.0.1:35132
I20260709 13:23:22.442163 14181 raft_consensus.cc:493] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:22.451310 14181 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:23:22.454144 14479 log.cc:927] Time spent T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
I20260709 13:23:22.299860 14486 tablet.cc:1724] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:23:22.457175 14059 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:298f745310a74a47876d52900df93041)
W20260709 13:23:22.458302 14059 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:298f745310a74a47876d52900df93041)
I20260709 13:23:22.436656 14491 tablet.cc:1724] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.531170 14181 raft_consensus.cc:515] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.533711 14181 leader_election.cc:290] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 3 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:22.492997 14495 tablet.cc:1724] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.539731 14498 tablet.cc:1724] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.543100 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298f745310a74a47876d52900df93041" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:22.539793 14499 tablet.cc:1724] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.544065 14033 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:22.559841 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298f745310a74a47876d52900df93041" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:22.563184 14109 raft_consensus.cc:3055] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:22.563552 14109 raft_consensus.cc:740] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:22.550153 14500 tablet.cc:1724] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.564643 14109 consensus_queue.cc:260] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.566516 14109 raft_consensus.cc:3060] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:22.577191 14502 tablet.cc:1724] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.588694 14483 tablet.cc:1724] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.637123 13931 catalog_manager.cc:5789] TS b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973) does not have the latest schema for tablet 98d2c5fc272842cc8f559b9d06ae7df3 (table soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]). Expected version 1 got 0
I20260709 13:23:22.639173 13931 catalog_manager.cc:5789] TS b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973) does not have the latest schema for tablet 463b007f16004ab5b8d8c835765fc26b (table soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]). Expected version 1 got 0
I20260709 13:23:22.640667 13931 catalog_manager.cc:5789] TS b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973) does not have the latest schema for tablet 2ccf4a9ab7cc4769991c3201e7ab29a7 (table soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]). Expected version 1 got 0
I20260709 13:23:22.644766 14491 tablet.cc:1724] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.639345 14109 raft_consensus.cc:2468] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 3.
I20260709 13:23:22.652168 14033 raft_consensus.cc:2468] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 3.
I20260709 13:23:22.651688 14492 tablet.cc:1724] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.654027 14148 leader_election.cc:304] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:22.655699 14432 raft_consensus.cc:2804] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:22.656301 14432 raft_consensus.cc:697] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 3 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:22.657713 14432 consensus_queue.cc:237] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.646003 14493 tablet.cc:1724] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.667177 14498 tablet.cc:1724] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.669807 14495 tablet.cc:1724] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.678081 14499 tablet.cc:1724] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.680244 14031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
mode: GRACEFUL
new_leader_uuid: "db886523de6f4dd0b7d366f5276de514"
 from {username='slave'} at 127.0.0.1:40958
I20260709 13:23:22.681125 14031 raft_consensus.cc:606] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Received request to transfer leadership to TS db886523de6f4dd0b7d366f5276de514
I20260709 13:23:22.682066 13930 catalog_manager.cc:5789] TS a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281) does not have the latest schema for tablet 075163cc1eca4043ba451af1a657f15b (table soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]). Expected version 1 got 0
I20260709 13:23:22.683336  3021 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:23:22.684203  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:22.686828 14486 tablet.cc:1724] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.686619 13929 catalog_manager.cc:5697] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 2 to 3, leader changed from a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66) to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:22.689174 13929 catalog_manager.cc:5789] TS db886523de6f4dd0b7d366f5276de514 (127.2.243.67:40631) does not have the latest schema for tablet 298f745310a74a47876d52900df93041 (table soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532]). Expected version 1 got 0
I20260709 13:23:22.692862 14487 tablet.cc:1724] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.691491 14493 tablet.cc:1724] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.694281 14483 tablet.cc:1724] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.696142 14494 tablet.cc:1724] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.700670 14500 tablet.cc:1724] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.716710 14109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5"
dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
mode: GRACEFUL
new_leader_uuid: "db886523de6f4dd0b7d366f5276de514"
 from {username='slave'} at 127.0.0.1:45658
I20260709 13:23:22.717706 14109 raft_consensus.cc:606] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 LEADER]: Received request to transfer leadership to TS db886523de6f4dd0b7d366f5276de514
I20260709 13:23:22.722570 14031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b"
dest_uuid: "b662c9fb95644b5bb159e204db929836"
mode: GRACEFUL
new_leader_uuid: "db886523de6f4dd0b7d366f5276de514"
 from {username='slave'} at 127.0.0.1:40958
I20260709 13:23:22.723554 14031 raft_consensus.cc:606] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Received request to transfer leadership to TS db886523de6f4dd0b7d366f5276de514
I20260709 13:23:22.726085  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:22.741088 14502 tablet.cc:1724] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.749636  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:22.803635 14487 tablet.cc:1724] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:22.855885 13931 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61: soft_deleted_table [id=374e4875760a4d82875e53f6a79b5532] alter complete (version 1)
I20260709 13:23:22.889030 14489 raft_consensus.cc:993] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: : Instructing follower db886523de6f4dd0b7d366f5276de514 to start an election
I20260709 13:23:22.889744 14464 raft_consensus.cc:1081] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 LEADER]: Signalling peer db886523de6f4dd0b7d366f5276de514 to start an election
I20260709 13:23:22.891878 14177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5"
dest_uuid: "db886523de6f4dd0b7d366f5276de514"
 from {username='slave'} at 127.0.0.1:35132
I20260709 13:23:22.892575 14177 raft_consensus.cc:493] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:22.892880 14177 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:22.899899 14177 raft_consensus.cc:515] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.902148 14177 leader_election.cc:290] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 4 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:22.903389 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:22.903793 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7c427864c4187a85097099bd95ab5" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:22.904274 14033 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:22.904625 14109 raft_consensus.cc:3055] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:23:22.905087 14109 raft_consensus.cc:740] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2e8dad7b86a4cebb9d628fa7a5cf76e, State: Running, Role: LEADER
I20260709 13:23:22.906263 14109 consensus_queue.cc:260] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.907828 14109 raft_consensus.cc:3060] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:22.913746 14033 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 4.
I20260709 13:23:22.915721 14148 leader_election.cc:304] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:22.916312 14109 raft_consensus.cc:2468] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 4.
I20260709 13:23:22.916918 14432 raft_consensus.cc:2804] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:23:22.917486 14432 raft_consensus.cc:697] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 4 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:22.918533 14432 consensus_queue.cc:237] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.928617 13930 catalog_manager.cc:5697] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 3 to 4, leader changed from a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66) to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 4 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:22.937667 14497 raft_consensus.cc:993] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836: : Instructing follower db886523de6f4dd0b7d366f5276de514 to start an election
I20260709 13:23:22.938390 14497 raft_consensus.cc:1081] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Signalling peer db886523de6f4dd0b7d366f5276de514 to start an election
I20260709 13:23:22.940719 14177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7"
dest_uuid: "db886523de6f4dd0b7d366f5276de514"
 from {username='slave'} at 127.0.0.1:35136
I20260709 13:23:22.941363 14177 raft_consensus.cc:493] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:22.941777 14177 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:22.948498 14177 raft_consensus.cc:515] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.950632 14177 leader_election.cc:290] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 3 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:22.951711 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:22.952005 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccf4a9ab7cc4769991c3201e7ab29a7" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:22.952534 14033 raft_consensus.cc:3055] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:22.952719 14109 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:22.952872 14033 raft_consensus.cc:740] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:22.953811 14033 consensus_queue.cc:260] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.954924 14033 raft_consensus.cc:3060] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:22.959815 14109 raft_consensus.cc:2468] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 3.
I20260709 13:23:22.961606 14033 raft_consensus.cc:2468] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 3.
I20260709 13:23:22.961735 14148 leader_election.cc:304] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e8dad7b86a4cebb9d628fa7a5cf76e, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:22.962740 14432 raft_consensus.cc:2804] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:22.963305 14432 raft_consensus.cc:697] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 3 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:22.964227 14432 consensus_queue.cc:237] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:22.972739 13930 catalog_manager.cc:5697] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 2 to 3, leader changed from b662c9fb95644b5bb159e204db929836 (127.2.243.65) to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:23.124577 14033 raft_consensus.cc:1275] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:23:23.126597 14433 raft_consensus.cc:993] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836: : Instructing follower db886523de6f4dd0b7d366f5276de514 to start an election
I20260709 13:23:23.126238 14485 consensus_queue.cc:1048] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:23:23.127315 14433 raft_consensus.cc:1081] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Signalling peer db886523de6f4dd0b7d366f5276de514 to start an election
I20260709 13:23:23.129091 14177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b"
dest_uuid: "db886523de6f4dd0b7d366f5276de514"
 from {username='slave'} at 127.0.0.1:35136
I20260709 13:23:23.129794 14177 raft_consensus.cc:493] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.130525 14177 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.147444 14109 raft_consensus.cc:1275] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:23:23.148965 14177 raft_consensus.cc:515] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:23.152519 14177 leader_election.cc:290] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 3 election: Requested vote from peers b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973), a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281)
I20260709 13:23:23.151818 14432 consensus_queue.cc:1048] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:23:23.156461 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b662c9fb95644b5bb159e204db929836"
I20260709 13:23:23.156960 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458e21aa52ba48889d4f90a877289f5b" candidate_uuid: "db886523de6f4dd0b7d366f5276de514" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e"
I20260709 13:23:23.157363 14033 raft_consensus.cc:3055] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:23.157770 14109 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.157943 14033 raft_consensus.cc:740] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b662c9fb95644b5bb159e204db929836, State: Running, Role: LEADER
I20260709 13:23:23.159730 14033 consensus_queue.cc:260] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:23.161356 14033 raft_consensus.cc:3060] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.169787 14033 raft_consensus.cc:2468] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 3.
I20260709 13:23:23.171241 14148 leader_election.cc:304] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b662c9fb95644b5bb159e204db929836, db886523de6f4dd0b7d366f5276de514; no voters: 
I20260709 13:23:23.172387 14109 raft_consensus.cc:2468] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db886523de6f4dd0b7d366f5276de514 in term 3.
I20260709 13:23:23.172402 14432 raft_consensus.cc:2804] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:23.173287 14432 raft_consensus.cc:697] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 3 LEADER]: Becoming Leader. State: Replica: db886523de6f4dd0b7d366f5276de514, State: Running, Role: LEADER
I20260709 13:23:23.174443 14432 consensus_queue.cc:237] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } }
I20260709 13:23:23.186781 13929 catalog_manager.cc:5697] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 reported cstate change: term changed from 2 to 3, leader changed from b662c9fb95644b5bb159e204db929836 (127.2.243.65) to db886523de6f4dd0b7d366f5276de514 (127.2.243.67). New cstate: current_term: 3 leader_uuid: "db886523de6f4dd0b7d366f5276de514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db886523de6f4dd0b7d366f5276de514" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 40631 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:23.427356 14033 raft_consensus.cc:1275] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:23:23.428987 14432 consensus_queue.cc:1048] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:23.439615 14109 raft_consensus.cc:1275] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:23:23.442432 14485 consensus_queue.cc:1048] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:23:23.453006 14033 raft_consensus.cc:1275] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 4 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:23:23.454821 14485 consensus_queue.cc:1048] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:23.467471 14106 raft_consensus.cc:1275] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 4 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:23:23.471021 14432 consensus_queue.cc:1048] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:23.623080 14109 raft_consensus.cc:1275] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:23.624730 14485 consensus_queue.cc:1048] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e8dad7b86a4cebb9d628fa7a5cf76e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:23.637101 14031 raft_consensus.cc:1275] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Refusing update from remote peer db886523de6f4dd0b7d366f5276de514: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:23.639564 14485 consensus_queue.cc:1048] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662c9fb95644b5bb159e204db929836" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:23.846447  3021 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:23:23.852816  3021 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:23:23.853413  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:23.859174  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:23:23.860090  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:24.903267  3021 tablet_server.cc:179] TabletServer@127.2.243.65:0 shutting down...
W20260709 13:23:24.934377 14148 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:23:24.942233 14148 consensus_peers.cc:597] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.951201  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:24.952265  3021 tablet_replica.cc:333] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.953747  3021 raft_consensus.cc:2243] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.954409  3021 raft_consensus.cc:2272] T 1f00f645f7b64975879f3d45a8a1b3cd P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.957249  3021 tablet_replica.cc:333] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.958065  3021 raft_consensus.cc:2243] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.958688  3021 raft_consensus.cc:2272] T 298f745310a74a47876d52900df93041 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.961228  3021 tablet_replica.cc:333] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.962260  3021 raft_consensus.cc:2243] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.963289  3021 raft_consensus.cc:2272] T 98d2c5fc272842cc8f559b9d06ae7df3 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.965700  3021 tablet_replica.cc:333] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.966419  3021 raft_consensus.cc:2243] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.967443  3021 raft_consensus.cc:2272] T aa7634f6546640e58cba32f0af843138 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.970366  3021 tablet_replica.cc:333] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.971352  3021 raft_consensus.cc:2243] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.972573  3021 raft_consensus.cc:2272] T 463b007f16004ab5b8d8c835765fc26b P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.975893  3021 tablet_replica.cc:333] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.976763  3021 raft_consensus.cc:2243] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.977340  3021 raft_consensus.cc:2272] T 1ee7c427864c4187a85097099bd95ab5 P b662c9fb95644b5bb159e204db929836 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.977664 14073 consensus_peers.cc:597] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.979969  3021 tablet_replica.cc:333] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.980890  3021 raft_consensus.cc:2243] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.981472  3021 raft_consensus.cc:2272] T 52e8dc4c3b70438c9f6bea36cb52d951 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.984136  3021 tablet_replica.cc:333] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.984879  3021 raft_consensus.cc:2243] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.985937  3021 raft_consensus.cc:2272] T 24c0c04ede294e58a16689d3caf7caa5 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.988692  3021 tablet_replica.cc:333] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.989403  3021 raft_consensus.cc:2243] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.989944  3021 raft_consensus.cc:2272] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.992888  3021 tablet_replica.cc:333] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.993654  3021 raft_consensus.cc:2243] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.994191  3021 raft_consensus.cc:2272] T c95e674505f34cea9f84dc6d5637d188 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.997309 14073 consensus_peers.cc:597] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.997596  3021 tablet_replica.cc:333] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:24.998505  3021 raft_consensus.cc:2243] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.999125  3021 raft_consensus.cc:2272] T 075163cc1eca4043ba451af1a657f15b P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.001904  3021 tablet_replica.cc:333] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:25.002624  3021 raft_consensus.cc:2243] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.003607  3021 raft_consensus.cc:2272] T f8559cc216db4afb918ef75b3e3512ee P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.006167  3021 tablet_replica.cc:333] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:25.006862  3021 raft_consensus.cc:2243] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.007383  3021 raft_consensus.cc:2272] T 65ab465ed9a74b04a7fa5d843d888abc P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.010070  3021 tablet_replica.cc:333] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:25.010721  3021 raft_consensus.cc:2243] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.011261  3021 raft_consensus.cc:2272] T 98d12d39c60e4af992a9477a7b5f7349 P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.014170  3021 tablet_replica.cc:333] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:25.015065  3021 raft_consensus.cc:2243] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.015561  3021 raft_consensus.cc:2272] T 458e21aa52ba48889d4f90a877289f5b P b662c9fb95644b5bb159e204db929836 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.019057  3021 tablet_replica.cc:333] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:25.019785  3021 raft_consensus.cc:2243] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.020632  3021 raft_consensus.cc:2272] T 238f1767354e4e6a85680d8362f770eb P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.024892  3021 tablet_replica.cc:333] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836: stopping tablet replica
W20260709 13:23:25.025295 14073 consensus_peers.cc:597] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.025718  3021 raft_consensus.cc:2243] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.026979  3021 raft_consensus.cc:2272] T a9e0aefcfd114f658f43a25a0b39c7f1 P b662c9fb95644b5bb159e204db929836 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.030180  3021 tablet_replica.cc:333] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836: stopping tablet replica
I20260709 13:23:25.030822  3021 raft_consensus.cc:2243] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.031868  3021 raft_consensus.cc:2272] T eb1f2a2970624c2781536ca8d63094fd P b662c9fb95644b5bb159e204db929836 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.043805 14148 consensus_peers.cc:597] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.073154  3021 tablet_server.cc:196] TabletServer@127.2.243.65:0 shutdown complete.
W20260709 13:23:25.099974 14148 consensus_peers.cc:597] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:37973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.127895  3021 tablet_server.cc:179] TabletServer@127.2.243.66:0 shutting down...
W20260709 13:23:25.160507 14073 consensus_peers.cc:597] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:37973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.167888 14148 consensus_peers.cc:597] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:37973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.172989  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:25.174024  3021 tablet_replica.cc:333] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.174981  3021 raft_consensus.cc:2243] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.176513  3021 raft_consensus.cc:2272] T 1f00f645f7b64975879f3d45a8a1b3cd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.179361  3021 tablet_replica.cc:333] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.180054  3021 raft_consensus.cc:2243] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.181125  3021 raft_consensus.cc:2272] T aa7634f6546640e58cba32f0af843138 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.183476  3021 tablet_replica.cc:333] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.184126  3021 raft_consensus.cc:2243] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.184675  3021 raft_consensus.cc:2272] T 463b007f16004ab5b8d8c835765fc26b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.186968  3021 tablet_replica.cc:333] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.187646  3021 raft_consensus.cc:2243] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.188619  3021 raft_consensus.cc:2272] T 298f745310a74a47876d52900df93041 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.191357  3021 tablet_replica.cc:333] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.192289  3021 raft_consensus.cc:2243] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.192936  3021 raft_consensus.cc:2272] T 98d2c5fc272842cc8f559b9d06ae7df3 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.195309  3021 tablet_replica.cc:333] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.196062  3021 raft_consensus.cc:2243] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.196663  3021 raft_consensus.cc:2272] T 98d12d39c60e4af992a9477a7b5f7349 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.199219  3021 tablet_replica.cc:333] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.199913  3021 raft_consensus.cc:2243] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.200475  3021 raft_consensus.cc:2272] T 458e21aa52ba48889d4f90a877289f5b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.203094  3021 tablet_replica.cc:333] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.203799  3021 raft_consensus.cc:2243] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.204319  3021 raft_consensus.cc:2272] T 24c0c04ede294e58a16689d3caf7caa5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.206527  3021 tablet_replica.cc:333] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.207118  3021 raft_consensus.cc:2243] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.207952  3021 raft_consensus.cc:2272] T 1ee7c427864c4187a85097099bd95ab5 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.210759  3021 tablet_replica.cc:333] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.211536  3021 raft_consensus.cc:2243] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.212750  3021 raft_consensus.cc:2272] T 52e8dc4c3b70438c9f6bea36cb52d951 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.215703  3021 tablet_replica.cc:333] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.216470  3021 raft_consensus.cc:2243] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.217206  3021 raft_consensus.cc:2272] T a9e0aefcfd114f658f43a25a0b39c7f1 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.220518  3021 tablet_replica.cc:333] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.221372  3021 raft_consensus.cc:2243] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.222445  3021 raft_consensus.cc:2272] T 238f1767354e4e6a85680d8362f770eb P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.225200  3021 tablet_replica.cc:333] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.225867  3021 raft_consensus.cc:2243] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.226423  3021 raft_consensus.cc:2272] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.228904  3021 tablet_replica.cc:333] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.229511  3021 raft_consensus.cc:2243] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.230403  3021 raft_consensus.cc:2272] T 075163cc1eca4043ba451af1a657f15b P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.232908  3021 tablet_replica.cc:333] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.233510  3021 raft_consensus.cc:2243] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.233974  3021 raft_consensus.cc:2272] T c95e674505f34cea9f84dc6d5637d188 P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.236261  3021 tablet_replica.cc:333] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.237203  3021 raft_consensus.cc:2243] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.237843  3021 raft_consensus.cc:2272] T f8559cc216db4afb918ef75b3e3512ee P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.241057  3021 tablet_replica.cc:333] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.241834  3021 raft_consensus.cc:2243] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.242957  3021 raft_consensus.cc:2272] T 65ab465ed9a74b04a7fa5d843d888abc P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.243573 14148 consensus_peers.cc:597] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:37973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.246259  3021 tablet_replica.cc:333] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e: stopping tablet replica
I20260709 13:23:25.247349  3021 raft_consensus.cc:2243] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.248234  3021 raft_consensus.cc:2272] T eb1f2a2970624c2781536ca8d63094fd P a2e8dad7b86a4cebb9d628fa7a5cf76e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.270023 14148 consensus_peers.cc:597] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 -> Peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Couldn't send request to peer a2e8dad7b86a4cebb9d628fa7a5cf76e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.277593 14148 consensus_peers.cc:597] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 -> Peer b662c9fb95644b5bb159e204db929836 (127.2.243.65:37973): Couldn't send request to peer b662c9fb95644b5bb159e204db929836. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:37973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.301874 14148 consensus_peers.cc:597] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 -> Peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Couldn't send request to peer a2e8dad7b86a4cebb9d628fa7a5cf76e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:39281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.302587  3021 tablet_server.cc:196] TabletServer@127.2.243.66:0 shutdown complete.
I20260709 13:23:25.348850  3021 tablet_server.cc:179] TabletServer@127.2.243.67:0 shutting down...
I20260709 13:23:25.386050  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:25.386942  3021 tablet_replica.cc:333] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.387912  3021 raft_consensus.cc:2243] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.388723  3021 raft_consensus.cc:2272] T 1f00f645f7b64975879f3d45a8a1b3cd P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.391525  3021 tablet_replica.cc:333] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.392391  3021 raft_consensus.cc:2243] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.393462  3021 raft_consensus.cc:2272] T 298f745310a74a47876d52900df93041 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.396065  3021 tablet_replica.cc:333] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.396931  3021 raft_consensus.cc:2243] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.397557  3021 raft_consensus.cc:2272] T aa7634f6546640e58cba32f0af843138 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.399912  3021 tablet_replica.cc:333] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.400660  3021 raft_consensus.cc:2243] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.401185  3021 raft_consensus.cc:2272] T 463b007f16004ab5b8d8c835765fc26b P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.403514  3021 tablet_replica.cc:333] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.404193  3021 raft_consensus.cc:2243] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.405174  3021 raft_consensus.cc:2272] T 2ccf4a9ab7cc4769991c3201e7ab29a7 P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.407465  3021 tablet_replica.cc:333] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.408043  3021 raft_consensus.cc:2243] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.408602  3021 raft_consensus.cc:2272] T 98d2c5fc272842cc8f559b9d06ae7df3 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.410903  3021 tablet_replica.cc:333] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.411494  3021 raft_consensus.cc:2243] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.412470  3021 raft_consensus.cc:2272] T c95e674505f34cea9f84dc6d5637d188 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.414752  3021 tablet_replica.cc:333] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.415320  3021 raft_consensus.cc:2243] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.415763  3021 raft_consensus.cc:2272] T 075163cc1eca4043ba451af1a657f15b P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.418321  3021 tablet_replica.cc:333] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.418910  3021 raft_consensus.cc:2243] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.419407  3021 raft_consensus.cc:2272] T f8559cc216db4afb918ef75b3e3512ee P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.422801  3021 tablet_replica.cc:333] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.423589  3021 raft_consensus.cc:2243] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.424228  3021 raft_consensus.cc:2272] T 65ab465ed9a74b04a7fa5d843d888abc P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.425762 14148 consensus_peers.cc:597] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 -> Peer a2e8dad7b86a4cebb9d628fa7a5cf76e (127.2.243.66:39281): Couldn't send request to peer a2e8dad7b86a4cebb9d628fa7a5cf76e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:39281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.427348  3021 tablet_replica.cc:333] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.427990  3021 raft_consensus.cc:2243] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.428534  3021 raft_consensus.cc:2272] T 52e8dc4c3b70438c9f6bea36cb52d951 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.431363  3021 tablet_replica.cc:333] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.432425  3021 raft_consensus.cc:2243] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.433416  3021 raft_consensus.cc:2272] T 1ee7c427864c4187a85097099bd95ab5 P db886523de6f4dd0b7d366f5276de514 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.435932  3021 tablet_replica.cc:333] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.436687  3021 raft_consensus.cc:2243] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.437258  3021 raft_consensus.cc:2272] T 24c0c04ede294e58a16689d3caf7caa5 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.439723  3021 tablet_replica.cc:333] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.440444  3021 raft_consensus.cc:2243] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.440987  3021 raft_consensus.cc:2272] T eb1f2a2970624c2781536ca8d63094fd P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.443775  3021 tablet_replica.cc:333] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.444985  3021 raft_consensus.cc:2243] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.445696  3021 raft_consensus.cc:2272] T 238f1767354e4e6a85680d8362f770eb P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.449538  3021 tablet_replica.cc:333] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.450244  3021 raft_consensus.cc:2243] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.450973  3021 raft_consensus.cc:2272] T a9e0aefcfd114f658f43a25a0b39c7f1 P db886523de6f4dd0b7d366f5276de514 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.454161  3021 tablet_replica.cc:333] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.454721  3021 raft_consensus.cc:2243] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.455662  3021 raft_consensus.cc:2272] T 98d12d39c60e4af992a9477a7b5f7349 P db886523de6f4dd0b7d366f5276de514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.458488  3021 tablet_replica.cc:333] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514: stopping tablet replica
I20260709 13:23:25.459383  3021 raft_consensus.cc:2243] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.460652  3021 raft_consensus.cc:2272] T 458e21aa52ba48889d4f90a877289f5b P db886523de6f4dd0b7d366f5276de514 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.509604  3021 tablet_server.cc:196] TabletServer@127.2.243.67:0 shutdown complete.
I20260709 13:23:25.554421  3021 master.cc:562] Master@127.2.243.126:39909 shutting down...
I20260709 13:23:25.583880  3021 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.584579  3021 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.584928  3021 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0154e0f52e0d401593c0fb7434671c61: stopping tablet replica
I20260709 13:23:25.631408  3021 master.cc:584] Master@127.2.243.126:39909 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (15367 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:23:25.697985  3021 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.243.126:40583
I20260709 13:23:25.699375  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:25.706835 14527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:25.707708 14528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:25.708398 14530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:25.709371  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:25.710443  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:25.710640  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:25.710832  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603405710815 us; error 0 us; skew 500 ppm
I20260709 13:23:25.711447  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:25.714650  3021 webserver.cc:533] Webserver started at http://127.2.243.126:40067/ using document root <none> and password file <none>
I20260709 13:23:25.715261  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:25.715451  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:25.715785  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:25.717393  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/master-0-root/instance:
uuid: "b4905a0328fe450f845b63dc7f028e58"
format_stamp: "Formatted at 2026-07-09 13:23:25 on dist-test-slave-ftjc"
I20260709 13:23:25.723937  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:23:25.731235 14535 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:25.732445  3021 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:23:25.732831  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/master-0-root
uuid: "b4905a0328fe450f845b63dc7f028e58"
format_stamp: "Formatted at 2026-07-09 13:23:25 on dist-test-slave-ftjc"
I20260709 13:23:25.733129  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:25.746691  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:25.748198  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:25.799319  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.126:40583
I20260709 13:23:25.799456 14586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.126:40583 every 8 connection(s)
I20260709 13:23:25.804214 14587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:25.819080 14587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58: Bootstrap starting.
I20260709 13:23:25.825574 14587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:25.831068 14587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58: No bootstrap required, opened a new log
I20260709 13:23:25.833902 14587 raft_consensus.cc:359] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4905a0328fe450f845b63dc7f028e58" member_type: VOTER }
I20260709 13:23:25.834364 14587 raft_consensus.cc:385] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:25.834712 14587 raft_consensus.cc:740] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4905a0328fe450f845b63dc7f028e58, State: Initialized, Role: FOLLOWER
I20260709 13:23:25.835462 14587 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4905a0328fe450f845b63dc7f028e58" member_type: VOTER }
I20260709 13:23:25.835983 14587 raft_consensus.cc:399] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:25.836220 14587 raft_consensus.cc:493] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:25.836618 14587 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:25.842777 14587 raft_consensus.cc:515] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4905a0328fe450f845b63dc7f028e58" member_type: VOTER }
I20260709 13:23:25.843453 14587 leader_election.cc:304] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4905a0328fe450f845b63dc7f028e58; no voters: 
I20260709 13:23:25.845063 14587 leader_election.cc:290] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:25.845928 14590 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:25.848016 14590 raft_consensus.cc:697] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 1 LEADER]: Becoming Leader. State: Replica: b4905a0328fe450f845b63dc7f028e58, State: Running, Role: LEADER
I20260709 13:23:25.848582 14587 sys_catalog.cc:565] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:25.848785 14590 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4905a0328fe450f845b63dc7f028e58" member_type: VOTER }
I20260709 13:23:25.854583 14591 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4905a0328fe450f845b63dc7f028e58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4905a0328fe450f845b63dc7f028e58" member_type: VOTER } }
I20260709 13:23:25.854957 14592 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4905a0328fe450f845b63dc7f028e58. Latest consensus state: current_term: 1 leader_uuid: "b4905a0328fe450f845b63dc7f028e58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4905a0328fe450f845b63dc7f028e58" member_type: VOTER } }
I20260709 13:23:25.856078 14591 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:25.856664 14592 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:25.859105 14598 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:25.868404 14598 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:25.869652  3021 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:25.880163 14598 catalog_manager.cc:1383] Generated new cluster ID: 3c37742fe1314ef4b14250c1b220407c
I20260709 13:23:25.880615 14598 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:25.900866 14598 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:25.902565 14598 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:25.925870 14598 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58: Generated new TSK 0
I20260709 13:23:25.926630 14598 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:25.937239  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:25.944461 14608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:25.945873 14609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:25.947799 14611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:25.948261  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:25.949333  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:25.949523  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:25.949663  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603405949651 us; error 0 us; skew 500 ppm
I20260709 13:23:25.950366  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:25.953271  3021 webserver.cc:533] Webserver started at http://127.2.243.65:33657/ using document root <none> and password file <none>
I20260709 13:23:25.953770  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:25.953933  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:25.954159  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:25.955368  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-0-root/instance:
uuid: "c3f2cb06911b4753b819d30987a8073e"
format_stamp: "Formatted at 2026-07-09 13:23:25 on dist-test-slave-ftjc"
I20260709 13:23:25.960899  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:23:25.965548 14616 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:25.966570  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:23:25.966929  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-0-root
uuid: "c3f2cb06911b4753b819d30987a8073e"
format_stamp: "Formatted at 2026-07-09 13:23:25 on dist-test-slave-ftjc"
I20260709 13:23:25.967223  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:25.991290  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:25.992942  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:25.994671  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:25.997386  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:25.997628  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:25.997888  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:25.998081  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.048655  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.65:44275
I20260709 13:23:26.048784 14678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.65:44275 every 8 connection(s)
I20260709 13:23:26.054705  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:26.064926 14684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:26.064023 14683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:26.068821 14686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:26.069089  3021 server_base.cc:1061] running on GCE node
I20260709 13:23:26.070539  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:26.070842  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:26.071048  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603406071029 us; error 0 us; skew 500 ppm
I20260709 13:23:26.071828  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:26.075664  3021 webserver.cc:533] Webserver started at http://127.2.243.66:43691/ using document root <none> and password file <none>
I20260709 13:23:26.076400 14679 heartbeater.cc:344] Connected to a master server at 127.2.243.126:40583
I20260709 13:23:26.076447  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:26.076972 14679 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:26.076994  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:26.077488  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:26.077997 14679 heartbeater.cc:507] Master 127.2.243.126:40583 requested a full tablet report, sending...
I20260709 13:23:26.078902  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-1-root/instance:
uuid: "05553f7076ed412989bffbd7a001751e"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ftjc"
I20260709 13:23:26.080672 14552 ts_manager.cc:194] Registered new tserver with Master: c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275)
I20260709 13:23:26.083400 14552 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60076
I20260709 13:23:26.086256  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:23:26.091686 14691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.092825  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:23:26.093156  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-1-root
uuid: "05553f7076ed412989bffbd7a001751e"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ftjc"
I20260709 13:23:26.093446  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:26.127301  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:26.128883  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:26.130630  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:26.133495  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:26.133718  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.134070  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:26.134222  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.192364  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.66:33693
I20260709 13:23:26.192579 14753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.66:33693 every 8 connection(s)
I20260709 13:23:26.198648  3021 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:26.207108 14757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:26.209127 14758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:26.210951 14754 heartbeater.cc:344] Connected to a master server at 127.2.243.126:40583
I20260709 13:23:26.211642 14754 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:26.212869 14754 heartbeater.cc:507] Master 127.2.243.126:40583 requested a full tablet report, sending...
I20260709 13:23:26.214089  3021 server_base.cc:1061] running on GCE node
W20260709 13:23:26.214309 14760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:26.215709  3021 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:26.216048  3021 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:26.215857 14552 ts_manager.cc:194] Registered new tserver with Master: 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:26.216367  3021 hybrid_clock.cc:648] HybridClock initialized: now 1783603406216317 us; error 0 us; skew 500 ppm
I20260709 13:23:26.217309  3021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:26.218196 14552 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60088
I20260709 13:23:26.221689  3021 webserver.cc:533] Webserver started at http://127.2.243.67:36681/ using document root <none> and password file <none>
I20260709 13:23:26.222600  3021 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:26.222826  3021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:26.223062  3021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:26.225174  3021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-2-root/instance:
uuid: "e9761becfc5946af903b06479e745741"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ftjc"
I20260709 13:23:26.232043  3021 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:23:26.237264 14765 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.238438  3021 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:23:26.238858  3021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-2-root
uuid: "e9761becfc5946af903b06479e745741"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ftjc"
I20260709 13:23:26.239169  3021 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUtFmaG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603048513324-3021-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:26.264442  3021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:26.265827  3021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:26.267447  3021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:26.270332  3021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:26.270589  3021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.270855  3021 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:26.271037  3021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.324115  3021 rpc_server.cc:307] RPC server started. Bound to: 127.2.243.67:44429
I20260709 13:23:26.324263 14827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.243.67:44429 every 8 connection(s)
I20260709 13:23:26.341850 14828 heartbeater.cc:344] Connected to a master server at 127.2.243.126:40583
I20260709 13:23:26.342626 14828 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:26.343559 14828 heartbeater.cc:507] Master 127.2.243.126:40583 requested a full tablet report, sending...
I20260709 13:23:26.346418 14552 ts_manager.cc:194] Registered new tserver with Master: e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:26.347237  3021 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019327611s
I20260709 13:23:26.348412 14552 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60098
I20260709 13:23:26.381531 14552 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60114:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:26.384768 14552 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:26.475099 14719 tablet_service.cc:1511] Processing CreateTablet for tablet af47e2740f25491dae550fe984a63891 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:26.475487 14718 tablet_service.cc:1511] Processing CreateTablet for tablet 608206fd924d4a1388a4c651cd04e6fa (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:26.476995 14719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af47e2740f25491dae550fe984a63891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.476502 14717 tablet_service.cc:1511] Processing CreateTablet for tablet 19b8fb3c4ec84237b08fbe99ebc60f60 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:26.477730 14718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608206fd924d4a1388a4c651cd04e6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.479234 14716 tablet_service.cc:1511] Processing CreateTablet for tablet 7edaca98e9dd47f3bd0a4d49716193db (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:26.480882 14716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edaca98e9dd47f3bd0a4d49716193db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.484506 14715 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3371995d104e5989a49ef93aafb78e (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:26.486527 14715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3371995d104e5989a49ef93aafb78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.488417 14714 tablet_service.cc:1511] Processing CreateTablet for tablet d22eed3e0be240859f8b98b4d3f2f7c1 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:26.495543 14717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b8fb3c4ec84237b08fbe99ebc60f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.497078 14714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22eed3e0be240859f8b98b4d3f2f7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.512152 14713 tablet_service.cc:1511] Processing CreateTablet for tablet b3fa1e98bf304a84bf3940a40d480450 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:26.514530 14713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fa1e98bf304a84bf3940a40d480450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.525799 14792 tablet_service.cc:1511] Processing CreateTablet for tablet 608206fd924d4a1388a4c651cd04e6fa (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:26.527683 14792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608206fd924d4a1388a4c651cd04e6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.529806 14791 tablet_service.cc:1511] Processing CreateTablet for tablet 19b8fb3c4ec84237b08fbe99ebc60f60 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:26.532124 14791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b8fb3c4ec84237b08fbe99ebc60f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.533965 14711 tablet_service.cc:1511] Processing CreateTablet for tablet f414b45b72b34f86a9538d95740342ee (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:26.535840 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f414b45b72b34f86a9538d95740342ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.537869 14712 tablet_service.cc:1511] Processing CreateTablet for tablet 61bc727a8c5e4cf4bad18fc1dc5a9f5a (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:26.540097 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bc727a8c5e4cf4bad18fc1dc5a9f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.540194 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3371995d104e5989a49ef93aafb78e (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:26.542428 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3371995d104e5989a49ef93aafb78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.542227 14787 tablet_service.cc:1511] Processing CreateTablet for tablet b3fa1e98bf304a84bf3940a40d480450 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:26.544051 14787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fa1e98bf304a84bf3940a40d480450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.523609 14793 tablet_service.cc:1511] Processing CreateTablet for tablet af47e2740f25491dae550fe984a63891 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:26.540282 14788 tablet_service.cc:1511] Processing CreateTablet for tablet d22eed3e0be240859f8b98b4d3f2f7c1 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:26.538141 14790 tablet_service.cc:1511] Processing CreateTablet for tablet 7edaca98e9dd47f3bd0a4d49716193db (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:26.546989 14786 tablet_service.cc:1511] Processing CreateTablet for tablet 61bc727a8c5e4cf4bad18fc1dc5a9f5a (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:26.550571 14785 tablet_service.cc:1511] Processing CreateTablet for tablet f414b45b72b34f86a9538d95740342ee (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:26.556910 14793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af47e2740f25491dae550fe984a63891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.558434 14785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f414b45b72b34f86a9538d95740342ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.561244 14786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bc727a8c5e4cf4bad18fc1dc5a9f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.564919 14790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edaca98e9dd47f3bd0a4d49716193db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.572978 14788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22eed3e0be240859f8b98b4d3f2f7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.607349 14843 tablet_bootstrap.cc:492] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:26.622653 14644 tablet_service.cc:1511] Processing CreateTablet for tablet af47e2740f25491dae550fe984a63891 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:26.625676 14643 tablet_service.cc:1511] Processing CreateTablet for tablet 608206fd924d4a1388a4c651cd04e6fa (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:26.627696 14644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af47e2740f25491dae550fe984a63891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.632841 14643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608206fd924d4a1388a4c651cd04e6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.639763 14843 tablet_bootstrap.cc:654] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.642087 14641 tablet_service.cc:1511] Processing CreateTablet for tablet 7edaca98e9dd47f3bd0a4d49716193db (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:26.643956 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edaca98e9dd47f3bd0a4d49716193db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.646416 14640 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3371995d104e5989a49ef93aafb78e (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:26.651489 14639 tablet_service.cc:1511] Processing CreateTablet for tablet d22eed3e0be240859f8b98b4d3f2f7c1 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:26.639730 14642 tablet_service.cc:1511] Processing CreateTablet for tablet 19b8fb3c4ec84237b08fbe99ebc60f60 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:26.653126 14638 tablet_service.cc:1511] Processing CreateTablet for tablet b3fa1e98bf304a84bf3940a40d480450 (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:26.653824 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22eed3e0be240859f8b98b4d3f2f7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.654867 14638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fa1e98bf304a84bf3940a40d480450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.657996 14637 tablet_service.cc:1511] Processing CreateTablet for tablet 61bc727a8c5e4cf4bad18fc1dc5a9f5a (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:26.659782 14640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3371995d104e5989a49ef93aafb78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.661798 14636 tablet_service.cc:1511] Processing CreateTablet for tablet f414b45b72b34f86a9538d95740342ee (DEFAULT_TABLE table=test-workload [id=fba14ff832c44d39aa3efc6d88615f7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:26.663237 14642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b8fb3c4ec84237b08fbe99ebc60f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.669463 14637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bc727a8c5e4cf4bad18fc1dc5a9f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.679488 14636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f414b45b72b34f86a9538d95740342ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.702987 14844 tablet_bootstrap.cc:492] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:26.718538 14844 tablet_bootstrap.cc:654] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.730849 14843 tablet_bootstrap.cc:492] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:26.744817 14843 ts_tablet_manager.cc:1403] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.011s
I20260709 13:23:26.757031 14843 raft_consensus.cc:359] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.758515 14843 raft_consensus.cc:385] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.758994 14843 raft_consensus.cc:740] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.760210 14843 consensus_queue.cc:260] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.770738 14847 tablet_bootstrap.cc:492] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:26.782568 14844 tablet_bootstrap.cc:492] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:26.783353 14844 ts_tablet_manager.cc:1403] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.006s
I20260709 13:23:26.787343 14844 raft_consensus.cc:359] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.788313 14844 raft_consensus.cc:385] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.789796 14844 raft_consensus.cc:740] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.790966 14844 consensus_queue.cc:260] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.792594 14847 tablet_bootstrap.cc:654] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.797260 14828 heartbeater.cc:499] Master 127.2.243.126:40583 was elected leader, sending a full tablet report...
I20260709 13:23:26.797477 14843 ts_tablet_manager.cc:1434] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.052s	user 0.014s	sys 0.005s
I20260709 13:23:26.798460 14754 heartbeater.cc:499] Master 127.2.243.126:40583 was elected leader, sending a full tablet report...
I20260709 13:23:26.802217 14843 tablet_bootstrap.cc:492] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:26.807837 14844 ts_tablet_manager.cc:1434] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.005s
I20260709 13:23:26.810020 14844 tablet_bootstrap.cc:492] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:26.810290 14843 tablet_bootstrap.cc:654] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.823081 14847 tablet_bootstrap.cc:492] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:26.823298 14844 tablet_bootstrap.cc:654] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.823778 14847 ts_tablet_manager.cc:1403] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.018s
I20260709 13:23:26.823127 14843 tablet_bootstrap.cc:492] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:26.825969 14843 ts_tablet_manager.cc:1403] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.001s
I20260709 13:23:26.827627 14847 raft_consensus.cc:359] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
W20260709 13:23:26.829242 14829 tablet.cc:2406] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:23:26.828645 14847 raft_consensus.cc:385] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.830616 14847 raft_consensus.cc:740] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.831548 14847 consensus_queue.cc:260] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.831982 14843 raft_consensus.cc:359] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:26.832964 14843 raft_consensus.cc:385] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.833503 14843 raft_consensus.cc:740] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.834954 14843 consensus_queue.cc:260] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:26.839061 14843 ts_tablet_manager.cc:1434] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:23:26.850353 14848 raft_consensus.cc:493] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:26.851130 14844 tablet_bootstrap.cc:492] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:26.851856 14844 ts_tablet_manager.cc:1403] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.042s	user 0.029s	sys 0.000s
I20260709 13:23:26.851289 14848 raft_consensus.cc:515] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:26.855749 14844 raft_consensus.cc:359] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.856877 14844 raft_consensus.cc:385] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.857219 14844 raft_consensus.cc:740] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.858179 14844 consensus_queue.cc:260] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.861860 14844 ts_tablet_manager.cc:1434] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:23:26.863077 14844 tablet_bootstrap.cc:492] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741: Bootstrap starting.
W20260709 13:23:26.864265 14600 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:26.865887 14848 leader_election.cc:290] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9761becfc5946af903b06479e745741 (127.2.243.67:44429), c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275)
I20260709 13:23:26.871361 14679 heartbeater.cc:499] Master 127.2.243.126:40583 was elected leader, sending a full tablet report...
I20260709 13:23:26.874075 14847 ts_tablet_manager.cc:1434] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.050s	user 0.016s	sys 0.024s
I20260709 13:23:26.849545 14843 tablet_bootstrap.cc:492] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:26.875860 14847 tablet_bootstrap.cc:492] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:26.880924 14849 raft_consensus.cc:493] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:26.881733 14849 raft_consensus.cc:515] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.888124 14843 tablet_bootstrap.cc:654] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.891448 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af47e2740f25491dae550fe984a63891" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:26.897104 14844 tablet_bootstrap.cc:654] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:26.897989 14692 leader_election.cc:343] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9761becfc5946af903b06479e745741 (127.2.243.67:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:26.901118 14849 leader_election.cc:290] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:26.909401 14847 tablet_bootstrap.cc:654] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.915117 14654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af47e2740f25491dae550fe984a63891" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
W20260709 13:23:26.917846 14695 leader_election.cc:343] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:26.918552 14695 leader_election.cc:304] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05553f7076ed412989bffbd7a001751e; no voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741
I20260709 13:23:26.919165 14844 tablet_bootstrap.cc:492] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:26.919932 14844 ts_tablet_manager.cc:1403] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.001s
I20260709 13:23:26.919834 14848 raft_consensus.cc:2749] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:26.922192 14849 raft_consensus.cc:493] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:26.923228 14849 raft_consensus.cc:515] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.923972 14844 raft_consensus.cc:359] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.925005 14844 raft_consensus.cc:385] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.925372 14844 raft_consensus.cc:740] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.926644 14849 leader_election.cc:290] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:26.926477 14844 consensus_queue.cc:260] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.928745 14843 tablet_bootstrap.cc:492] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:26.929811 14843 ts_tablet_manager.cc:1403] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.009s
I20260709 13:23:26.932771 14847 tablet_bootstrap.cc:492] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:26.933610 14847 ts_tablet_manager.cc:1403] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.002s
I20260709 13:23:26.933961 14843 raft_consensus.cc:359] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.935170 14843 raft_consensus.cc:385] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.935515 14843 raft_consensus.cc:740] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.936601 14843 consensus_queue.cc:260] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.939462 14843 ts_tablet_manager.cc:1434] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:23:26.939769 14844 ts_tablet_manager.cc:1434] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:23:26.941071 14843 tablet_bootstrap.cc:492] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:26.948555 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:26.948611 14654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:26.951719 14843 tablet_bootstrap.cc:654] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.937698 14847 raft_consensus.cc:359] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.953254 14847 raft_consensus.cc:385] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.953696 14847 raft_consensus.cc:740] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.954701 14847 consensus_queue.cc:260] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.955615 14654 raft_consensus.cc:2468] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 0.
I20260709 13:23:26.957177 14847 ts_tablet_manager.cc:1434] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
W20260709 13:23:26.957847 14769 leader_election.cc:343] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:26.958568 14847 tablet_bootstrap.cc:492] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:26.959118 14769 leader_election.cc:304] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:26.961916 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:26.962685 14849 raft_consensus.cc:2804] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:26.963332 14849 raft_consensus.cc:493] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:26.963776 14849 raft_consensus.cc:3060] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:26.966418 14847 tablet_bootstrap.cc:654] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.961895 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
W20260709 13:23:26.969035 14769 leader_election.cc:343] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:26.977367 14769 leader_election.cc:304] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:26.979826 14844 tablet_bootstrap.cc:492] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:26.981041 14848 raft_consensus.cc:493] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:26.981940 14848 raft_consensus.cc:515] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:26.987051 14654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608206fd924d4a1388a4c651cd04e6fa" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:26.991463 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608206fd924d4a1388a4c651cd04e6fa" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
W20260709 13:23:26.991986 14695 leader_election.cc:343] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:26.993399 14848 leader_election.cc:290] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
W20260709 13:23:26.994716 14692 leader_election.cc:343] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9761becfc5946af903b06479e745741 (127.2.243.67:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:26.995625 14692 leader_election.cc:304] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05553f7076ed412989bffbd7a001751e; no voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741
I20260709 13:23:26.997982 14848 raft_consensus.cc:2749] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.000669 14864 raft_consensus.cc:2749] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.002095 14847 tablet_bootstrap.cc:492] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:27.002700 14847 ts_tablet_manager.cc:1403] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.044s	user 0.029s	sys 0.012s
W20260709 13:23:27.003140 14769 leader_election.cc:343] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.005764 14847 raft_consensus.cc:359] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:27.006589 14847 raft_consensus.cc:385] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.006942 14847 raft_consensus.cc:740] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.007607 14849 raft_consensus.cc:515] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.007895 14847 consensus_queue.cc:260] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:27.011000 14847 ts_tablet_manager.cc:1434] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:27.012377 14847 tablet_bootstrap.cc:492] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:27.013458 14654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:27.014315 14654 raft_consensus.cc:3060] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.015149 14849 leader_election.cc:290] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:27.017899 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.020109 14847 tablet_bootstrap.cc:654] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:27.021059 14769 leader_election.cc:343] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.028149 14844 tablet_bootstrap.cc:654] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.033264 14843 tablet_bootstrap.cc:492] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:27.034009 14843 ts_tablet_manager.cc:1403] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.093s	user 0.034s	sys 0.052s
I20260709 13:23:27.037503 14843 raft_consensus.cc:359] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.038462 14843 raft_consensus.cc:385] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.038792 14843 raft_consensus.cc:740] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.040107 14843 consensus_queue.cc:260] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.043879 14843 ts_tablet_manager.cc:1434] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:23:27.045250 14843 tablet_bootstrap.cc:492] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:27.045639 14844 tablet_bootstrap.cc:492] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:27.045920 14847 tablet_bootstrap.cc:492] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:27.046480 14844 ts_tablet_manager.cc:1403] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.004s
I20260709 13:23:27.046618 14847 ts_tablet_manager.cc:1403] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.011s
I20260709 13:23:27.051144 14844 raft_consensus.cc:359] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.052276 14844 raft_consensus.cc:385] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.051923 14847 raft_consensus.cc:359] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.052830 14844 raft_consensus.cc:740] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.052912 14847 raft_consensus.cc:385] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.053550 14847 raft_consensus.cc:740] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.053997 14843 tablet_bootstrap.cc:654] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.054394 14844 consensus_queue.cc:260] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.054589 14847 consensus_queue.cc:260] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.057099 14847 ts_tablet_manager.cc:1434] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:23:27.058418 14847 tablet_bootstrap.cc:492] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:27.064827 14844 ts_tablet_manager.cc:1434] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.008s
I20260709 13:23:27.066442 14847 tablet_bootstrap.cc:654] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.067076 14844 tablet_bootstrap.cc:492] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:27.079051 14844 tablet_bootstrap.cc:654] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.085318 14843 tablet_bootstrap.cc:492] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:27.086166 14843 ts_tablet_manager.cc:1403] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.012s
I20260709 13:23:27.090883 14843 raft_consensus.cc:359] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.091799 14843 raft_consensus.cc:385] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.092129 14843 raft_consensus.cc:740] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.093293 14844 tablet_bootstrap.cc:492] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:27.093231 14843 consensus_queue.cc:260] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.094138 14844 ts_tablet_manager.cc:1403] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.008s
I20260709 13:23:27.096396 14843 ts_tablet_manager.cc:1434] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:23:27.097832 14843 tablet_bootstrap.cc:492] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:27.098265 14844 raft_consensus.cc:359] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.099236 14844 raft_consensus.cc:385] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.099619 14844 raft_consensus.cc:740] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.100761 14844 consensus_queue.cc:260] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.103941 14844 ts_tablet_manager.cc:1434] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:23:27.105340 14844 tablet_bootstrap.cc:492] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:27.106374 14843 tablet_bootstrap.cc:654] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.106423 14853 raft_consensus.cc:493] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.107458 14853 raft_consensus.cc:515] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.115833 14844 tablet_bootstrap.cc:654] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.120595 14843 tablet_bootstrap.cc:492] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:27.121337 14843 ts_tablet_manager.cc:1403] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:23:27.123173 14853 leader_election.cc:290] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.126065 14843 raft_consensus.cc:359] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.127336 14843 raft_consensus.cc:385] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.127660 14843 raft_consensus.cc:740] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.129091 14843 consensus_queue.cc:260] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.131279 14844 tablet_bootstrap.cc:492] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:27.132122 14844 ts_tablet_manager.cc:1403] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.001s
I20260709 13:23:27.132220 14843 ts_tablet_manager.cc:1434] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:23:27.133637 14843 tablet_bootstrap.cc:492] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:27.136540 14844 raft_consensus.cc:359] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.137620 14844 raft_consensus.cc:385] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.138082 14844 raft_consensus.cc:740] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.139200 14844 consensus_queue.cc:260] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.141309 14843 tablet_bootstrap.cc:654] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.142743 14844 ts_tablet_manager.cc:1434] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:23:27.144179 14844 tablet_bootstrap.cc:492] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:27.154372 14844 tablet_bootstrap.cc:654] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.155447 14843 tablet_bootstrap.cc:492] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:27.156230 14843 ts_tablet_manager.cc:1403] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:23:27.159515 14849 raft_consensus.cc:493] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.159350 14654 raft_consensus.cc:2468] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 1.
I20260709 13:23:27.160106 14843 raft_consensus.cc:359] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.173792 14843 raft_consensus.cc:385] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.160472 14849 raft_consensus.cc:515] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.167560 14844 tablet_bootstrap.cc:492] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:27.179605 14844 ts_tablet_manager.cc:1403] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.004s
I20260709 13:23:27.181275 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f414b45b72b34f86a9538d95740342ee" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.178349 14849 leader_election.cc:290] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:27.174399 14843 raft_consensus.cc:740] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.182507 14729 raft_consensus.cc:2468] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 0.
I20260709 13:23:27.183584 14843 consensus_queue.cc:260] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.184825 14769 leader_election.cc:304] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:27.186336 14849 raft_consensus.cc:2804] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.186932 14849 raft_consensus.cc:493] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.187433 14849 raft_consensus.cc:3060] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.187711 14843 ts_tablet_manager.cc:1434] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:23:27.197368 14843 tablet_bootstrap.cc:492] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:27.194375 14844 raft_consensus.cc:359] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.199790 14844 raft_consensus.cc:385] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.200285 14844 raft_consensus.cc:740] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.201586 14844 consensus_queue.cc:260] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.204669 14844 ts_tablet_manager.cc:1434] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:23:27.205950 14844 tablet_bootstrap.cc:492] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:27.205816 14847 tablet_bootstrap.cc:492] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:27.207103 14847 ts_tablet_manager.cc:1403] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.149s	user 0.061s	sys 0.082s
I20260709 13:23:27.211131 14847 raft_consensus.cc:359] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.212487 14843 tablet_bootstrap.cc:654] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.212422 14853 raft_consensus.cc:493] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.214730 14769 leader_election.cc:304] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e
I20260709 13:23:27.215217 14864 raft_consensus.cc:493] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.212062 14847 raft_consensus.cc:385] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.215669 14654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f414b45b72b34f86a9538d95740342ee" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:27.218693 14654 raft_consensus.cc:2468] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 0.
I20260709 13:23:27.218847 14864 raft_consensus.cc:515] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.219759 14847 raft_consensus.cc:740] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.220605 14849 raft_consensus.cc:515] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.220921 14847 consensus_queue.cc:260] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.221560 14864 leader_election.cc:290] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:27.214318 14853 raft_consensus.cc:515] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.222429 14864 raft_consensus.cc:2804] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.223017 14864 raft_consensus.cc:697] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Leader. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:27.223104 14849 leader_election.cc:290] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:27.223917 14853 leader_election.cc:290] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.224614 14864 consensus_queue.cc:237] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.233052 14847 ts_tablet_manager.cc:1434] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.003s
I20260709 13:23:27.241341 14847 tablet_bootstrap.cc:492] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:27.242697 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f414b45b72b34f86a9538d95740342ee" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.243561 14729 raft_consensus.cc:2468] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:27.244827 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3371995d104e5989a49ef93aafb78e" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.247211 14620 leader_election.cc:304] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
W20260709 13:23:27.248374 14620 leader_election.cc:343] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.249243 14847 tablet_bootstrap.cc:654] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.253171 14853 raft_consensus.cc:2804] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.253862 14853 raft_consensus.cc:493] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.254364 14853 raft_consensus.cc:3060] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.265327 14848 raft_consensus.cc:493] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.266088 14848 raft_consensus.cc:515] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.266871 14847 tablet_bootstrap.cc:492] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:27.267578 14847 ts_tablet_manager.cc:1403] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:23:27.269776 14654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:27.270193 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.270812 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:27.271829 14848 leader_election.cc:290] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.271938 14653 raft_consensus.cc:2393] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05553f7076ed412989bffbd7a001751e in current term 1: Already voted for candidate e9761becfc5946af903b06479e745741 in this term.
I20260709 13:23:27.272120 14847 raft_consensus.cc:359] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.267232 14552 catalog_manager.cc:5697] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9761becfc5946af903b06479e745741 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "e9761becfc5946af903b06479e745741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:27.273043 14847 raft_consensus.cc:385] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.273468 14847 raft_consensus.cc:740] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.273757 14695 leader_election.cc:304] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05553f7076ed412989bffbd7a001751e; no voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741
I20260709 13:23:27.274166 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.274369 14847 consensus_queue.cc:260] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.274964 14728 raft_consensus.cc:2468] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 0.
I20260709 13:23:27.275243 14848 raft_consensus.cc:3060] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.279292 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f414b45b72b34f86a9538d95740342ee" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:27.279835 14844 tablet_bootstrap.cc:654] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.280247 14843 tablet_bootstrap.cc:492] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:27.280892 14843 ts_tablet_manager.cc:1403] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.007s
I20260709 13:23:27.288726 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f414b45b72b34f86a9538d95740342ee" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.290053 14728 raft_consensus.cc:3060] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.290448 14847 ts_tablet_manager.cc:1434] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.010s
I20260709 13:23:27.292101 14843 raft_consensus.cc:359] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.292961 14843 raft_consensus.cc:385] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.293141 14847 tablet_bootstrap.cc:492] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:27.293289 14843 raft_consensus.cc:740] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.295454 14843 consensus_queue.cc:260] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.312036 14880 raft_consensus.cc:493] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.312808 14880 raft_consensus.cc:515] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:27.315502 14847 tablet_bootstrap.cc:654] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.316076 14728 raft_consensus.cc:2468] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 1.
I20260709 13:23:27.316542 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af47e2740f25491dae550fe984a63891" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.317567 14729 raft_consensus.cc:2468] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:27.319728 14620 leader_election.cc:304] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
W20260709 13:23:27.321310 14769 leader_election.cc:343] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.328652 14864 raft_consensus.cc:493] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.329186 14843 ts_tablet_manager.cc:1434] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.048s	user 0.020s	sys 0.011s
I20260709 13:23:27.329398 14864 raft_consensus.cc:515] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.331882 14864 leader_election.cc:290] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:27.332787 14880 leader_election.cc:290] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.333585 14880 raft_consensus.cc:2804] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.334004 14880 raft_consensus.cc:493] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.334514 14880 raft_consensus.cc:3060] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.334141 14843 tablet_bootstrap.cc:492] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
W20260709 13:23:27.337929 14877 log.cc:927] Time spent T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:23:27.342317 14769 leader_election.cc:304] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:27.342694 14654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:27.347184 14864 raft_consensus.cc:2804] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.347823 14864 raft_consensus.cc:493] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.348209 14864 raft_consensus.cc:3060] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.351787 14883 raft_consensus.cc:493] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.352747 14883 raft_consensus.cc:515] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.354358 14853 raft_consensus.cc:515] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.355901 14653 raft_consensus.cc:2393] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e9761becfc5946af903b06479e745741 in current term 1: Already voted for candidate c3f2cb06911b4753b819d30987a8073e in this term.
I20260709 13:23:27.359465 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22eed3e0be240859f8b98b4d3f2f7c1" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
W20260709 13:23:27.361397 14695 leader_election.cc:343] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.362764 14843 tablet_bootstrap.cc:654] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.368530 14883 leader_election.cc:290] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.369994 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22eed3e0be240859f8b98b4d3f2f7c1" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.348457 14769 leader_election.cc:304] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:27.374166 14876 raft_consensus.cc:2804] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.374348 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.375204 14876 raft_consensus.cc:697] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Leader. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:27.375254 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f414b45b72b34f86a9538d95740342ee" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.375463 14728 raft_consensus.cc:2468] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 0.
I20260709 13:23:27.372125 14803 raft_consensus.cc:2468] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 0.
I20260709 13:23:27.376318 14876 consensus_queue.cc:237] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.377553 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3371995d104e5989a49ef93aafb78e" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.377844 14692 leader_election.cc:304] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:27.377991 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af47e2740f25491dae550fe984a63891" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.378443 14802 raft_consensus.cc:2468] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:27.379359 14883 raft_consensus.cc:2804] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:23:27.379514 14769 leader_election.cc:343] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.379812 14883 raft_consensus.cc:493] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.380324 14883 raft_consensus.cc:3060] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.385598 14847 tablet_bootstrap.cc:492] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:27.386387 14847 ts_tablet_manager.cc:1403] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.008s
I20260709 13:23:27.386264 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f414b45b72b34f86a9538d95740342ee" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.387301 14728 raft_consensus.cc:2393] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c3f2cb06911b4753b819d30987a8073e in current term 1: Already voted for candidate e9761becfc5946af903b06479e745741 in this term.
I20260709 13:23:27.394500 14884 raft_consensus.cc:493] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.394363 14883 raft_consensus.cc:515] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.395413 14884 raft_consensus.cc:515] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.397274 14847 raft_consensus.cc:359] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.398178 14847 raft_consensus.cc:385] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.398505 14847 raft_consensus.cc:740] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.399982 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22eed3e0be240859f8b98b4d3f2f7c1" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:27.401044 14853 leader_election.cc:290] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.401199 14847 consensus_queue.cc:260] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
W20260709 13:23:27.402426 14617 leader_election.cc:343] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9761becfc5946af903b06479e745741 (127.2.243.67:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.404122 14847 ts_tablet_manager.cc:1434] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:23:27.404083 14617 leader_election.cc:304] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e
I20260709 13:23:27.404814 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.400169 14769 leader_election.cc:304] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:27.409140 14653 raft_consensus.cc:3060] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.405901 14728 raft_consensus.cc:2468] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:27.411614 14849 raft_consensus.cc:2804] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.413655 14853 raft_consensus.cc:2804] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.394322 14864 raft_consensus.cc:515] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.421087 14843 tablet_bootstrap.cc:492] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:27.417425 14853 raft_consensus.cc:493] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.423952 14843 ts_tablet_manager.cc:1403] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.008s
I20260709 13:23:27.424026 14853 raft_consensus.cc:3060] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.419807 14884 leader_election.cc:290] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.421872 14620 leader_election.cc:304] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:27.430513 14844 tablet_bootstrap.cc:492] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:27.431113 14844 ts_tablet_manager.cc:1403] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.225s	user 0.033s	sys 0.027s
I20260709 13:23:27.430930 14883 leader_election.cc:290] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.418592 14849 raft_consensus.cc:493] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.429594 14847 tablet_bootstrap.cc:492] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:27.434289 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f414b45b72b34f86a9538d95740342ee" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:27.429175 14848 raft_consensus.cc:2749] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.434760 14884 raft_consensus.cc:2804] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.436592 14849 raft_consensus.cc:3060] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.442366 14884 raft_consensus.cc:493] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.443230 14880 raft_consensus.cc:515] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:27.443867 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22eed3e0be240859f8b98b4d3f2f7c1" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:27.444598 14803 raft_consensus.cc:3060] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.446494 14880 leader_election.cc:290] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.443928 14844 raft_consensus.cc:359] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:27.447500 14844 raft_consensus.cc:385] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.447795 14844 raft_consensus.cc:740] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.448665 14884 raft_consensus.cc:3060] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.448930 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af47e2740f25491dae550fe984a63891" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.449689 14728 raft_consensus.cc:3060] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.449224 14551 catalog_manager.cc:5697] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9761becfc5946af903b06479e745741 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "e9761becfc5946af903b06479e745741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:27.458948 14728 raft_consensus.cc:2468] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:27.459709 14884 raft_consensus.cc:515] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.460292 14844 consensus_queue.cc:260] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:27.460759 14620 leader_election.cc:304] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:27.461869 14880 raft_consensus.cc:2804] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.463141 14884 leader_election.cc:290] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.463625 14880 raft_consensus.cc:697] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:27.465334 14880 consensus_queue.cc:237] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:27.465551 14843 raft_consensus.cc:359] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.466298 14844 ts_tablet_manager.cc:1434] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:23:27.466388 14843 raft_consensus.cc:385] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.466859 14843 raft_consensus.cc:740] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.468277 14847 tablet_bootstrap.cc:654] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.467630 14843 consensus_queue.cc:260] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.468778 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.467865 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.469702 14802 raft_consensus.cc:2393] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3f2cb06911b4753b819d30987a8073e in current term 1: Already voted for candidate e9761becfc5946af903b06479e745741 in this term.
I20260709 13:23:27.470652 14728 raft_consensus.cc:3060] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.470793 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af47e2740f25491dae550fe984a63891" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:27.472306 14843 ts_tablet_manager.cc:1434] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:23:27.472904 14801 raft_consensus.cc:3060] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.467628 14844 tablet_bootstrap.cc:492] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:27.496935 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:27.498138 14802 raft_consensus.cc:2393] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c3f2cb06911b4753b819d30987a8073e in current term 1: Already voted for candidate e9761becfc5946af903b06479e745741 in this term.
I20260709 13:23:27.498925 14848 raft_consensus.cc:493] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.499897 14848 raft_consensus.cc:515] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.483031 14617 leader_election.cc:304] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e; no voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741
I20260709 13:23:27.510944 14849 raft_consensus.cc:515] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.514817 14848 leader_election.cc:290] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.503844 14728 raft_consensus.cc:2468] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:27.517230 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.518515 14802 raft_consensus.cc:2468] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 0.
I20260709 13:23:27.521498 14692 leader_election.cc:304] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:27.522101 14801 raft_consensus.cc:2468] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:27.523736 14620 leader_election.cc:304] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:27.525424 14891 raft_consensus.cc:2804] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.526060 14891 raft_consensus.cc:697] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:27.527065 14891 consensus_queue.cc:237] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.528648 14884 raft_consensus.cc:2749] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:23:27.528921 14617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.243.67:44429, user_credentials={real_user=slave}} blocked reactor thread for 49652.3us
I20260709 13:23:27.530706 14654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:27.531136 14848 raft_consensus.cc:2804] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.531800 14848 raft_consensus.cc:493] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.532279 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:27.532318 14848 raft_consensus.cc:3060] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.535949 14853 raft_consensus.cc:515] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.539677 14864 leader_election.cc:290] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:27.539609 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3371995d104e5989a49ef93aafb78e" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.540555 14728 raft_consensus.cc:3060] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.541035 14853 leader_election.cc:290] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.546828 14653 raft_consensus.cc:2468] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 1.
I20260709 13:23:27.559791 14847 tablet_bootstrap.cc:492] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:27.560547 14847 ts_tablet_manager.cc:1403] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.143s	user 0.035s	sys 0.045s
W20260709 13:23:27.561721 14695 leader_election.cc:343] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.563851 14695 leader_election.cc:304] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:27.564888 14883 raft_consensus.cc:2804] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.563797 14847 raft_consensus.cc:359] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.565474 14883 raft_consensus.cc:697] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Becoming Leader. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:27.565554 14803 raft_consensus.cc:2468] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 1.
I20260709 13:23:27.566478 14883 consensus_queue.cc:237] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.567395 14848 raft_consensus.cc:515] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.565595 14847 raft_consensus.cc:385] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.568686 14847 raft_consensus.cc:740] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.569516 14847 consensus_queue.cc:260] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.571965 14847 ts_tablet_manager.cc:1434] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:23:27.572230 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:27.572391 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:27.573032 14653 raft_consensus.cc:3060] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.573362 14802 raft_consensus.cc:3060] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.575047 14844 tablet_bootstrap.cc:654] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.579439 14847 tablet_bootstrap.cc:492] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:27.581286 14728 raft_consensus.cc:2468] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:27.582942 14620 leader_election.cc:304] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:27.583781 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.584167 14891 raft_consensus.cc:2804] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.584481 14848 leader_election.cc:290] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.584954 14729 raft_consensus.cc:2393] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e9761becfc5946af903b06479e745741 in current term 1: Already voted for candidate c3f2cb06911b4753b819d30987a8073e in this term.
I20260709 13:23:27.585111 14891 raft_consensus.cc:697] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:27.585691 14802 raft_consensus.cc:2468] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 1.
I20260709 13:23:27.586170 14891 consensus_queue.cc:237] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.587212 14692 leader_election.cc:304] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:27.588322 14848 raft_consensus.cc:2804] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.588416 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3371995d104e5989a49ef93aafb78e" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:27.589139 14848 raft_consensus.cc:697] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Becoming Leader. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:27.587301 14847 tablet_bootstrap.cc:654] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.589927 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:27.590330 14848 consensus_queue.cc:237] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.593497 14803 raft_consensus.cc:3060] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.607899 14849 leader_election.cc:290] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:27.598510 14769 leader_election.cc:304] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e
W20260709 13:23:27.610950 14769 leader_election.cc:343] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.613526 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.614283 14728 raft_consensus.cc:3060] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.615119 14803 raft_consensus.cc:2468] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:27.615679 14653 raft_consensus.cc:2468] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 1.
I20260709 13:23:27.616717 14849 raft_consensus.cc:2749] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.620208 14847 tablet_bootstrap.cc:492] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:27.621034 14847 ts_tablet_manager.cc:1403] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.017s
I20260709 13:23:27.623090 14728 raft_consensus.cc:2468] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 1.
I20260709 13:23:27.626627 14844 tablet_bootstrap.cc:492] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:27.627354 14844 ts_tablet_manager.cc:1403] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.008s
I20260709 13:23:27.627112 14847 raft_consensus.cc:359] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.628036 14847 raft_consensus.cc:385] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.628372 14847 raft_consensus.cc:740] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.629321 14847 consensus_queue.cc:260] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.630563 14769 leader_election.cc:304] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:27.631170 14844 raft_consensus.cc:359] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.631050 14552 catalog_manager.cc:5697] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e reported cstate change: term changed from 0 to 1, leader changed from <none> to 05553f7076ed412989bffbd7a001751e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "05553f7076ed412989bffbd7a001751e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.632015 14847 ts_tablet_manager.cc:1434] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:23:27.632076 14844 raft_consensus.cc:385] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.632725 14844 raft_consensus.cc:740] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.633654 14844 consensus_queue.cc:260] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.632802 14849 raft_consensus.cc:2804] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.634979 14849 raft_consensus.cc:697] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Leader. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:27.636113 14849 consensus_queue.cc:237] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.637070 14844 ts_tablet_manager.cc:1434] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:23:27.637120 14551 catalog_manager.cc:5697] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.641089 14876 consensus_queue.cc:1048] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:27.641525 14551 catalog_manager.cc:5697] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:27.644742 14551 catalog_manager.cc:5697] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.657791 14552 catalog_manager.cc:5697] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9761becfc5946af903b06479e745741 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "e9761becfc5946af903b06479e745741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:27.668089 14849 consensus_queue.cc:1048] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:27.671545 14549 catalog_manager.cc:5697] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e reported cstate change: term changed from 0 to 1, leader changed from <none> to 05553f7076ed412989bffbd7a001751e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "05553f7076ed412989bffbd7a001751e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.687366 14891 raft_consensus.cc:493] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.688077 14891 raft_consensus.cc:515] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.690546 14891 leader_election.cc:290] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.691792 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.692866 14729 raft_consensus.cc:2393] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3f2cb06911b4753b819d30987a8073e in current term 1: Already voted for candidate e9761becfc5946af903b06479e745741 in this term.
I20260709 13:23:27.693089 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.695233 14617 leader_election.cc:304] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e; no voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741
I20260709 13:23:27.696744 14891 raft_consensus.cc:3060] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.696761 14880 raft_consensus.cc:493] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.697531 14880 raft_consensus.cc:515] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.701233 14880 leader_election.cc:290] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.701457 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608206fd924d4a1388a4c651cd04e6fa" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:27.702342 14729 raft_consensus.cc:2468] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:27.703362 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608206fd924d4a1388a4c651cd04e6fa" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:27.704455 14803 raft_consensus.cc:2468] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:27.704239 14620 leader_election.cc:304] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:27.706478 14880 raft_consensus.cc:2804] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.706893 14880 raft_consensus.cc:493] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.707242 14880 raft_consensus.cc:3060] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.709123 14891 raft_consensus.cc:2749] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.716426 14880 raft_consensus.cc:515] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.718637 14880 leader_election.cc:290] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:27.719863 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608206fd924d4a1388a4c651cd04e6fa" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:27.719863 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608206fd924d4a1388a4c651cd04e6fa" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:27.720948 14803 raft_consensus.cc:3060] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.720948 14729 raft_consensus.cc:3060] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.730499 14729 raft_consensus.cc:2468] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:27.730499 14803 raft_consensus.cc:2468] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:27.732416 14620 leader_election.cc:304] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:27.733301 14880 raft_consensus.cc:2804] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.733793 14880 raft_consensus.cc:697] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:27.734730 14880 consensus_queue.cc:237] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:27.743566 14549 catalog_manager.cc:5697] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.891359 14880 consensus_queue.cc:1048] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.904765 14891 consensus_queue.cc:1048] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.949882 14803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60"
dest_uuid: "e9761becfc5946af903b06479e745741"
mode: GRACEFUL
new_leader_uuid: "c3f2cb06911b4753b819d30987a8073e"
 from {username='slave'} at 127.0.0.1:41756
I20260709 13:23:27.950560 14803 raft_consensus.cc:606] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Received request to transfer leadership to TS c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:27.960441 14803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db"
dest_uuid: "e9761becfc5946af903b06479e745741"
mode: GRACEFUL
new_leader_uuid: "c3f2cb06911b4753b819d30987a8073e"
 from {username='slave'} at 127.0.0.1:41756
I20260709 13:23:27.961361 14803 raft_consensus.cc:606] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Received request to transfer leadership to TS c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:27.965150 14849 consensus_queue.cc:1048] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.966126 14876 consensus_queue.cc:1048] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.983119 14883 consensus_queue.cc:1048] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:23:27.996856 14891 consensus_queue.cc:1048] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.005263 14891 consensus_queue.cc:1048] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:28.020931 14652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3371995d104e5989a49ef93aafb78e"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
mode: GRACEFUL
new_leader_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:42880
I20260709 13:23:28.021960 14652 raft_consensus.cc:606] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Received request to transfer leadership to TS 05553f7076ed412989bffbd7a001751e
I20260709 13:23:28.040161 14848 consensus_queue.cc:1048] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:28.047049 14652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
mode: GRACEFUL
new_leader_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:42880
I20260709 13:23:28.047722 14652 raft_consensus.cc:606] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Received request to transfer leadership to TS 05553f7076ed412989bffbd7a001751e
I20260709 13:23:28.064783 14876 consensus_queue.cc:1048] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.083395 14864 consensus_queue.cc:1048] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.094893 14864 raft_consensus.cc:993] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741: : Instructing follower c3f2cb06911b4753b819d30987a8073e to start an election
I20260709 13:23:28.095503 14849 raft_consensus.cc:1081] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Signalling peer c3f2cb06911b4753b819d30987a8073e to start an election
I20260709 13:23:28.097463 14653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
 from {username='slave'} at 127.0.0.1:42864
I20260709 13:23:28.098155 14653 raft_consensus.cc:493] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:28.098562 14653 raft_consensus.cc:3060] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.106828 14653 raft_consensus.cc:515] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.109753 14653 leader_election.cc:290] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 2 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:28.110276 14884 consensus_queue.cc:1048] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.111377 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:28.112149 14803 raft_consensus.cc:3055] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:28.113010 14803 raft_consensus.cc:740] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:28.112121 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8fb3c4ec84237b08fbe99ebc60f60" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:28.113763 14729 raft_consensus.cc:3060] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.114027 14803 consensus_queue.cc:260] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.115743 14803 raft_consensus.cc:3060] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.123751 14880 raft_consensus.cc:993] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e: : Instructing follower 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:28.124858 14880 raft_consensus.cc:1081] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Signalling peer 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:28.127033 14803 raft_consensus.cc:2468] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 2.
I20260709 13:23:28.127645 14727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3371995d104e5989a49ef93aafb78e"
dest_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:36044
I20260709 13:23:28.128310 14727 raft_consensus.cc:493] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:28.128711 14727 raft_consensus.cc:3060] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.130359 14729 raft_consensus.cc:2468] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 2.
I20260709 13:23:28.132910 14617 leader_election.cc:304] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:28.135464 14891 raft_consensus.cc:2804] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:28.136101 14891 raft_consensus.cc:697] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 2 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:28.136255 14880 consensus_queue.cc:1048] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.137228 14891 consensus_queue.cc:237] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.139700 14727 raft_consensus.cc:515] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.141542 14728 raft_consensus.cc:1240] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Rejecting Update request from peer c3f2cb06911b4753b819d30987a8073e for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:28.143989 14727 leader_election.cc:290] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:28.144734 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3371995d104e5989a49ef93aafb78e" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:28.145466 14803 raft_consensus.cc:3060] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.145803 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3371995d104e5989a49ef93aafb78e" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:28.147091 14653 raft_consensus.cc:3055] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:28.147650 14653 raft_consensus.cc:740] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:28.148854 14653 consensus_queue.cc:260] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.150138 14653 raft_consensus.cc:3060] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.150092 14891 consensus_queue.cc:1048] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:23:28.153522 14551 catalog_manager.cc:5697] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 1 to 2, leader changed from e9761becfc5946af903b06479e745741 (127.2.243.67) to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 2 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:28.161780 14891 consensus_queue.cc:1048] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.162063 14653 raft_consensus.cc:2468] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:28.164719 14848 consensus_queue.cc:1048] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.156845 14803 raft_consensus.cc:2468] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:28.167567 14802 raft_consensus.cc:1240] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Rejecting Update request from peer c3f2cb06911b4753b819d30987a8073e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:23:28.168141 14692 leader_election.cc:304] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:28.170113 14848 raft_consensus.cc:2804] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:28.170701 14848 raft_consensus.cc:697] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Becoming Leader. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:28.171734 14848 consensus_queue.cc:237] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.187809 14848 consensus_queue.cc:1048] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.205104 14552 catalog_manager.cc:5697] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e reported cstate change: term changed from 1 to 2, leader changed from c3f2cb06911b4753b819d30987a8073e (127.2.243.65) to 05553f7076ed412989bffbd7a001751e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "05553f7076ed412989bffbd7a001751e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:28.253672 14849 raft_consensus.cc:993] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741: : Instructing follower c3f2cb06911b4753b819d30987a8073e to start an election
I20260709 13:23:28.254264 14876 raft_consensus.cc:1081] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Signalling peer c3f2cb06911b4753b819d30987a8073e to start an election
I20260709 13:23:28.256307 14653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
 from {username='slave'} at 127.0.0.1:42864
I20260709 13:23:28.257023 14653 raft_consensus.cc:493] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:28.257452 14653 raft_consensus.cc:3060] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.263790 14653 raft_consensus.cc:515] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.266201 14653 leader_election.cc:290] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 2 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:28.266870 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:28.266847 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edaca98e9dd47f3bd0a4d49716193db" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:28.267624 14802 raft_consensus.cc:3055] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:28.268029 14728 raft_consensus.cc:3060] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.268035 14802 raft_consensus.cc:740] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:28.269343 14802 consensus_queue.cc:260] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.270843 14802 raft_consensus.cc:3060] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.275332 14728 raft_consensus.cc:2468] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 2.
I20260709 13:23:28.277024 14620 leader_election.cc:304] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:28.277547 14802 raft_consensus.cc:2468] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 2.
I20260709 13:23:28.278196 14884 raft_consensus.cc:2804] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:28.278781 14884 raft_consensus.cc:697] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 2 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:28.279901 14884 consensus_queue.cc:237] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.289609 14551 catalog_manager.cc:5697] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 1 to 2, leader changed from e9761becfc5946af903b06479e745741 (127.2.243.67) to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 2 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:28.497080 14880 raft_consensus.cc:993] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e: : Instructing follower 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:28.497637 14884 raft_consensus.cc:1081] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Signalling peer 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:28.499624 14728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a"
dest_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:36044
I20260709 13:23:28.500295 14728 raft_consensus.cc:493] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:28.500924 14728 raft_consensus.cc:3060] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.510434 14728 raft_consensus.cc:515] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.513548 14728 leader_election.cc:290] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:28.514344 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:28.514948 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bc727a8c5e4cf4bad18fc1dc5a9f5a" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:28.515127 14653 raft_consensus.cc:3055] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:28.515553 14802 raft_consensus.cc:3060] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.515561 14653 raft_consensus.cc:740] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:28.516630 14653 consensus_queue.cc:260] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.517860 14653 raft_consensus.cc:3060] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:28.523368 14802 raft_consensus.cc:2468] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:28.524973 14653 raft_consensus.cc:2468] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:28.525056 14692 leader_election.cc:304] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:28.526104 14848 raft_consensus.cc:2804] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:28.526587 14848 raft_consensus.cc:697] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Becoming Leader. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:28.527499 14848 consensus_queue.cc:237] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:28.536880 14551 catalog_manager.cc:5697] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e reported cstate change: term changed from 1 to 2, leader changed from c3f2cb06911b4753b819d30987a8073e (127.2.243.65) to 05553f7076ed412989bffbd7a001751e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "05553f7076ed412989bffbd7a001751e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:28.612856 14728 raft_consensus.cc:1275] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Refusing update from remote peer c3f2cb06911b4753b819d30987a8073e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:28.613876 14802 raft_consensus.cc:1275] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:28.614504 14884 consensus_queue.cc:1048] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:28.615455 14848 consensus_queue.cc:1048] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:28.629978 14653 raft_consensus.cc:1275] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:28.632582 14886 consensus_queue.cc:1048] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:28.633064 14802 raft_consensus.cc:1275] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Refusing update from remote peer c3f2cb06911b4753b819d30987a8073e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:28.635474 14884 consensus_queue.cc:1048] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:28.758634 14802 raft_consensus.cc:1275] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Refusing update from remote peer c3f2cb06911b4753b819d30987a8073e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:28.760545 14884 consensus_queue.cc:1048] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:28.772596 14728 raft_consensus.cc:1275] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Refusing update from remote peer c3f2cb06911b4753b819d30987a8073e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:28.774591 14891 consensus_queue.cc:1048] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:29.011299 14653 raft_consensus.cc:1275] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:29.012778 14927 consensus_queue.cc:1048] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:29.022209 14802 raft_consensus.cc:1275] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:29.024029 14848 consensus_queue.cc:1048] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:31.103883 14548 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60126:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:31.109678 14548 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:31.180089 14642 tablet_service.cc:1511] Processing CreateTablet for tablet 1bfbec5442a641cfba5740e9b47dc106 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:31.181030 14715 tablet_service.cc:1511] Processing CreateTablet for tablet 1bfbec5442a641cfba5740e9b47dc106 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:31.183182 14715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bfbec5442a641cfba5740e9b47dc106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.183228 14792 tablet_service.cc:1511] Processing CreateTablet for tablet 1bfbec5442a641cfba5740e9b47dc106 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:31.185304 14792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bfbec5442a641cfba5740e9b47dc106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.184954 14638 tablet_service.cc:1511] Processing CreateTablet for tablet e6e005e2ee764603a277d2fe533fa460 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:31.187171 14638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e005e2ee764603a277d2fe533fa460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.189074 14642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bfbec5442a641cfba5740e9b47dc106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.189986 14793 tablet_service.cc:1511] Processing CreateTablet for tablet e6e005e2ee764603a277d2fe533fa460 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:31.192140 14793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e005e2ee764603a277d2fe533fa460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.192655 14717 tablet_service.cc:1511] Processing CreateTablet for tablet e6e005e2ee764603a277d2fe533fa460 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:31.193151 14639 tablet_service.cc:1511] Processing CreateTablet for tablet 93d5960025d34dbba47e46ceb0360cf0 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:31.194700 14717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e005e2ee764603a277d2fe533fa460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.194923 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d5960025d34dbba47e46ceb0360cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.198721 14716 tablet_service.cc:1511] Processing CreateTablet for tablet 93d5960025d34dbba47e46ceb0360cf0 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:31.200680 14716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d5960025d34dbba47e46ceb0360cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.204069 14791 tablet_service.cc:1511] Processing CreateTablet for tablet 93d5960025d34dbba47e46ceb0360cf0 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:31.206360 14791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d5960025d34dbba47e46ceb0360cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.216704 14637 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed74048d6da401a87dc20f014fc52c3 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:31.218663 14637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed74048d6da401a87dc20f014fc52c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.220003 14714 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed74048d6da401a87dc20f014fc52c3 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:31.222818 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed74048d6da401a87dc20f014fc52c3 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:31.224238 14643 tablet_service.cc:1511] Processing CreateTablet for tablet 6eaa8b7c48a443db964c38face13de75 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:31.224923 14714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed74048d6da401a87dc20f014fc52c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.226094 14643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eaa8b7c48a443db964c38face13de75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.227391 14713 tablet_service.cc:1511] Processing CreateTablet for tablet 6eaa8b7c48a443db964c38face13de75 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:31.229066 14713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eaa8b7c48a443db964c38face13de75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.229341 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed74048d6da401a87dc20f014fc52c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.245162 14787 tablet_service.cc:1511] Processing CreateTablet for tablet 6eaa8b7c48a443db964c38face13de75 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:31.247072 14787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eaa8b7c48a443db964c38face13de75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.246788 14641 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe6996f7f2c410bba7ab0ff4e601fbf (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:31.248571 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe6996f7f2c410bba7ab0ff4e601fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.266888 14712 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe6996f7f2c410bba7ab0ff4e601fbf (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:31.269109 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe6996f7f2c410bba7ab0ff4e601fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.295575 14786 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe6996f7f2c410bba7ab0ff4e601fbf (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:31.298863 14786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe6996f7f2c410bba7ab0ff4e601fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.299683 14711 tablet_service.cc:1511] Processing CreateTablet for tablet 87544905f0e549cdacc51ce75d172cf0 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:31.301517 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87544905f0e549cdacc51ce75d172cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.302034 14640 tablet_service.cc:1511] Processing CreateTablet for tablet 87544905f0e549cdacc51ce75d172cf0 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:31.303797 14640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87544905f0e549cdacc51ce75d172cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.322917 14788 tablet_service.cc:1511] Processing CreateTablet for tablet 87544905f0e549cdacc51ce75d172cf0 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:31.325953 14636 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3339a35c754193a2ed0526c250631c (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:31.331805 14717 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3339a35c754193a2ed0526c250631c (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:31.326648 14788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87544905f0e549cdacc51ce75d172cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.328281 14636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3339a35c754193a2ed0526c250631c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.334275 14717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3339a35c754193a2ed0526c250631c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.345662 14785 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3339a35c754193a2ed0526c250631c (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:31.348423 14945 tablet_bootstrap.cc:492] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:31.349925 14785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3339a35c754193a2ed0526c250631c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.395045 14637 tablet_service.cc:1511] Processing CreateTablet for tablet fa8d984604d146388e3a8f31a966ce05 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:31.396907 14637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8d984604d146388e3a8f31a966ce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.406821 14946 tablet_bootstrap.cc:492] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:31.432547 14712 tablet_service.cc:1511] Processing CreateTablet for tablet fa8d984604d146388e3a8f31a966ce05 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:31.434201 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8d984604d146388e3a8f31a966ce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.440877 14947 tablet_bootstrap.cc:492] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:31.447203 14792 tablet_service.cc:1511] Processing CreateTablet for tablet fa8d984604d146388e3a8f31a966ce05 (DEFAULT_TABLE table=soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:31.457458 14792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8d984604d146388e3a8f31a966ce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:31.383378 14945 tablet_bootstrap.cc:654] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.473155 14946 tablet_bootstrap.cc:654] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.478646 14947 tablet_bootstrap.cc:654] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.516000 14947 tablet_bootstrap.cc:492] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:31.516000 14945 tablet_bootstrap.cc:492] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:31.516798 14947 ts_tablet_manager.cc:1403] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.014s
I20260709 13:23:31.516896 14945 ts_tablet_manager.cc:1403] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.169s	user 0.025s	sys 0.010s
I20260709 13:23:31.521123 14945 raft_consensus.cc:359] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.522053 14946 tablet_bootstrap.cc:492] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:31.522233 14945 raft_consensus.cc:385] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.522112 14947 raft_consensus.cc:359] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.522986 14946 ts_tablet_manager.cc:1403] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.019s
I20260709 13:23:31.523065 14945 raft_consensus.cc:740] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.523334 14947 raft_consensus.cc:385] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.523720 14947 raft_consensus.cc:740] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.524210 14945 consensus_queue.cc:260] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.524565 14947 consensus_queue.cc:260] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.527583 14946 raft_consensus.cc:359] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.527719 14947 ts_tablet_manager.cc:1434] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:23:31.527776 14945 ts_tablet_manager.cc:1434] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:23:31.528735 14946 raft_consensus.cc:385] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.529277 14946 raft_consensus.cc:740] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.529904 14945 tablet_bootstrap.cc:492] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:31.530599 14947 tablet_bootstrap.cc:492] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:31.530424 14946 consensus_queue.cc:260] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.533460 14946 ts_tablet_manager.cc:1434] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:23:31.534812 14946 tablet_bootstrap.cc:492] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:31.539904 14947 tablet_bootstrap.cc:654] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.543509 14945 tablet_bootstrap.cc:654] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.546598 14946 tablet_bootstrap.cc:654] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.555979 14947 tablet_bootstrap.cc:492] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:31.556808 14947 ts_tablet_manager.cc:1403] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.010s
I20260709 13:23:31.557116 14945 tablet_bootstrap.cc:492] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:31.557868 14945 ts_tablet_manager.cc:1403] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 13:23:31.558820 14849 raft_consensus.cc:493] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.559494 14849 raft_consensus.cc:515] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.564463 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eaa8b7c48a443db964c38face13de75" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
W20260709 13:23:31.568923 14769 leader_election.cc:343] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.563633 14947 raft_consensus.cc:359] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.569749 14947 raft_consensus.cc:385] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.570163 14947 raft_consensus.cc:740] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.571102 14947 consensus_queue.cc:260] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.572461 14849 leader_election.cc:290] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:31.568941 14946 tablet_bootstrap.cc:492] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:31.575125 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eaa8b7c48a443db964c38face13de75" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:31.575562 14946 ts_tablet_manager.cc:1403] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.003s
I20260709 13:23:31.581610 14945 raft_consensus.cc:359] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
W20260709 13:23:31.582369 14769 leader_election.cc:343] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.592144 14945 raft_consensus.cc:385] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.592954 14945 raft_consensus.cc:740] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.592978 14769 leader_election.cc:304] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:31.594301 14945 consensus_queue.cc:260] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.595161 14849 raft_consensus.cc:2749] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:31.598222 14945 ts_tablet_manager.cc:1434] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:23:31.599854 14945 tablet_bootstrap.cc:492] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:31.585038 14946 raft_consensus.cc:359] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.600548 14946 raft_consensus.cc:385] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.600988 14946 raft_consensus.cc:740] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.602020 14946 consensus_queue.cc:260] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.605882 14946 ts_tablet_manager.cc:1434] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 13:23:31.609340 14947 ts_tablet_manager.cc:1434] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.052s	user 0.022s	sys 0.021s
I20260709 13:23:31.610939 14947 tablet_bootstrap.cc:492] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:31.612558 14946 tablet_bootstrap.cc:492] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:31.615275 14945 tablet_bootstrap.cc:654] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.619726 14947 tablet_bootstrap.cc:654] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.623000 14946 tablet_bootstrap.cc:654] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.629283 14945 tablet_bootstrap.cc:492] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:31.630031 14945 ts_tablet_manager.cc:1403] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.007s
I20260709 13:23:31.633915 14945 raft_consensus.cc:359] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.635252 14945 raft_consensus.cc:385] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.635757 14945 raft_consensus.cc:740] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.637023 14945 consensus_queue.cc:260] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.640410 14945 ts_tablet_manager.cc:1434] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:23:31.641474 14947 tablet_bootstrap.cc:492] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:31.642292 14945 tablet_bootstrap.cc:492] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:31.645360 14891 raft_consensus.cc:493] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.646065 14946 tablet_bootstrap.cc:492] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:31.642459 14947 ts_tablet_manager.cc:1403] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.012s
I20260709 13:23:31.645987 14891 raft_consensus.cc:515] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.646875 14946 ts_tablet_manager.cc:1403] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.006s
I20260709 13:23:31.650566 14947 raft_consensus.cc:359] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.650831 14946 raft_consensus.cc:359] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.652544 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e005e2ee764603a277d2fe533fa460" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:31.652910 14946 raft_consensus.cc:385] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.651633 14947 raft_consensus.cc:385] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.653335 14728 raft_consensus.cc:2468] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:31.653337 14946 raft_consensus.cc:740] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.652228 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e005e2ee764603a277d2fe533fa460" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:31.653484 14947 raft_consensus.cc:740] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.655350 14947 consensus_queue.cc:260] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
W20260709 13:23:31.656117 14617 leader_election.cc:343] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9761becfc5946af903b06479e745741 (127.2.243.67:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.657183 14945 tablet_bootstrap.cc:654] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.657909 14620 leader_election.cc:304] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: e9761becfc5946af903b06479e745741
I20260709 13:23:31.658641 14947 ts_tablet_manager.cc:1434] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:23:31.659997 14947 tablet_bootstrap.cc:492] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:31.651739 14891 leader_election.cc:290] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:31.661127 14891 raft_consensus.cc:493] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.661280 14946 consensus_queue.cc:260] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.662876 14958 raft_consensus.cc:2804] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:31.663357 14958 raft_consensus.cc:493] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:31.663695 14958 raft_consensus.cc:3060] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:31.662892 14891 raft_consensus.cc:515] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.683121 14891 leader_election.cc:290] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:31.684885 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:31.687698 14947 tablet_bootstrap.cc:654] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:31.688262 14617 leader_election.cc:343] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9761becfc5946af903b06479e745741 (127.2.243.67:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.693547 14946 ts_tablet_manager.cc:1434] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.046s	user 0.002s	sys 0.007s
I20260709 13:23:31.693912 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:31.694954 14946 tablet_bootstrap.cc:492] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
W20260709 13:23:31.695849 14620 leader_election.cc:343] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.696472 14620 leader_election.cc:304] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e; no voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741
I20260709 13:23:31.697510 14959 raft_consensus.cc:2749] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:31.705050 14958 raft_consensus.cc:515] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.706506 14945 tablet_bootstrap.cc:492] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:31.707180 14945 ts_tablet_manager.cc:1403] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.012s
I20260709 13:23:31.707322 14947 tablet_bootstrap.cc:492] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:31.707981 14947 ts_tablet_manager.cc:1403] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.009s
I20260709 13:23:31.709599 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e005e2ee764603a277d2fe533fa460" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:31.710316 14728 raft_consensus.cc:3060] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:31.711584 14947 raft_consensus.cc:359] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.712497 14947 raft_consensus.cc:385] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.712822 14947 raft_consensus.cc:740] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.713644 14947 consensus_queue.cc:260] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.716790 14947 ts_tablet_manager.cc:1434] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:23:31.717856 14946 tablet_bootstrap.cc:654] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.718008 14947 tablet_bootstrap.cc:492] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:31.721289 14945 raft_consensus.cc:359] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.722198 14945 raft_consensus.cc:385] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.722451 14959 raft_consensus.cc:493] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.722512 14945 raft_consensus.cc:740] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.723258 14959 raft_consensus.cc:515] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.723716 14945 consensus_queue.cc:260] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.726524 14945 ts_tablet_manager.cc:1434] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.002s
I20260709 13:23:31.727741 14945 tablet_bootstrap.cc:492] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:31.728104 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d5960025d34dbba47e46ceb0360cf0" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:31.728962 14802 raft_consensus.cc:2468] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:31.733520 14959 leader_election.cc:290] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:31.735459 14947 tablet_bootstrap.cc:654] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.735321 14617 leader_election.cc:304] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:31.737442 14959 raft_consensus.cc:2804] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:31.740453 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d5960025d34dbba47e46ceb0360cf0" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:31.743983 14945 tablet_bootstrap.cc:654] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.744623 14959 raft_consensus.cc:493] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:31.745929 14959 raft_consensus.cc:3060] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:31.745108 14620 leader_election.cc:343] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.757298 14958 leader_election.cc:290] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:31.760619 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e005e2ee764603a277d2fe533fa460" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:31.762379 14959 raft_consensus.cc:515] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
W20260709 13:23:31.763569 14617 leader_election.cc:343] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9761becfc5946af903b06479e745741 (127.2.243.67:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.766680 14728 raft_consensus.cc:2468] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:31.768199 14946 tablet_bootstrap.cc:492] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:31.768250 14947 tablet_bootstrap.cc:492] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:31.768661 14620 leader_election.cc:304] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: e9761becfc5946af903b06479e745741
I20260709 13:23:31.768958 14959 leader_election.cc:290] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:31.769052 14947 ts_tablet_manager.cc:1403] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.017s
I20260709 13:23:31.768989 14946 ts_tablet_manager.cc:1403] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.038s
I20260709 13:23:31.770013 14959 raft_consensus.cc:2804] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:31.770565 14959 raft_consensus.cc:697] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:31.771999 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d5960025d34dbba47e46ceb0360cf0" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:31.773011 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d5960025d34dbba47e46ceb0360cf0" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
W20260709 13:23:31.773654 14620 leader_election.cc:343] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.773684 14802 raft_consensus.cc:3060] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:31.774107 14946 raft_consensus.cc:359] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.773988 14947 raft_consensus.cc:359] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.774995 14946 raft_consensus.cc:385] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.775086 14947 raft_consensus.cc:385] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.775354 14946 raft_consensus.cc:740] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.775554 14947 raft_consensus.cc:740] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.776535 14946 consensus_queue.cc:260] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.776535 14947 consensus_queue.cc:260] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.779240 14946 ts_tablet_manager.cc:1434] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:23:31.779609 14947 ts_tablet_manager.cc:1434] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:23:31.781340 14947 tablet_bootstrap.cc:492] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:31.781668 14959 consensus_queue.cc:237] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.783172 14945 tablet_bootstrap.cc:492] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:31.783806 14945 ts_tablet_manager.cc:1403] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.003s
I20260709 13:23:31.786474 14946 tablet_bootstrap.cc:492] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:31.790526 14947 tablet_bootstrap.cc:654] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.793732 14802 raft_consensus.cc:2468] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:31.787771 14945 raft_consensus.cc:359] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.795440 14945 raft_consensus.cc:385] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.795997 14946 tablet_bootstrap.cc:654] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.796049 14945 raft_consensus.cc:740] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.802145 14945 consensus_queue.cc:260] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.812871 14945 ts_tablet_manager.cc:1434] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.029s	user 0.014s	sys 0.001s
I20260709 13:23:31.815112 14945 tablet_bootstrap.cc:492] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:31.809329 14617 leader_election.cc:304] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e
I20260709 13:23:31.822475 14959 raft_consensus.cc:2804] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:31.823122 14959 raft_consensus.cc:697] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:31.824419 14959 consensus_queue.cc:237] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.825525 14947 tablet_bootstrap.cc:492] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:31.826285 14947 ts_tablet_manager.cc:1403] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.016s
I20260709 13:23:31.826385 14945 tablet_bootstrap.cc:654] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.829656 14883 raft_consensus.cc:493] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.830405 14947 raft_consensus.cc:359] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.831749 14947 raft_consensus.cc:385] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.832158 14947 raft_consensus.cc:740] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.833335 14947 consensus_queue.cc:260] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.835005 14946 tablet_bootstrap.cc:492] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:31.830471 14883 raft_consensus.cc:515] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.839661 14947 ts_tablet_manager.cc:1434] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:23:31.840121 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eaa8b7c48a443db964c38face13de75" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:31.840934 14802 raft_consensus.cc:2468] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 0.
I20260709 13:23:31.841499 14947 tablet_bootstrap.cc:492] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:31.843199 14692 leader_election.cc:304] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:31.844641 14883 leader_election.cc:290] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:31.845186 14940 raft_consensus.cc:2804] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:31.845656 14946 ts_tablet_manager.cc:1403] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.016s
I20260709 13:23:31.845913 14940 raft_consensus.cc:493] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:31.846622 14940 raft_consensus.cc:3060] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:31.848884 14954 raft_consensus.cc:493] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.850278 14946 raft_consensus.cc:359] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.851352 14946 raft_consensus.cc:385] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:31.851693 14946 raft_consensus.cc:740] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:31.852694 14947 tablet_bootstrap.cc:654] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.852703 14946 consensus_queue.cc:260] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.853276 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eaa8b7c48a443db964c38face13de75" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
W20260709 13:23:31.855765 14695 leader_election.cc:343] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.856388 14946 ts_tablet_manager.cc:1434] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:23:31.857417 14883 raft_consensus.cc:493] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.858052 14946 tablet_bootstrap.cc:492] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:31.858291 14883 raft_consensus.cc:515] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.850123 14954 raft_consensus.cc:515] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.866078 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
W20260709 13:23:31.869298 14769 leader_election.cc:343] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.870254 14946 tablet_bootstrap.cc:654] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:31.870322 14954 leader_election.cc:290] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:31.809253 14548 catalog_manager.cc:5697] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:31.888826 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
W20260709 13:23:31.891558 14769 leader_election.cc:343] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.892488 14769 leader_election.cc:304] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:31.894135 14954 raft_consensus.cc:2749] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:31.899291 14954 raft_consensus.cc:493] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.900123 14954 raft_consensus.cc:515] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.901582 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:31.903403 14954 leader_election.cc:290] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
W20260709 13:23:31.904106 14692 leader_election.cc:343] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9761becfc5946af903b06479e745741 (127.2.243.67:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.906913 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
W20260709 13:23:31.909965 14769 leader_election.cc:343] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:31.911391 14958 raft_consensus.cc:493] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.912211 14958 raft_consensus.cc:515] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.915992 14958 leader_election.cc:290] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:31.916992 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bfbec5442a641cfba5740e9b47dc106" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:31.917856 14728 raft_consensus.cc:2468] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:31.918951 14620 leader_election.cc:304] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:31.920743 14958 raft_consensus.cc:2804] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:31.921224 14958 raft_consensus.cc:493] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:31.921675 14958 raft_consensus.cc:3060] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:31.923262 14883 leader_election.cc:290] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
W20260709 13:23:31.926510 14600 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:31.929196 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bfbec5442a641cfba5740e9b47dc106" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:31.930837 14801 raft_consensus.cc:2468] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:31.932662 14883 raft_consensus.cc:493] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.935722 14883 raft_consensus.cc:515] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.943321 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:31.945937 14652 raft_consensus.cc:2468] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 0.
I20260709 13:23:31.951763 14958 raft_consensus.cc:515] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.961666 14769 leader_election.cc:304] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e
I20260709 13:23:31.963166 14954 raft_consensus.cc:2804] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:31.963855 14954 raft_consensus.cc:493] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:31.964491 14954 raft_consensus.cc:3060] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:31.963938 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:31.969075 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bfbec5442a641cfba5740e9b47dc106" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:31.969910 14728 raft_consensus.cc:3060] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:31.970599 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d5960025d34dbba47e46ceb0360cf0" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:31.971669 14801 raft_consensus.cc:2393] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05553f7076ed412989bffbd7a001751e in current term 1: Already voted for candidate c3f2cb06911b4753b819d30987a8073e in this term.
I20260709 13:23:31.980181 14728 raft_consensus.cc:2468] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:31.982038 14620 leader_election.cc:304] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:31.983146 14959 raft_consensus.cc:2804] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:31.984005 14959 raft_consensus.cc:697] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:31.984128 14958 leader_election.cc:290] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:31.979625 14954 raft_consensus.cc:515] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.985376 14959 consensus_queue.cc:237] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:31.991554 14954 leader_election.cc:290] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:31.994503 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
W20260709 13:23:31.997458 14769 leader_election.cc:343] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:32.017645 14883 leader_election.cc:290] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
W20260709 13:23:32.029443 14695 leader_election.cc:343] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:32.031011 14695 leader_election.cc:304] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05553f7076ed412989bffbd7a001751e; no voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741
I20260709 13:23:32.033870 14978 raft_consensus.cc:2749] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:32.037773 14946 tablet_bootstrap.cc:492] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:32.038787 14946 ts_tablet_manager.cc:1403] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.181s	user 0.045s	sys 0.097s
I20260709 13:23:32.039762 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:32.041167 14652 raft_consensus.cc:3060] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.043658 14946 raft_consensus.cc:359] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.045030 14946 raft_consensus.cc:385] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.045476 14946 raft_consensus.cc:740] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.046555 14946 consensus_queue.cc:260] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.047895 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bfbec5442a641cfba5740e9b47dc106" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:32.050216 14801 raft_consensus.cc:3060] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.052105 14946 ts_tablet_manager.cc:1434] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:23:32.055171 14946 tablet_bootstrap.cc:492] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:32.052919 14940 raft_consensus.cc:515] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.067848 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eaa8b7c48a443db964c38face13de75" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:32.068375 14946 tablet_bootstrap.cc:654] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:32.069111 14802 raft_consensus.cc:3060] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.081851 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d5960025d34dbba47e46ceb0360cf0" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:32.084986 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eaa8b7c48a443db964c38face13de75" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:32.086555 14653 raft_consensus.cc:3060] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.107192 14945 tablet_bootstrap.cc:492] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:32.108101 14945 ts_tablet_manager.cc:1403] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.293s	user 0.085s	sys 0.109s
I20260709 13:23:32.114521 14945 raft_consensus.cc:359] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.115514 14945 raft_consensus.cc:385] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.109382 14940 leader_election.cc:290] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.120209 14653 raft_consensus.cc:2468] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 1.
I20260709 13:23:32.115813 14945 raft_consensus.cc:740] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.117391 14695 leader_election.cc:304] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05553f7076ed412989bffbd7a001751e; no voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741
I20260709 13:23:32.122716 14802 raft_consensus.cc:2468] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 1.
I20260709 13:23:32.125202 14947 tablet_bootstrap.cc:492] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:32.126464 14947 ts_tablet_manager.cc:1403] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.285s	user 0.091s	sys 0.058s
I20260709 13:23:32.125439 14652 raft_consensus.cc:2468] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 1.
I20260709 13:23:32.127724 14692 leader_election.cc:304] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:32.129042 14972 raft_consensus.cc:2804] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:32.129624 14972 raft_consensus.cc:697] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Becoming Leader. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:32.130080 14947 raft_consensus.cc:359] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.130966 14947 raft_consensus.cc:385] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.130527 14972 consensus_queue.cc:237] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.131297 14947 raft_consensus.cc:740] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.132315 14940 raft_consensus.cc:3060] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.132185 14551 catalog_manager.cc:5697] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:32.133396 14801 raft_consensus.cc:2468] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:32.134300 14551 catalog_manager.cc:5697] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:32.134367 14954 raft_consensus.cc:493] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:32.137768 14954 raft_consensus.cc:515] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.140468 14954 leader_election.cc:290] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:32.141803 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e005e2ee764603a277d2fe533fa460" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:32.142676 14728 raft_consensus.cc:2393] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9761becfc5946af903b06479e745741 in current term 1: Already voted for candidate c3f2cb06911b4753b819d30987a8073e in this term.
I20260709 13:23:32.143018 14946 tablet_bootstrap.cc:492] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:32.143633 14946 ts_tablet_manager.cc:1403] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.089s	user 0.030s	sys 0.030s
I20260709 13:23:32.144134 14769 leader_election.cc:304] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e
I20260709 13:23:32.132213 14947 consensus_queue.cc:260] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.141456 14945 consensus_queue.cc:260] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.148691 14945 ts_tablet_manager.cc:1434] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 13:23:32.149691 14954 raft_consensus.cc:2804] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:32.150115 14945 tablet_bootstrap.cc:492] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:32.158778 14946 raft_consensus.cc:359] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.160279 14946 raft_consensus.cc:385] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.160869 14946 raft_consensus.cc:740] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.161957 14946 consensus_queue.cc:260] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.165328 14946 ts_tablet_manager.cc:1434] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:23:32.155656 14940 raft_consensus.cc:2749] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:32.166905 14946 tablet_bootstrap.cc:492] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:32.149691 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e005e2ee764603a277d2fe533fa460" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:32.171679 14769 leader_election.cc:304] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:32.171062 14947 ts_tablet_manager.cc:1434] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.006s
I20260709 13:23:32.173491 14947 tablet_bootstrap.cc:492] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:32.177024 14954 raft_consensus.cc:697] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Leader. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:32.178160 14954 consensus_queue.cc:237] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.179093 14946 tablet_bootstrap.cc:654] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:32.179625 14945 tablet_bootstrap.cc:654] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:32.177052 14981 raft_consensus.cc:3060] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.191215 14551 catalog_manager.cc:5697] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e reported cstate change: term changed from 0 to 1, leader changed from <none> to 05553f7076ed412989bffbd7a001751e (127.2.243.66). New cstate: current_term: 1 leader_uuid: "05553f7076ed412989bffbd7a001751e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:32.184559 14947 tablet_bootstrap.cc:654] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:32.201033 14548 catalog_manager.cc:5697] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9761becfc5946af903b06479e745741 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "e9761becfc5946af903b06479e745741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:32.208410 14959 raft_consensus.cc:493] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:32.209096 14959 raft_consensus.cc:515] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.209606 14945 tablet_bootstrap.cc:492] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:32.210538 14945 ts_tablet_manager.cc:1403] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.005s
I20260709 13:23:32.200122 14981 raft_consensus.cc:2749] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:32.214462 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe6996f7f2c410bba7ab0ff4e601fbf" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:32.215030 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe6996f7f2c410bba7ab0ff4e601fbf" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:32.215451 14959 leader_election.cc:290] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.215751 14728 raft_consensus.cc:2468] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:32.214564 14945 raft_consensus.cc:359] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
W20260709 13:23:32.216706 14617 leader_election.cc:343] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9761becfc5946af903b06479e745741 (127.2.243.67:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:32.217011 14945 raft_consensus.cc:385] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.217602 14945 raft_consensus.cc:740] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.218573 14945 consensus_queue.cc:260] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.220021 14946 tablet_bootstrap.cc:492] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:32.220386 14620 leader_election.cc:304] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: e9761becfc5946af903b06479e745741
I20260709 13:23:32.220695 14946 ts_tablet_manager.cc:1403] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.009s
I20260709 13:23:32.221346 14959 raft_consensus.cc:2804] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:32.221805 14959 raft_consensus.cc:493] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:32.222164 14959 raft_consensus.cc:3060] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.225975 14946 raft_consensus.cc:359] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.226922 14946 raft_consensus.cc:385] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.227216 14946 raft_consensus.cc:740] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.228108 14946 consensus_queue.cc:260] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.230515 14946 ts_tablet_manager.cc:1434] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:23:32.231253 14981 raft_consensus.cc:493] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:32.232074 14946 tablet_bootstrap.cc:492] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e: Bootstrap starting.
I20260709 13:23:32.231892 14981 raft_consensus.cc:515] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.234434 14981 leader_election.cc:290] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:32.235819 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:32.237136 14947 tablet_bootstrap.cc:492] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:32.235754 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:32.237743 14947 ts_tablet_manager.cc:1403] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.006s
I20260709 13:23:32.237993 14728 raft_consensus.cc:2468] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 0.
W20260709 13:23:32.238232 14769 leader_election.cc:343] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:32.239346 14769 leader_election.cc:304] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:32.240720 14981 raft_consensus.cc:2804] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:32.240454 14959 raft_consensus.cc:515] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.241218 14981 raft_consensus.cc:493] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:32.241652 14981 raft_consensus.cc:3060] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.242899 14959 leader_election.cc:290] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.244726 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe6996f7f2c410bba7ab0ff4e601fbf" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:32.244872 14947 raft_consensus.cc:359] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.245673 14947 raft_consensus.cc:385] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.245801 14945 ts_tablet_manager.cc:1434] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:23:32.240458 14946 tablet_bootstrap.cc:654] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:32.244762 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe6996f7f2c410bba7ab0ff4e601fbf" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:32.246726 14728 raft_consensus.cc:3060] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.245975 14947 raft_consensus.cc:740] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.249945 14945 tablet_bootstrap.cc:492] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:32.250061 14947 consensus_queue.cc:260] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.251187 14801 raft_consensus.cc:3060] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.253057 14947 ts_tablet_manager.cc:1434] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:23:32.254338 14947 tablet_bootstrap.cc:492] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741: Bootstrap starting.
I20260709 13:23:32.257186 14728 raft_consensus.cc:2468] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:32.259054 14620 leader_election.cc:304] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:32.260281 14981 raft_consensus.cc:515] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.261413 14959 raft_consensus.cc:2804] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:32.264784 14945 tablet_bootstrap.cc:654] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:32.265792 14959 raft_consensus.cc:697] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:32.266708 14981 leader_election.cc:290] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:32.268289 14947 tablet_bootstrap.cc:654] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:32.267992 14959 consensus_queue.cc:237] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.270534 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
W20260709 13:23:32.272974 14769 leader_election.cc:343] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:32.280726 14945 tablet_bootstrap.cc:492] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:32.281497 14945 ts_tablet_manager.cc:1403] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.006s
I20260709 13:23:32.283303 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:32.284053 14728 raft_consensus.cc:3060] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.285586 14945 raft_consensus.cc:359] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.288470 14945 raft_consensus.cc:385] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.288854 14945 raft_consensus.cc:740] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.289196 14947 tablet_bootstrap.cc:492] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741: No bootstrap required, opened a new log
I20260709 13:23:32.277938 14801 raft_consensus.cc:2468] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:32.289878 14947 ts_tablet_manager.cc:1403] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.006s
I20260709 13:23:32.293768 14947 raft_consensus.cc:359] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.293560 14945 consensus_queue.cc:260] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.294564 14947 raft_consensus.cc:385] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.294891 14947 raft_consensus.cc:740] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.295892 14947 consensus_queue.cc:260] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.297374 14728 raft_consensus.cc:2468] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 1.
I20260709 13:23:32.299070 14769 leader_election.cc:304] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:32.300091 14981 raft_consensus.cc:2804] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:32.300722 14981 raft_consensus.cc:697] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Leader. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:32.301000 14945 ts_tablet_manager.cc:1434] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:23:32.302126 14945 tablet_bootstrap.cc:492] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e: Bootstrap starting.
I20260709 13:23:32.301743 14981 consensus_queue.cc:237] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.305899 14947 ts_tablet_manager.cc:1434] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:23:32.310420 14945 tablet_bootstrap.cc:654] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:32.307811 14551 catalog_manager.cc:5697] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:32.290290 14946 tablet_bootstrap.cc:492] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e: No bootstrap required, opened a new log
I20260709 13:23:32.315083 14946 ts_tablet_manager.cc:1403] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.014s
I20260709 13:23:32.322316 14891 consensus_queue.cc:1048] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:23:32.335371 14891 raft_consensus.cc:493] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:32.334728 14959 consensus_queue.cc:1048] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:23:32.339995 14891 raft_consensus.cc:515] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.343426 14891 leader_election.cc:290] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.347291 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8d984604d146388e3a8f31a966ce05" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:32.349404 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8d984604d146388e3a8f31a966ce05" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:32.349174 14551 catalog_manager.cc:5697] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9761becfc5946af903b06479e745741 (127.2.243.67). New cstate: current_term: 1 leader_uuid: "e9761becfc5946af903b06479e745741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:32.350157 14801 raft_consensus.cc:2468] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
W20260709 13:23:32.350965 14620 leader_election.cc:343] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:32.352195 14617 leader_election.cc:304] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 05553f7076ed412989bffbd7a001751e
I20260709 13:23:32.353700 14959 consensus_queue.cc:1048] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.355425 14891 raft_consensus.cc:2804] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:32.359752 14891 raft_consensus.cc:493] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:32.366694 14891 raft_consensus.cc:3060] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.364661 14945 tablet_bootstrap.cc:492] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e: No bootstrap required, opened a new log
I20260709 13:23:32.374289 14945 ts_tablet_manager.cc:1403] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.001s
I20260709 13:23:32.363520 14946 raft_consensus.cc:359] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.379365 14945 raft_consensus.cc:359] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.400620 14945 raft_consensus.cc:385] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.400992 14945 raft_consensus.cc:740] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.400277 14946 raft_consensus.cc:385] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:32.402166 14946 raft_consensus.cc:740] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Initialized, Role: FOLLOWER
I20260709 13:23:32.401957 14945 consensus_queue.cc:260] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.402774 14958 consensus_queue.cc:1048] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.406083 14945 ts_tablet_manager.cc:1434] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:23:32.407618 14946 consensus_queue.cc:260] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.411013 14946 ts_tablet_manager.cc:1434] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.003s
I20260709 13:23:32.459082 14996 consensus_queue.cc:1048] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.463928 14891 raft_consensus.cc:515] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.469259 14997 consensus_queue.cc:1048] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.479360 14891 leader_election.cc:290] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.480758 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8d984604d146388e3a8f31a966ce05" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:32.481546 14803 raft_consensus.cc:3060] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.480628 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8d984604d146388e3a8f31a966ce05" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:32.489403 14727 raft_consensus.cc:3060] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.498320 14727 raft_consensus.cc:2468] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:32.500183 14620 leader_election.cc:304] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:32.501310 15003 raft_consensus.cc:2804] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:32.501838 15003 raft_consensus.cc:697] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:32.502812 15003 consensus_queue.cc:237] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.517730 14803 raft_consensus.cc:2468] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:32.526198 14549 catalog_manager.cc:5697] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:32.543406 14972 consensus_queue.cc:1048] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:32.556972 14972 consensus_queue.cc:1048] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.605191 15003 raft_consensus.cc:493] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:32.605826 15003 raft_consensus.cc:515] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.606599 14981 consensus_queue.cc:1048] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.608256 15003 leader_election.cc:290] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.609457 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:32.610496 14728 raft_consensus.cc:2468] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:32.610949 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:32.612488 14620 leader_election.cc:304] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:32.614336 15003 raft_consensus.cc:2804] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:32.614904 15003 raft_consensus.cc:493] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:32.615584 15003 raft_consensus.cc:3060] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.616431 14803 raft_consensus.cc:2468] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 0.
I20260709 13:23:32.625680 14728 raft_consensus.cc:3060] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.631969 15003 raft_consensus.cc:515] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.636610 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:32.637432 14727 raft_consensus.cc:3060] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.637949 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:32.638410 15003 leader_election.cc:290] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.638778 14803 raft_consensus.cc:3060] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.642545 14891 raft_consensus.cc:493] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:32.643263 14891 raft_consensus.cc:515] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.645257 14982 consensus_queue.cc:1048] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.646881 14891 leader_election.cc:290] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.647317 14729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05553f7076ed412989bffbd7a001751e" is_pre_election: true
I20260709 13:23:32.648587 14803 raft_consensus.cc:2468] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:32.649610 14729 raft_consensus.cc:2393] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3f2cb06911b4753b819d30987a8073e in current term 1: Already voted for candidate e9761becfc5946af903b06479e745741 in this term.
I20260709 13:23:32.649878 14727 raft_consensus.cc:2468] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 1.
I20260709 13:23:32.652668 14620 leader_election.cc:304] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:32.654112 15003 raft_consensus.cc:2804] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:32.654142 14976 raft_consensus.cc:493] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:32.655433 14803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:32.655295 14976 raft_consensus.cc:515] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.656420 15003 raft_consensus.cc:697] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:32.657936 15003 consensus_queue.cc:237] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:32.658646 14617 leader_election.cc:304] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e; no voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741
I20260709 13:23:32.659736 14802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9761becfc5946af903b06479e745741" is_pre_election: true
I20260709 13:23:32.661253 14891 raft_consensus.cc:3060] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:32.661811 14976 leader_election.cc:290] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:32.669591 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f2cb06911b4753b819d30987a8073e" is_pre_election: true
I20260709 13:23:32.672124 14695 leader_election.cc:304] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05553f7076ed412989bffbd7a001751e; no voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741
I20260709 13:23:32.673574 14976 raft_consensus.cc:2749] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:32.675153 14891 raft_consensus.cc:2749] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:32.678570 14549 catalog_manager.cc:5697] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 1 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:32.783749 14891 consensus_queue.cc:1048] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:32.799176 14891 consensus_queue.cc:1048] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.887841 14954 consensus_queue.cc:1048] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.891420 14954 consensus_queue.cc:1048] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:32.897354 14891 consensus_queue.cc:1048] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:32.931638 14891 consensus_queue.cc:1048] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:23:33.005962 14803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3"
dest_uuid: "e9761becfc5946af903b06479e745741"
mode: GRACEFUL
new_leader_uuid: "c3f2cb06911b4753b819d30987a8073e"
 from {username='slave'} at 127.0.0.1:41756
I20260709 13:23:33.006781 14803 raft_consensus.cc:606] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Received request to transfer leadership to TS c3f2cb06911b4753b819d30987a8073e
I20260709 13:23:33.010640 14982 raft_consensus.cc:993] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741: : Instructing follower c3f2cb06911b4753b819d30987a8073e to start an election
I20260709 13:23:33.011199 14954 raft_consensus.cc:1081] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Signalling peer c3f2cb06911b4753b819d30987a8073e to start an election
I20260709 13:23:33.013317 14652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
 from {username='slave'} at 127.0.0.1:42864
I20260709 13:23:33.014189 14652 raft_consensus.cc:493] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:33.014839 14652 raft_consensus.cc:3060] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.018702 14653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fe6996f7f2c410bba7ab0ff4e601fbf"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
mode: GRACEFUL
new_leader_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:42880
I20260709 13:23:33.019475 14653 raft_consensus.cc:606] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Received request to transfer leadership to TS 05553f7076ed412989bffbd7a001751e
I20260709 13:23:33.023548 14652 raft_consensus.cc:515] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.025959 14652 leader_election.cc:290] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 2 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:33.026010 14803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0"
dest_uuid: "e9761becfc5946af903b06479e745741"
mode: GRACEFUL
new_leader_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:41756
I20260709 13:23:33.026587 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:33.026867 14803 raft_consensus.cc:606] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Received request to transfer leadership to TS 05553f7076ed412989bffbd7a001751e
I20260709 13:23:33.027275 14728 raft_consensus.cc:3060] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.027527 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed74048d6da401a87dc20f014fc52c3" candidate_uuid: "c3f2cb06911b4753b819d30987a8073e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:33.028529 14801 raft_consensus.cc:3055] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:33.029049 14801 raft_consensus.cc:740] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:33.030035 14801 consensus_queue.cc:260] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.031622 14801 raft_consensus.cc:3060] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.036571 14728 raft_consensus.cc:2468] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 2.
I20260709 13:23:33.036917 14652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
mode: GRACEFUL
new_leader_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:42880
I20260709 13:23:33.037773 14652 raft_consensus.cc:606] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Received request to transfer leadership to TS 05553f7076ed412989bffbd7a001751e
I20260709 13:23:33.038081 14620 leader_election.cc:304] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:33.038944 14891 raft_consensus.cc:2804] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.039455 14891 raft_consensus.cc:697] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 2 LEADER]: Becoming Leader. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:33.040256 14891 consensus_queue.cc:237] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.041388 14801 raft_consensus.cc:2468] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f2cb06911b4753b819d30987a8073e in term 2.
I20260709 13:23:33.046962 14652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa8d984604d146388e3a8f31a966ce05"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
mode: GRACEFUL
new_leader_uuid: "e9761becfc5946af903b06479e745741"
 from {username='slave'} at 127.0.0.1:42880
I20260709 13:23:33.047775 14652 raft_consensus.cc:606] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Received request to transfer leadership to TS e9761becfc5946af903b06479e745741
I20260709 13:23:33.052376 14552 catalog_manager.cc:5697] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e reported cstate change: term changed from 1 to 2, leader changed from e9761becfc5946af903b06479e745741 (127.2.243.67) to c3f2cb06911b4753b819d30987a8073e (127.2.243.65). New cstate: current_term: 2 leader_uuid: "c3f2cb06911b4753b819d30987a8073e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:33.053609 14891 consensus_queue.cc:1048] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:33.067255 14891 consensus_queue.cc:1048] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:33.086704 15003 raft_consensus.cc:993] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e: : Instructing follower 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:33.087231 15003 raft_consensus.cc:1081] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Signalling peer 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:33.089593 14728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c"
dest_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:36044
I20260709 13:23:33.090265 14728 raft_consensus.cc:493] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:33.090704 14728 raft_consensus.cc:3060] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.100167 14728 raft_consensus.cc:515] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.102263 14728 leader_election.cc:290] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:33.103494 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:33.103543 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3339a35c754193a2ed0526c250631c" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:33.104436 14652 raft_consensus.cc:3055] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:33.104496 14801 raft_consensus.cc:3060] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.104780 14652 raft_consensus.cc:740] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:33.105629 14652 consensus_queue.cc:260] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.106756 14652 raft_consensus.cc:3060] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.111364 14801 raft_consensus.cc:2468] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:33.112840 14652 raft_consensus.cc:2468] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:33.112924 14692 leader_election.cc:304] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:33.114099 14972 raft_consensus.cc:2804] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.114579 14972 raft_consensus.cc:697] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Becoming Leader. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:33.115478 14972 consensus_queue.cc:237] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.123160 14552 catalog_manager.cc:5697] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e reported cstate change: term changed from 1 to 2, leader changed from c3f2cb06911b4753b819d30987a8073e (127.2.243.65) to 05553f7076ed412989bffbd7a001751e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "05553f7076ed412989bffbd7a001751e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:33.305080 14982 raft_consensus.cc:993] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741: : Instructing follower 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:33.305629 14954 raft_consensus.cc:1081] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Signalling peer 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:33.307344 14728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0"
dest_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:36042
I20260709 13:23:33.307974 14728 raft_consensus.cc:493] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:33.308264 14728 raft_consensus.cc:3060] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.314190 14728 raft_consensus.cc:515] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.315791 14728 leader_election.cc:290] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:33.317013 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:33.317059 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87544905f0e549cdacc51ce75d172cf0" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:33.317785 14652 raft_consensus.cc:3060] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.317813 14801 raft_consensus.cc:3055] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:33.318364 14801 raft_consensus.cc:740] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:33.319401 14801 consensus_queue.cc:260] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.320657 14801 raft_consensus.cc:3060] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.325919 14652 raft_consensus.cc:2468] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:33.327319 14695 leader_election.cc:304] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, c3f2cb06911b4753b819d30987a8073e; no voters: 
I20260709 13:23:33.327452 14801 raft_consensus.cc:2468] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:33.328521 14972 raft_consensus.cc:2804] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.329095 14972 raft_consensus.cc:697] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Becoming Leader. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:33.329975 14972 consensus_queue.cc:237] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.338068 14552 catalog_manager.cc:5697] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e reported cstate change: term changed from 1 to 2, leader changed from e9761becfc5946af903b06479e745741 (127.2.243.67) to 05553f7076ed412989bffbd7a001751e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "05553f7076ed412989bffbd7a001751e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:33.365718 14891 raft_consensus.cc:993] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e: : Instructing follower 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:33.366320 15003 raft_consensus.cc:1081] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Signalling peer 05553f7076ed412989bffbd7a001751e to start an election
I20260709 13:23:33.368325 14728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fe6996f7f2c410bba7ab0ff4e601fbf"
dest_uuid: "05553f7076ed412989bffbd7a001751e"
 from {username='slave'} at 127.0.0.1:36044
I20260709 13:23:33.369065 14728 raft_consensus.cc:493] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:33.369422 14728 raft_consensus.cc:3060] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.375844 14728 raft_consensus.cc:515] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.378080 14728 leader_election.cc:290] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), e9761becfc5946af903b06479e745741 (127.2.243.67:44429)
I20260709 13:23:33.379213 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe6996f7f2c410bba7ab0ff4e601fbf" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:33.379724 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe6996f7f2c410bba7ab0ff4e601fbf" candidate_uuid: "05553f7076ed412989bffbd7a001751e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9761becfc5946af903b06479e745741"
I20260709 13:23:33.380164 14653 raft_consensus.cc:3055] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:33.380324 14801 raft_consensus.cc:3060] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.380620 14653 raft_consensus.cc:740] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:33.381613 14653 consensus_queue.cc:260] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.383109 14653 raft_consensus.cc:3060] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.390417 14801 raft_consensus.cc:2468] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:33.392299 14692 leader_election.cc:304] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:33.392908 14653 raft_consensus.cc:2468] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05553f7076ed412989bffbd7a001751e in term 2.
I20260709 13:23:33.393455 14972 raft_consensus.cc:2804] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.394675 14972 raft_consensus.cc:697] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Becoming Leader. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:33.395844 14972 consensus_queue.cc:237] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.404317 14552 catalog_manager.cc:5697] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e reported cstate change: term changed from 1 to 2, leader changed from c3f2cb06911b4753b819d30987a8073e (127.2.243.65) to 05553f7076ed412989bffbd7a001751e (127.2.243.66). New cstate: current_term: 2 leader_uuid: "05553f7076ed412989bffbd7a001751e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:33.476596 15000 raft_consensus.cc:993] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: : Instructing follower e9761becfc5946af903b06479e745741 to start an election
I20260709 13:23:33.477293 14891 raft_consensus.cc:1081] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Signalling peer e9761becfc5946af903b06479e745741 to start an election
I20260709 13:23:33.479342 14801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa8d984604d146388e3a8f31a966ce05"
dest_uuid: "e9761becfc5946af903b06479e745741"
 from {username='slave'} at 127.0.0.1:41750
I20260709 13:23:33.480060 14801 raft_consensus.cc:493] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:33.480561 14801 raft_consensus.cc:3060] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.489348 14801 raft_consensus.cc:515] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.491292 14801 leader_election.cc:290] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 2 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:33.492590 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8d984604d146388e3a8f31a966ce05" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:33.493031 14728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8d984604d146388e3a8f31a966ce05" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:33.493569 14728 raft_consensus.cc:3060] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.493600 14653 raft_consensus.cc:3055] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:33.494230 14653 raft_consensus.cc:740] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:33.495246 14653 consensus_queue.cc:260] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.496748 14653 raft_consensus.cc:3060] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.503535 14728 raft_consensus.cc:2468] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 2.
I20260709 13:23:33.505162 14769 leader_election.cc:304] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05553f7076ed412989bffbd7a001751e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:33.505854 14653 raft_consensus.cc:2468] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 2.
I20260709 13:23:33.506217 14954 raft_consensus.cc:2804] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.506844 14954 raft_consensus.cc:697] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 2 LEADER]: Becoming Leader. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:33.507809 14954 consensus_queue.cc:237] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:33.510298 14653 raft_consensus.cc:1275] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.513370 14972 consensus_queue.cc:1048] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:33.518263 14552 catalog_manager.cc:5697] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 reported cstate change: term changed from 1 to 2, leader changed from c3f2cb06911b4753b819d30987a8073e (127.2.243.65) to e9761becfc5946af903b06479e745741 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "e9761becfc5946af903b06479e745741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:33.527325 14801 raft_consensus.cc:1275] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.530105 14972 consensus_queue.cc:1048] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:23:33.579733 14801 raft_consensus.cc:1275] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Refusing update from remote peer c3f2cb06911b4753b819d30987a8073e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.581342 15003 consensus_queue.cc:1048] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:33.589649 14728 raft_consensus.cc:1275] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Refusing update from remote peer c3f2cb06911b4753b819d30987a8073e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.591565 15000 consensus_queue.cc:1048] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:33.767890 14653 raft_consensus.cc:1275] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.769394 14976 consensus_queue.cc:1048] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:33.783120 14801 raft_consensus.cc:1275] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.784982 14976 consensus_queue.cc:1048] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:33.815706 14801 raft_consensus.cc:1275] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.817185 14976 consensus_queue.cc:1048] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:33.827899 14653 raft_consensus.cc:1275] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Refusing update from remote peer 05553f7076ed412989bffbd7a001751e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.831297 15023 consensus_queue.cc:1048] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:34.024744 14653 raft_consensus.cc:1275] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Refusing update from remote peer e9761becfc5946af903b06479e745741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:34.026176 14954 consensus_queue.cc:1048] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:34.039258 14728 raft_consensus.cc:1275] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Refusing update from remote peer e9761becfc5946af903b06479e745741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:34.042425 14954 consensus_queue.cc:1048] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:36.053049 14550 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60126:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:23:36.077873 14550 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60126:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:23:36.125077  3021 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:23:36.320955 15046 log.cc:927] Time spent T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:23:36.448066 15078 tablet.cc:1724] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.519975 15081 tablet.cc:1724] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.533779 14650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af47e2740f25491dae550fe984a63891"
dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
mode: GRACEFUL
new_leader_uuid: "e9761becfc5946af903b06479e745741"
 from {username='slave'} at 127.0.0.1:54564
I20260709 13:23:36.554358 14650 raft_consensus.cc:606] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Received request to transfer leadership to TS e9761becfc5946af903b06479e745741
W20260709 13:23:36.577261 15079 log.cc:927] Time spent T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
W20260709 13:23:36.595115 15084 log.cc:927] Time spent T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
I20260709 13:23:36.602870 15088 tablet.cc:1724] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.636989 15094 tablet.cc:1724] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.662797 15098 tablet.cc:1724] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.683387 15096 tablet.cc:1724] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.688324 15099 tablet.cc:1724] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:23:36.693688 15086 log.cc:927] Time spent T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
W20260709 13:23:36.696910 15093 log.cc:927] Time spent T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:23:36.715545 15095 tablet.cc:1724] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.724134 15102 tablet.cc:1724] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.640453 15100 tablet.cc:1724] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:23:36.706959 14769 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.243.65:44275, user_credentials={real_user=slave}} blocked reactor thread for 70615.3us
I20260709 13:23:36.750931 15071 raft_consensus.cc:993] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e: : Instructing follower e9761becfc5946af903b06479e745741 to start an election
I20260709 13:23:36.751542 15071 raft_consensus.cc:1081] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Signalling peer e9761becfc5946af903b06479e745741 to start an election
I20260709 13:23:36.757619 14802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af47e2740f25491dae550fe984a63891"
dest_uuid: "e9761becfc5946af903b06479e745741"
 from {username='slave'} at 127.0.0.1:41750
I20260709 13:23:36.758360 14802 raft_consensus.cc:493] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:36.758786 14802 raft_consensus.cc:3060] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:36.641193 15101 tablet.cc:1724] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.770946 14550 catalog_manager.cc:5789] TS c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275) does not have the latest schema for tablet 93d5960025d34dbba47e46ceb0360cf0 (table soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]). Expected version 1 got 0
I20260709 13:23:36.772523 14550 catalog_manager.cc:5789] TS c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275) does not have the latest schema for tablet 2ed74048d6da401a87dc20f014fc52c3 (table soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]). Expected version 1 got 0
I20260709 13:23:36.774029 14550 catalog_manager.cc:5789] TS c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275) does not have the latest schema for tablet e6e005e2ee764603a277d2fe533fa460 (table soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]). Expected version 1 got 0
I20260709 13:23:36.775657 15105 tablet.cc:1724] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.780781 15081 tablet.cc:1724] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.798803 15099 tablet.cc:1724] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.805325 14726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450"
dest_uuid: "05553f7076ed412989bffbd7a001751e"
mode: GRACEFUL
new_leader_uuid: "e9761becfc5946af903b06479e745741"
 from {username='slave'} at 127.0.0.1:39666
I20260709 13:23:36.806213 14726 raft_consensus.cc:606] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Received request to transfer leadership to TS e9761becfc5946af903b06479e745741
I20260709 13:23:36.808073  3021 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:36.808948  3021 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:36.808451 14802 raft_consensus.cc:515] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:36.811739 14802 leader_election.cc:290] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 2 election: Requested vote from peers 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693), c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275)
I20260709 13:23:36.811915 14552 catalog_manager.cc:5789] TS 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693) does not have the latest schema for tablet 7fe6996f7f2c410bba7ab0ff4e601fbf (table soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]). Expected version 1 got 0
I20260709 13:23:36.813804 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af47e2740f25491dae550fe984a63891" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:36.814606 14653 raft_consensus.cc:3055] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:36.814010 15078 tablet.cc:1724] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.814855 14551 catalog_manager.cc:5789] TS e9761becfc5946af903b06479e745741 (127.2.243.67:44429) does not have the latest schema for tablet fa8d984604d146388e3a8f31a966ce05 (table soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863]). Expected version 1 got 0
I20260709 13:23:36.814988 14653 raft_consensus.cc:740] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f2cb06911b4753b819d30987a8073e, State: Running, Role: LEADER
I20260709 13:23:36.817319 14653 consensus_queue.cc:260] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:36.818987 14653 raft_consensus.cc:3060] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:36.815922 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af47e2740f25491dae550fe984a63891" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:36.820784 14726 raft_consensus.cc:3060] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:36.823289 15099 tablet.cc:1724] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.825083 15098 tablet.cc:1724] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.820906 15096 tablet.cc:1724] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.836743 15088 tablet.cc:1724] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.839957 15099 tablet.cc:1724] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.851852 15105 tablet.cc:1724] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.856254 15094 tablet.cc:1724] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.868016 15088 tablet.cc:1724] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.883981 15088 tablet.cc:1724] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.896148 15095 tablet.cc:1724] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.896520 15101 tablet.cc:1724] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.872177 14653 raft_consensus.cc:2468] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 2.
I20260709 13:23:36.899704 14769 leader_election.cc:304] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:36.894023 14726 raft_consensus.cc:2468] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 2.
I20260709 13:23:36.901070 15106 raft_consensus.cc:2804] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:36.902160 15106 raft_consensus.cc:697] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 2 LEADER]: Becoming Leader. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:36.903111 15106 consensus_queue.cc:237] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } }
I20260709 13:23:36.926422 15101 tablet.cc:1724] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:36.948387 14552 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58: soft_deleted_table [id=9bd1c332c5c94b01bdc22e2d63aee863] alter complete (version 1)
I20260709 13:23:36.961850 14552 catalog_manager.cc:5697] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 reported cstate change: term changed from 1 to 2, leader changed from c3f2cb06911b4753b819d30987a8073e (127.2.243.65) to e9761becfc5946af903b06479e745741 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "e9761becfc5946af903b06479e745741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:37.004968 15058 raft_consensus.cc:993] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e: : Instructing follower e9761becfc5946af903b06479e745741 to start an election
I20260709 13:23:37.005725 15077 raft_consensus.cc:1081] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Signalling peer e9761becfc5946af903b06479e745741 to start an election
I20260709 13:23:37.007905 14802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450"
dest_uuid: "e9761becfc5946af903b06479e745741"
 from {username='slave'} at 127.0.0.1:41744
I20260709 13:23:37.008591 14802 raft_consensus.cc:493] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:37.009155 14802 raft_consensus.cc:3060] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.016620 14802 raft_consensus.cc:515] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:37.018756 14802 leader_election.cc:290] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 2 election: Requested vote from peers c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275), 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693)
I20260709 13:23:37.019798 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f2cb06911b4753b819d30987a8073e"
I20260709 13:23:37.020288 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fa1e98bf304a84bf3940a40d480450" candidate_uuid: "e9761becfc5946af903b06479e745741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05553f7076ed412989bffbd7a001751e"
I20260709 13:23:37.020808 14653 raft_consensus.cc:3060] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.020967 14726 raft_consensus.cc:3055] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:37.021378 14726 raft_consensus.cc:740] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05553f7076ed412989bffbd7a001751e, State: Running, Role: LEADER
I20260709 13:23:37.022264 14726 consensus_queue.cc:260] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:37.023677 14726 raft_consensus.cc:3060] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.029982 14653 raft_consensus.cc:2468] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 2.
I20260709 13:23:37.031673 14769 leader_election.cc:304] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3f2cb06911b4753b819d30987a8073e, e9761becfc5946af903b06479e745741; no voters: 
I20260709 13:23:37.032737 15106 raft_consensus.cc:2804] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:37.032857 14726 raft_consensus.cc:2468] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9761becfc5946af903b06479e745741 in term 2.
I20260709 13:23:37.033351 15106 raft_consensus.cc:697] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 2 LEADER]: Becoming Leader. State: Replica: e9761becfc5946af903b06479e745741, State: Running, Role: LEADER
I20260709 13:23:37.034451 15106 consensus_queue.cc:237] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } }
I20260709 13:23:37.046113 14548 catalog_manager.cc:5697] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 reported cstate change: term changed from 1 to 2, leader changed from 05553f7076ed412989bffbd7a001751e (127.2.243.66) to e9761becfc5946af903b06479e745741 (127.2.243.67). New cstate: current_term: 2 leader_uuid: "e9761becfc5946af903b06479e745741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9761becfc5946af903b06479e745741" member_type: VOTER last_known_addr { host: "127.2.243.67" port: 44429 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:37.317698 14653 raft_consensus.cc:1275] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Refusing update from remote peer e9761becfc5946af903b06479e745741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:37.319761 15059 consensus_queue.cc:1048] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:37.333109 14726 raft_consensus.cc:1275] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Refusing update from remote peer e9761becfc5946af903b06479e745741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:37.335361 15106 consensus_queue.cc:1048] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:37.463330 14726 raft_consensus.cc:1275] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Refusing update from remote peer e9761becfc5946af903b06479e745741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:37.465093 15106 consensus_queue.cc:1048] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05553f7076ed412989bffbd7a001751e" member_type: VOTER last_known_addr { host: "127.2.243.66" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:37.478228 14651 raft_consensus.cc:1275] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Refusing update from remote peer e9761becfc5946af903b06479e745741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:37.480738 15113 consensus_queue.cc:1048] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f2cb06911b4753b819d30987a8073e" member_type: VOTER last_known_addr { host: "127.2.243.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:37.891320  3021 tablet_server.cc:179] TabletServer@127.2.243.65:0 shutting down...
W20260709 13:23:37.898521 14769 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 13:23:37.905296 14769 consensus_peers.cc:597] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 -> Peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Couldn't send request to peer c3f2cb06911b4753b819d30987a8073e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:37.930177 14769 consensus_peers.cc:597] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 -> Peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Couldn't send request to peer c3f2cb06911b4753b819d30987a8073e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:37.959442  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:37.961009  3021 tablet_replica.cc:333] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.961978  3021 raft_consensus.cc:2243] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:37.962728  3021 raft_consensus.cc:2272] T 87544905f0e549cdacc51ce75d172cf0 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:37.965294  3021 tablet_replica.cc:333] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.966348  3021 raft_consensus.cc:2243] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:37.967003  3021 raft_consensus.cc:2272] T fa8d984604d146388e3a8f31a966ce05 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:37.969607  3021 tablet_replica.cc:333] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.970587  3021 raft_consensus.cc:2243] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:37.971400  3021 raft_consensus.cc:2272] T 6eaa8b7c48a443db964c38face13de75 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:37.974505  3021 tablet_replica.cc:333] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.975226  3021 raft_consensus.cc:2243] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:37.976135  3021 raft_consensus.cc:2272] T 1bfbec5442a641cfba5740e9b47dc106 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:37.978693  3021 tablet_replica.cc:333] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.979574  3021 raft_consensus.cc:2243] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:37.980116  3021 raft_consensus.cc:2272] T 8e3339a35c754193a2ed0526c250631c P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:37.982105  3021 tablet_replica.cc:333] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.982630  3021 raft_consensus.cc:2243] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:37.983054  3021 raft_consensus.cc:2272] T 7fe6996f7f2c410bba7ab0ff4e601fbf P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:37.985397  3021 tablet_replica.cc:333] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.986030  3021 raft_consensus.cc:2243] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:37.986912  3021 raft_consensus.cc:2272] T 19b8fb3c4ec84237b08fbe99ebc60f60 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:37.992945  3021 tablet_replica.cc:333] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.993587  3021 raft_consensus.cc:2243] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:37.994572  3021 raft_consensus.cc:2272] T e6e005e2ee764603a277d2fe533fa460 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:37.996877  3021 tablet_replica.cc:333] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:37.997473  3021 raft_consensus.cc:2243] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:37.998370  3021 raft_consensus.cc:2272] T 2ed74048d6da401a87dc20f014fc52c3 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.000665  3021 tablet_replica.cc:333] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.001320  3021 raft_consensus.cc:2243] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.001789  3021 raft_consensus.cc:2272] T b3fa1e98bf304a84bf3940a40d480450 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.004952  3021 tablet_replica.cc:333] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.005609  3021 raft_consensus.cc:2243] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.006100  3021 raft_consensus.cc:2272] T d22eed3e0be240859f8b98b4d3f2f7c1 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.008685  3021 tablet_replica.cc:333] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.009284  3021 raft_consensus.cc:2243] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.009768  3021 raft_consensus.cc:2272] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.012090  3021 tablet_replica.cc:333] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.012744  3021 raft_consensus.cc:2243] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.013842  3021 raft_consensus.cc:2272] T 93d5960025d34dbba47e46ceb0360cf0 P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.016129  3021 tablet_replica.cc:333] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.016824  3021 raft_consensus.cc:2243] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.017778  3021 raft_consensus.cc:2272] T 608206fd924d4a1388a4c651cd04e6fa P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.020254  3021 tablet_replica.cc:333] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.020931  3021 raft_consensus.cc:2243] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.021497  3021 raft_consensus.cc:2272] T 7c3371995d104e5989a49ef93aafb78e P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.024058  3021 tablet_replica.cc:333] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.024791  3021 raft_consensus.cc:2243] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.025321  3021 raft_consensus.cc:2272] T af47e2740f25491dae550fe984a63891 P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.028986  3021 tablet_replica.cc:333] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.029704  3021 raft_consensus.cc:2243] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.030743  3021 raft_consensus.cc:2272] T 7edaca98e9dd47f3bd0a4d49716193db P c3f2cb06911b4753b819d30987a8073e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:38.033056 14695 consensus_peers.cc:597] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e -> Peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Couldn't send request to peer c3f2cb06911b4753b819d30987a8073e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.034510  3021 tablet_replica.cc:333] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e: stopping tablet replica
I20260709 13:23:38.035358  3021 raft_consensus.cc:2243] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.035866  3021 raft_consensus.cc:2272] T f414b45b72b34f86a9538d95740342ee P c3f2cb06911b4753b819d30987a8073e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.085907  3021 tablet_server.cc:196] TabletServer@127.2.243.65:0 shutdown complete.
W20260709 13:23:38.120426 14695 consensus_peers.cc:597] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e -> Peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Couldn't send request to peer c3f2cb06911b4753b819d30987a8073e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.129222  3021 tablet_server.cc:179] TabletServer@127.2.243.66:0 shutting down...
W20260709 13:23:38.158947 14695 consensus_peers.cc:597] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e -> Peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Couldn't send request to peer c3f2cb06911b4753b819d30987a8073e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.173118  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:38.174074  3021 tablet_replica.cc:333] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.174870  3021 raft_consensus.cc:2243] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.175509  3021 raft_consensus.cc:2272] T fa8d984604d146388e3a8f31a966ce05 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.178319  3021 tablet_replica.cc:333] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.179026  3021 raft_consensus.cc:2243] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.180032  3021 raft_consensus.cc:2272] T 87544905f0e549cdacc51ce75d172cf0 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.182485  3021 tablet_replica.cc:333] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.183168  3021 raft_consensus.cc:2243] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.183689  3021 raft_consensus.cc:2272] T 1bfbec5442a641cfba5740e9b47dc106 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.186039  3021 tablet_replica.cc:333] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.186730  3021 raft_consensus.cc:2243] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.187645  3021 raft_consensus.cc:2272] T 8e3339a35c754193a2ed0526c250631c P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.190807  3021 tablet_replica.cc:333] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.191498  3021 raft_consensus.cc:2243] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.192065  3021 raft_consensus.cc:2272] T 2ed74048d6da401a87dc20f014fc52c3 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.194049  3021 tablet_replica.cc:333] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.194759  3021 raft_consensus.cc:2243] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.195951  3021 raft_consensus.cc:2272] T 7fe6996f7f2c410bba7ab0ff4e601fbf P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.198851  3021 tablet_replica.cc:333] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.199592  3021 raft_consensus.cc:2243] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.200172  3021 raft_consensus.cc:2272] T 19b8fb3c4ec84237b08fbe99ebc60f60 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:38.203248 14769 consensus_peers.cc:597] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 -> Peer c3f2cb06911b4753b819d30987a8073e (127.2.243.65:44275): Couldn't send request to peer c3f2cb06911b4753b819d30987a8073e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.65:44275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.204154  3021 tablet_replica.cc:333] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.205087  3021 raft_consensus.cc:2243] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.205717  3021 raft_consensus.cc:2272] T e6e005e2ee764603a277d2fe533fa460 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.208606  3021 tablet_replica.cc:333] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.209251  3021 raft_consensus.cc:2243] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.210289  3021 raft_consensus.cc:2272] T d22eed3e0be240859f8b98b4d3f2f7c1 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.212693  3021 tablet_replica.cc:333] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.213431  3021 raft_consensus.cc:2243] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.213948  3021 raft_consensus.cc:2272] T 7edaca98e9dd47f3bd0a4d49716193db P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.216621  3021 tablet_replica.cc:333] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.217494  3021 raft_consensus.cc:2243] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.217979  3021 raft_consensus.cc:2272] T b3fa1e98bf304a84bf3940a40d480450 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.221104  3021 tablet_replica.cc:333] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.221758  3021 raft_consensus.cc:2243] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.222645  3021 raft_consensus.cc:2272] T 6eaa8b7c48a443db964c38face13de75 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.224876  3021 tablet_replica.cc:333] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.225448  3021 raft_consensus.cc:2243] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.225873  3021 raft_consensus.cc:2272] T f414b45b72b34f86a9538d95740342ee P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.228124  3021 tablet_replica.cc:333] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.229027  3021 raft_consensus.cc:2243] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.229656  3021 raft_consensus.cc:2272] T 93d5960025d34dbba47e46ceb0360cf0 P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.232066  3021 tablet_replica.cc:333] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.232945  3021 raft_consensus.cc:2243] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.233525  3021 raft_consensus.cc:2272] T 608206fd924d4a1388a4c651cd04e6fa P 05553f7076ed412989bffbd7a001751e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.236181  3021 tablet_replica.cc:333] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.236864  3021 raft_consensus.cc:2243] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.237838  3021 raft_consensus.cc:2272] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.240595  3021 tablet_replica.cc:333] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.241225  3021 raft_consensus.cc:2243] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.242240  3021 raft_consensus.cc:2272] T 7c3371995d104e5989a49ef93aafb78e P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.244747  3021 tablet_replica.cc:333] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e: stopping tablet replica
I20260709 13:23:38.245290  3021 raft_consensus.cc:2243] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.245788  3021 raft_consensus.cc:2272] T af47e2740f25491dae550fe984a63891 P 05553f7076ed412989bffbd7a001751e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:38.290146 14769 consensus_peers.cc:597] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 -> Peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Couldn't send request to peer 05553f7076ed412989bffbd7a001751e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:33693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.294108  3021 tablet_server.cc:196] TabletServer@127.2.243.66:0 shutdown complete.
W20260709 13:23:38.302755 14769 consensus_peers.cc:597] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 -> Peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Couldn't send request to peer 05553f7076ed412989bffbd7a001751e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:33693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:38.323534 14769 consensus_peers.cc:597] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 -> Peer 05553f7076ed412989bffbd7a001751e (127.2.243.66:33693): Couldn't send request to peer 05553f7076ed412989bffbd7a001751e. Status: Network error: Client connection negotiation failed: client connection to 127.2.243.66:33693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.342507  3021 tablet_server.cc:179] TabletServer@127.2.243.67:0 shutting down...
I20260709 13:23:38.376828  3021 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:38.377943  3021 tablet_replica.cc:333] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.379083  3021 raft_consensus.cc:2243] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.380324  3021 raft_consensus.cc:2272] T fa8d984604d146388e3a8f31a966ce05 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.382718  3021 tablet_replica.cc:333] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.383350  3021 raft_consensus.cc:2243] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.383823  3021 raft_consensus.cc:2272] T 87544905f0e549cdacc51ce75d172cf0 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.385984  3021 tablet_replica.cc:333] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.386541  3021 raft_consensus.cc:2243] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.386974  3021 raft_consensus.cc:2272] T 1bfbec5442a641cfba5740e9b47dc106 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.389045  3021 tablet_replica.cc:333] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.389643  3021 raft_consensus.cc:2243] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.390468  3021 raft_consensus.cc:2272] T af47e2740f25491dae550fe984a63891 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.393402  3021 tablet_replica.cc:333] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.394158  3021 raft_consensus.cc:2243] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.394768  3021 raft_consensus.cc:2272] T 7c3371995d104e5989a49ef93aafb78e P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.397460  3021 tablet_replica.cc:333] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.398150  3021 raft_consensus.cc:2243] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.398686  3021 raft_consensus.cc:2272] T 93d5960025d34dbba47e46ceb0360cf0 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.401387  3021 tablet_replica.cc:333] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.402070  3021 raft_consensus.cc:2243] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.402779  3021 raft_consensus.cc:2272] T 608206fd924d4a1388a4c651cd04e6fa P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.405706  3021 tablet_replica.cc:333] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.406697  3021 raft_consensus.cc:2243] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.407279  3021 raft_consensus.cc:2272] T 61bc727a8c5e4cf4bad18fc1dc5a9f5a P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.409873  3021 tablet_replica.cc:333] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.410739  3021 raft_consensus.cc:2243] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.411254  3021 raft_consensus.cc:2272] T d22eed3e0be240859f8b98b4d3f2f7c1 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.414366  3021 tablet_replica.cc:333] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.415120  3021 raft_consensus.cc:2243] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.415714  3021 raft_consensus.cc:2272] T 6eaa8b7c48a443db964c38face13de75 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.418084  3021 tablet_replica.cc:333] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.418761  3021 raft_consensus.cc:2243] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.419343  3021 raft_consensus.cc:2272] T 7fe6996f7f2c410bba7ab0ff4e601fbf P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.421622  3021 tablet_replica.cc:333] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.422307  3021 raft_consensus.cc:2243] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.422832  3021 raft_consensus.cc:2272] T e6e005e2ee764603a277d2fe533fa460 P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.425017  3021 tablet_replica.cc:333] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.425612  3021 raft_consensus.cc:2243] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.426450  3021 raft_consensus.cc:2272] T 8e3339a35c754193a2ed0526c250631c P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.428732  3021 tablet_replica.cc:333] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.429338  3021 raft_consensus.cc:2243] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.429847  3021 raft_consensus.cc:2272] T 2ed74048d6da401a87dc20f014fc52c3 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.431963  3021 tablet_replica.cc:333] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.432574  3021 raft_consensus.cc:2243] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.433094  3021 raft_consensus.cc:2272] T 19b8fb3c4ec84237b08fbe99ebc60f60 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.435619  3021 tablet_replica.cc:333] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.436218  3021 raft_consensus.cc:2243] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.437244  3021 raft_consensus.cc:2272] T f414b45b72b34f86a9538d95740342ee P e9761becfc5946af903b06479e745741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.439594  3021 tablet_replica.cc:333] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.440207  3021 raft_consensus.cc:2243] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.440834  3021 raft_consensus.cc:2272] T 7edaca98e9dd47f3bd0a4d49716193db P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.444269  3021 tablet_replica.cc:333] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741: stopping tablet replica
I20260709 13:23:38.445173  3021 raft_consensus.cc:2243] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.446292  3021 raft_consensus.cc:2272] T b3fa1e98bf304a84bf3940a40d480450 P e9761becfc5946af903b06479e745741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.483748  3021 tablet_server.cc:196] TabletServer@127.2.243.67:0 shutdown complete.
I20260709 13:23:38.525018  3021 master.cc:562] Master@127.2.243.126:40583 shutting down...
I20260709 13:23:38.552769  3021 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.553424  3021 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.553740  3021 tablet_replica.cc:333] T 00000000000000000000000000000000 P b4905a0328fe450f845b63dc7f028e58: stopping tablet replica
I20260709 13:23:38.577210  3021 master.cc:584] Master@127.2.243.126:40583 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12943 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (28311 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (369933 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:23:38.644416  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 418 messages since previous log ~16 seconds ago
I20260709 13:23:38.644786  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 418 messages since previous log ~16 seconds ago
I20260709 13:23:38.645007  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 414 messages since previous log ~16 seconds ago
I20260709 13:23:38.645254  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:23:38.645473  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:23:38.645720  3021 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~191 seconds ago
I20260709 13:23:38.645957  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~191 seconds ago
I20260709 13:23:38.646263  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 9 messages since previous log ~197 seconds ago
I20260709 13:23:38.646586  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:23:38.646938  3021 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
